Skip to content

[DevOps]: Setup ingestion cron job at remaining DOE sites #331

Closed

Description

@tomvothecoder

Task Details

Follow up to #169, which contains the blueprint for setting up the ingestion workflow at other sites.

Steps to Complete

Obtain credentials

  • 1. PNNL Compy -- In Progress
  • 2. ORNL Frontier
  • 3. ALCF Aurora

Setup ingestion pipeline

For each site:

  1. Add site config
  2. Add cronjob -- Requires API credentials
    • Perform dry-run on staging and performance directories
  3. Validate dry-runs
  4. Perform full-runs
  5. Validate full-runs
  6. Done

Additional Notes

No response

Activity

  1. added
    devopsDevOps task (e.g., DOE site ingestion, CI/CD, Docker)
    on Sep 9, 2026
  2. tomvothecoder commented on Sep 22, 2026

    @tomvothecoder
    CollaboratorAuthor

    I will be taking over this task

  3. TonyB9000 commented on Sep 22, 2026

    @TonyB9000
    Collaborator

    @tomvothecoder OK. You should not run into any great difficulties - save for account noise.

  4. tomvothecoder commented on Oct 8, 2026

    @tomvothecoder
    CollaboratorAuthor

    Superceded by #374, #375, and #376

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

devopsDevOps task (e.g., DOE site ingestion, CI/CD, Docker)

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions