Skip to content

DevIndex: Add Scheduled Hourly Updater Workflow #9119

@tobiu

Description

@tobiu

This task implements a scheduled GitHub Actions workflow to keep the DevIndex data fresh.

Objective:
Run the DevIndex.services.Updater automatically on an hourly basis to update user profiles and contribution stats.

Strategy:

  • Schedule: Hourly (cron: '0 * * * *').
  • Batch Size: Limit to 200 users per run.
    • Rationale: This stays safely within the 1,000 req/hour limit for public repositories, even accounting for 2-4x retry logic on errors.
    • Throughput: ~4,800 updates/day -> ~3 day full refresh cycle for 15k users.
  • Persistence: The workflow will commit changes to users.jsonl and tracker.json back to the dev branch.

Implementation:

  • Create .github/workflows/devindex-updater.yml
  • Use stefanzweifel/git-auto-commit-action for reliable committing.
  • Use concurrency to prevent overlapping runs.

Metadata

Metadata

Assignees

Labels

aibuildBuild system, scripts, and configurationenhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions