Skip to content

[PHASE 4] Add scheduled label coverage audit workflow #2833

Description

@ashleyshaw

Phase 4c: Scheduled Label Coverage Audit Workflow (Future Enhancement)

Set up scheduled GitHub Actions workflow to audit label coverage and track trends over time.

🎯 Objectives

  • Run weekly audit on all open issues/PRs
  • Generate audit reports (CLI, Markdown, JSON)
  • Track coverage trends over time
  • Auto-create issue with audit results
  • Generate recommendations

✅ Features

Weekly Audit Run

  • Schedule: Every Monday at 2 AM UTC
  • Audit all open issues and PRs
  • Calculate coverage metrics
  • Identify top missing labels

Report Generation

  • CLI report (console output)
  • Markdown report (human-readable)
  • JSON report (machine-readable)
  • Trend analysis (vs. previous week)

Issue Creation

  • Auto-create weekly audit issue
  • Include:
    • Summary statistics
    • Coverage by family
    • Top missing labels
    • Recommended bulk labels
    • Trend analysis
    • Links to non-compliant issues
  • Label with: type:audit, area:governance, meta:bot-generated

Trend Tracking

  • Store weekly snapshots in project folder
  • Calculate trend (improving/declining)
  • Generate 4-week chart
  • Alert if coverage drops

💻 Implementation Plan

Workflow Setup

  • Create .github/workflows/audit-label-coverage.yml
  • Schedule with cron: 0 2 * * 1 (Monday 2 AM UTC)
  • Call audit-label-coverage skill
  • Generate reports

Trend Tracking

  • Store audit snapshots in .github/projects/active/audit-trends/
  • Calculate week-over-week change
  • Generate trend chart (PNG or SVG)
  • Include in report

Issue Auto-Creation

  • Use actions/github-script
  • Create issue with audit results
  • Apply labels
  • Link to full reports

📊 Effort & Timeline

Timeline: Post-Phase 3 (target: Oct 2026)
Effort: 3–4 hours (workflow setup + testing)
Owner: TBD

🔗 Related Issues

Epic: #2681
Phase 4a: #2689 (Issue Agent skills)
Phase 4b: #2690 (CI Error Diagnosis Skill)

📚 References

  • Label Audit Skill: skills/audit-label-coverage/
  • Example Workflow: .github/workflows/changelog-management.yml
  • Cron Syntax: https://crontab.guru/

📋 Expected Output

Weekly Issue Example:

Title: Weekly Label Coverage Audit — Sept 8, 2026

## Summary
- Total Issues: 245
- Fully Labeled (100%): 25 (10%)
- Partially Labeled: 185 (75%)
- Unlabeled (0%): 35 (15%)
- Average Coverage: 71.5% (+2.5% vs. last week ✅)

## Family Coverage
- type: 100% ✓
- status: 85% (↑ +3%)
- priority: 62% (↑ +1%)
- area: 78% (↑ +2%)

## Recommendations
- Apply `priority:normal` to 80+ issues
- Apply `status:needs-triage` to 50 issues
- Apply `area:ci` to 35 issues

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

Fields

Priority

None yet

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions