Skip to content

ci: let the dependency audit fail - #69

Open
mattglory wants to merge 1 commit into
mainfrom
ci-dependency-audit-can-fail
Open

mattglory wants to merge 1 commit into
mainfrom
ci-dependency-audit-can-fail

Conversation

@mattglory

Copy link
Copy Markdown
Owner

Summary

Removes continue-on-error: true from both npm audit --audit-level=high steps in security.yml, so the Dependency Audit job can actually go red.

Why

With the flag set, the job passed unconditionally. Evidence from PR #61's Security Scan run (before the deps fix in #63): the audit step printed several Severity: high findings and the job's conclusion was success. It stayed green while GitHub showed one critical and six high alerts. A check that can't fail isn't evidence of anything, which is the F-7 shape, and it's what a Slack "Security CI" summary (proposed by Hillary) would have reported as all-clear. This should land before any such notification.

Safe to merge now

  • Both audits exit 0 today (root: 0 vulnerabilities after chore(deps): clear the critical and all high Dependabot alerts #63; web: 0 high/critical), so this doesn't turn the check red now, only when a new high/critical advisory lands.
  • Dependency Audit is not a required check (Build Frontend and Test Smart Contracts are), so a red run is a signal and never blocks a merge.
  • The workflow still parses (validated), and only that file changed.

Trade-off worth knowing

A new advisory can turn Dependency Audit red on an unrelated PR. That's the intended signal, but it can look like noise. The weekly Monday run means it's caught even without PR traffic. npm audit also depends on the registry being reachable, so a transient network failure will show as red too.

.github/workflows/ is CODEOWNERS-protected (Hillary).

🤖 Generated with Claude Code

Both `npm audit --audit-level=high` steps had continue-on-error: true, so the
Dependency Audit job could never go red. Evidence: PR #61's Security Scan run
printed several "Severity: high" findings and the job concluded success; the
check stayed green throughout a period when GitHub showed one critical and six
high alerts. A check that cannot fail is not evidence of anything -- the F-7
shape -- and it is what any notification layered on this workflow would have
reported as "Security CI passed".

Removes both flags. Verified: both audits exit 0 today (root: 0
vulnerabilities after #63; web: 0 high/critical), so this does not turn the
check red now, only when a new high or critical advisory lands. Dependency
Audit is not one of the two required status checks (Build Frontend, Test Smart
Contracts), so a red run is a signal, never a merge block.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@vercel

vercel Bot commented Sep 21, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
web Ready Ready Preview Sep 21, 2026 12:07pm UTC

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant