debug-fuzzer-failure

Debugging SSA Fuzzer Failures

This skill provides the complete workflow for debugging SSA optimization bugs discovered by CI fuzzers. It combines two sub-skills:

1. extract-fuzzer-repro — Extract a Noir project from CI failure logs
2. bisect-ssa-pass — Bisect SSA passes to find the one that breaks semantics

When to Use This Skill

Use this when:

• A pass_vs_prev fuzzer test fails in CI
• You have a GitHub Actions URL showing a fuzzer failure
• You need to go from "CI is red" to "I know which SSA pass has the bug"

Note: This workflow is tailored for pass_vs_prev failures, which detect SSA passes that break semantic preservation. Other fuzzers exist that test different properties and may require different debugging approaches. Identify the fuzzer type from the failing test name in the GitHub logs — it follows the format targets::<fuzzer_type>::tests::fuzz_with_arbtest. If the failure comes from a fuzzer other than pass_vs_prev, ask the developer for guidance on how to proceed.

Workflow Overview

1. Extract reproduction case from CI logs (extract-fuzzer-repro)
2. Verify the failure reproduces locally
3. Bisect, analyze, and fix (bisect-ssa-pass)

Step 1: Extract the Reproduction Case

Use the extract-fuzzer-repro skill to get a local Noir project from the CI logs.

Input: GitHub Actions job URL (e.g., https://github.com/noir-lang/noir/actions/runs/12345/job/67890)

Output: A Noir project directory with:

• src/main.nr — The generated program that triggered the failure
• Prover.toml — Input values that cause the bug

Quick reference:

# Download logs from GitHub Actions
gh run view <run-id> --job <job-id> --log > fuzzer_log.txt

# Extract the Noir project (the skill has detailed instructions)
# Look for "Program:" and "Inputs:" sections in the log

Step 2: Verify the Failure Reproduces Locally

Before bisecting, confirm the issue reproduces:

cd <extracted_project>
nargo execute

If using experimental features (like enums/match), add the appropriate flags:

nargo execute -Zenums

Step 3: Bisect and Fix

Use the bisect-ssa-pass skill to:

• Identify which optimization pass breaks semantics
• Analyze the incorrect transformation
• Create a regression test
• Fix the bug

Tips

• The pass_vs_prev fuzzer compares interpretation results before and after each pass, so failures indicate semantic preservation bugs
• Keep the extracted project around until the fix is merged — you may need to re-test
• If the SSA is complex, focus on the specific function/block where the semantic change occurs

Related Skills

• extract-fuzzer-repro — Detailed instructions for extracting from CI logs
• bisect-ssa-pass — Detailed instructions for SSA bisection and regression tests