fix: clean-lens findings + trim the dogfood swarm to strong reviewers (#4)
Build & push image / build-and-push (push) Successful in 9s

emit() now skips findings extraction for a "No material issues found"
lens (its path:line refs are verification notes, not problems), fixing
the FP inflation that penalized thorough clean-pass reviewers. Also trims
the dogfood swarm to the strong reviewers: drops m5/qwen3.6 (last local
lane), gemma4, gpt-oss:120b, and kimi-k2.7-code — leaving 6 cloud +
claude-code/sonnet.

Fittingly, PR #4's own 11-model review produced 43 findings that were ALL
clean-verification bullets (zero real) — a live demonstration of the bug
this fixes. gofmt clean, go vet quiet, go test -race green.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Steve Dudenhoeffer <steve@stevedudenhoeffer.com>
Co-committed-by: Steve Dudenhoeffer <steve@stevedudenhoeffer.com>
This commit was merged in pull request #4.
This commit is contained in:
2026-06-27 22:14:07 +00:00
committed by steve
parent 82f7ef78d5
commit 80d8f53f63
4 changed files with 68 additions and 34 deletions
+13 -31
View File
@@ -4,8 +4,8 @@
# caches :latest, and this build is what carries foreman provider-type support)
# as a specialist swarm and posts
# ONE consolidated review comment as gitea-actions. Advisory only — never blocks a
# merge. Gadfly reviewing its OWN PRs — dogfooding: 9 cloud + the M5 Mac + the
# Claude Code engine (sonnet) as a competitor (M1 dropped as too slow).
# merge. Gadfly reviewing its OWN PRs — dogfooding: 6 cloud models + the Claude
# Code engine (sonnet) as a competitor. Local Macs and weak cloud models dropped.
name: Adversarial Review (Gadfly)
@@ -41,8 +41,8 @@ jobs:
|| github.actor == 'fizi'
|| github.actor == 'dazed'))
runs-on: ubuntu-latest
# Fleet (9 cloud + M5 Mac + claude-code/sonnet, all concurrent) reviewing
# every PR with the 3-lens suite — the slow local lane dominates wall time.
# Fleet (6 cloud + claude-code/sonnet, all concurrent) reviewing every PR
# with the 3-lens suite. All cloud now, so runs are fast.
timeout-minutes: 90
steps:
- uses: docker://gitea.stevedudenhoeffer.com/steve/gadfly:sha-86f12c1
@@ -54,38 +54,20 @@ jobs:
# below): Pro/Max subscription token. Dogfoods the Phase-1 engine on
# gadfly's own PRs as a competitor alongside the Ollama models.
CLAUDE_CODE_OAUTH_TOKEN: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
# Local Mac (M5), reached through its foreman queue (native Ollama on the
# wire). Gadfly's GADFLY_ENDPOINT_* form with the "foreman" provider
# type: GADFLY_ENDPOINT_M5 registers provider "m5", building a
# foreman-preset Ollama client at the given URL. (M1 is dropped from
# gadfly's swarm — too slow/low-signal — so its endpoint isn't mapped.)
# Values
# (host + token) live in gitea secrets, each of the form:
# foreman|https://<foreman-host>|<token>
# (converted from the komodo LLM_* DSNs foreman://<token>@<host>).
# REQUIRES a Gadfly image built with foreman provider-type support
# (the GADFLY_ENDPOINT "foreman|..." type); on an older image the m1/m5
# lanes error with "unknown provider foreman". The HTTPS-only LLM_*
# foreman:// DSN is the alternative that needs no image rebuild.
# NOTE: the Mac behind each foreman must still be awake/reachable; if a
# box is offline, that model's comment shows an error and the others
# still post. (Gitea secrets aren't auto-exposed — map each explicitly.)
GADFLY_ENDPOINT_M5: ${{ secrets.GADFLY_ENDPOINT_M5 }}
# Fleet: 9 cloud (3 at a time) + M5 Max + Claude Code (sonnet) — one
# consolidated comment each. Matches mort's cloud set so the scoreboard
# is comparable; M1 Pro is intentionally dropped here (too slow); and
# claude-code/sonnet runs the Phase-1 engine as a competitor (its own
# lane, needs CLAUDE_CODE_OAUTH_TOKEN above).
GADFLY_MODELS: "minimax-m3:cloud,glm-5.2:cloud,glm-5.1:cloud,kimi-k2.7-code:cloud,deepseek-v4-pro:cloud,nemotron-3-super:cloud,gpt-oss:120b-cloud,qwen3-coder:480b-cloud,gemma4:cloud,m5/qwen3.6:35b-mlx,claude-code/sonnet"
# cloud runs 3 at once; the Mac one at a time; claude-code one at a time;
# all three lanes run in parallel.
GADFLY_PROVIDER_CONCURRENCY: "ollama-cloud=3,m5=1,claude-code=1"
# Fleet: 6 cloud (3 at a time) + Claude Code (sonnet) — one consolidated
# comment each, all cloud now. The local Macs (m1/m5) and the weaker
# cloud models (gemma4, gpt-oss:120b, kimi-k2.7-code) were dropped as
# low-signal for gadfly's own PRs. claude-code/sonnet runs the Phase-1
# engine as a competitor in its own lane (needs CLAUDE_CODE_OAUTH_TOKEN).
GADFLY_MODELS: "minimax-m3:cloud,glm-5.2:cloud,glm-5.1:cloud,deepseek-v4-pro:cloud,nemotron-3-super:cloud,qwen3-coder:480b-cloud,claude-code/sonnet"
# cloud runs 3 at once; claude-code one at a time; both lanes parallel.
GADFLY_PROVIDER_CONCURRENCY: "ollama-cloud=3,claude-code=1"
# 3 cloud models x 3 lenses = 9 concurrent ollama-cloud queries (under the 10 budget).
GADFLY_PROVIDER_LENS_CONCURRENCY: "ollama-cloud=3"
# Default => the 3-lens suite (security, correctness, error-handling).
# Set the repo var GADFLY_SPECIALISTS to override (csv / "all" / "auto").
GADFLY_SPECIALISTS: ${{ vars.GADFLY_SPECIALISTS || 'security,correctness,error-handling' }}
# Per-lens deadline + bounded steps so the slow local models stay sane.
# Per-lens deadline + bounded steps (also bounds the claude-code lane).
GADFLY_TIMEOUT_SECS: "600"
GADFLY_MAX_STEPS: "14"
# Allow-list for the comment trigger (mirrors the job-level if: guard).