fix: clean-lens findings + trim the dogfood swarm to strong reviewers (#4)
Build & push image / build-and-push (push) Successful in 9s
Build & push image / build-and-push (push) Successful in 9s
emit() now skips findings extraction for a "No material issues found" lens (its path:line refs are verification notes, not problems), fixing the FP inflation that penalized thorough clean-pass reviewers. Also trims the dogfood swarm to the strong reviewers: drops m5/qwen3.6 (last local lane), gemma4, gpt-oss:120b, and kimi-k2.7-code — leaving 6 cloud + claude-code/sonnet. Fittingly, PR #4's own 11-model review produced 43 findings that were ALL clean-verification bullets (zero real) — a live demonstration of the bug this fixes. gofmt clean, go vet quiet, go test -race green. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: Steve Dudenhoeffer <steve@stevedudenhoeffer.com> Co-committed-by: Steve Dudenhoeffer <steve@stevedudenhoeffer.com>
This commit was merged in pull request #4.
This commit is contained in:
@@ -4,8 +4,8 @@
|
||||
# caches :latest, and this build is what carries foreman provider-type support)
|
||||
# as a specialist swarm and posts
|
||||
# ONE consolidated review comment as gitea-actions. Advisory only — never blocks a
|
||||
# merge. Gadfly reviewing its OWN PRs — dogfooding: 9 cloud + the M5 Mac + the
|
||||
# Claude Code engine (sonnet) as a competitor (M1 dropped as too slow).
|
||||
# merge. Gadfly reviewing its OWN PRs — dogfooding: 6 cloud models + the Claude
|
||||
# Code engine (sonnet) as a competitor. Local Macs and weak cloud models dropped.
|
||||
|
||||
name: Adversarial Review (Gadfly)
|
||||
|
||||
@@ -41,8 +41,8 @@ jobs:
|
||||
|| github.actor == 'fizi'
|
||||
|| github.actor == 'dazed'))
|
||||
runs-on: ubuntu-latest
|
||||
# Fleet (9 cloud + M5 Mac + claude-code/sonnet, all concurrent) reviewing
|
||||
# every PR with the 3-lens suite — the slow local lane dominates wall time.
|
||||
# Fleet (6 cloud + claude-code/sonnet, all concurrent) reviewing every PR
|
||||
# with the 3-lens suite. All cloud now, so runs are fast.
|
||||
timeout-minutes: 90
|
||||
steps:
|
||||
- uses: docker://gitea.stevedudenhoeffer.com/steve/gadfly:sha-86f12c1
|
||||
@@ -54,38 +54,20 @@ jobs:
|
||||
# below): Pro/Max subscription token. Dogfoods the Phase-1 engine on
|
||||
# gadfly's own PRs as a competitor alongside the Ollama models.
|
||||
CLAUDE_CODE_OAUTH_TOKEN: ${{ secrets.CLAUDE_CODE_OAUTH_TOKEN }}
|
||||
# Local Mac (M5), reached through its foreman queue (native Ollama on the
|
||||
# wire). Gadfly's GADFLY_ENDPOINT_* form with the "foreman" provider
|
||||
# type: GADFLY_ENDPOINT_M5 registers provider "m5", building a
|
||||
# foreman-preset Ollama client at the given URL. (M1 is dropped from
|
||||
# gadfly's swarm — too slow/low-signal — so its endpoint isn't mapped.)
|
||||
# Values
|
||||
# (host + token) live in gitea secrets, each of the form:
|
||||
# foreman|https://<foreman-host>|<token>
|
||||
# (converted from the komodo LLM_* DSNs foreman://<token>@<host>).
|
||||
# REQUIRES a Gadfly image built with foreman provider-type support
|
||||
# (the GADFLY_ENDPOINT "foreman|..." type); on an older image the m1/m5
|
||||
# lanes error with "unknown provider foreman". The HTTPS-only LLM_*
|
||||
# foreman:// DSN is the alternative that needs no image rebuild.
|
||||
# NOTE: the Mac behind each foreman must still be awake/reachable; if a
|
||||
# box is offline, that model's comment shows an error and the others
|
||||
# still post. (Gitea secrets aren't auto-exposed — map each explicitly.)
|
||||
GADFLY_ENDPOINT_M5: ${{ secrets.GADFLY_ENDPOINT_M5 }}
|
||||
# Fleet: 9 cloud (3 at a time) + M5 Max + Claude Code (sonnet) — one
|
||||
# consolidated comment each. Matches mort's cloud set so the scoreboard
|
||||
# is comparable; M1 Pro is intentionally dropped here (too slow); and
|
||||
# claude-code/sonnet runs the Phase-1 engine as a competitor (its own
|
||||
# lane, needs CLAUDE_CODE_OAUTH_TOKEN above).
|
||||
GADFLY_MODELS: "minimax-m3:cloud,glm-5.2:cloud,glm-5.1:cloud,kimi-k2.7-code:cloud,deepseek-v4-pro:cloud,nemotron-3-super:cloud,gpt-oss:120b-cloud,qwen3-coder:480b-cloud,gemma4:cloud,m5/qwen3.6:35b-mlx,claude-code/sonnet"
|
||||
# cloud runs 3 at once; the Mac one at a time; claude-code one at a time;
|
||||
# all three lanes run in parallel.
|
||||
GADFLY_PROVIDER_CONCURRENCY: "ollama-cloud=3,m5=1,claude-code=1"
|
||||
# Fleet: 6 cloud (3 at a time) + Claude Code (sonnet) — one consolidated
|
||||
# comment each, all cloud now. The local Macs (m1/m5) and the weaker
|
||||
# cloud models (gemma4, gpt-oss:120b, kimi-k2.7-code) were dropped as
|
||||
# low-signal for gadfly's own PRs. claude-code/sonnet runs the Phase-1
|
||||
# engine as a competitor in its own lane (needs CLAUDE_CODE_OAUTH_TOKEN).
|
||||
GADFLY_MODELS: "minimax-m3:cloud,glm-5.2:cloud,glm-5.1:cloud,deepseek-v4-pro:cloud,nemotron-3-super:cloud,qwen3-coder:480b-cloud,claude-code/sonnet"
|
||||
# cloud runs 3 at once; claude-code one at a time; both lanes parallel.
|
||||
GADFLY_PROVIDER_CONCURRENCY: "ollama-cloud=3,claude-code=1"
|
||||
# 3 cloud models x 3 lenses = 9 concurrent ollama-cloud queries (under the 10 budget).
|
||||
GADFLY_PROVIDER_LENS_CONCURRENCY: "ollama-cloud=3"
|
||||
# Default => the 3-lens suite (security, correctness, error-handling).
|
||||
# Set the repo var GADFLY_SPECIALISTS to override (csv / "all" / "auto").
|
||||
GADFLY_SPECIALISTS: ${{ vars.GADFLY_SPECIALISTS || 'security,correctness,error-handling' }}
|
||||
# Per-lens deadline + bounded steps so the slow local models stay sane.
|
||||
# Per-lens deadline + bounded steps (also bounds the claude-code lane).
|
||||
GADFLY_TIMEOUT_SECS: "600"
|
||||
GADFLY_MAX_STEPS: "14"
|
||||
# Allow-list for the comment trigger (mirrors the job-level if: guard).
|
||||
|
||||
Reference in New Issue
Block a user