feat: validate workflow agent output schemas #373

Merged

dries merged 2 commits from fix/workflow-json-output-hardening into main

2026-07-18 10:11:05 +02:00

dries commented

2026-07-17 23:48:39 +02:00

Owner

Summary

add optional agent.outputSchema to JSON/YAML workflow definitions and MCP authoring guidance
compile schemas during validate/publish and reject external references
include required schemas in agent prompts and validate final responses at runtime
accept any completed response when no schema is declared
silently unwrap Markdown-fenced JSON before schema validation and allow one corrective retry
add schemas to the migration workflow outputs consumed downstream

Testing

failing-first schema/no-schema runtime tests
make lint
make test
go test -cover ./internal/workflows ./internal/mcp
pnpm exec tsc -b

## Summary - add optional `agent.outputSchema` to JSON/YAML workflow definitions and MCP authoring guidance - compile schemas during validate/publish and reject external references - include required schemas in agent prompts and validate final responses at runtime - accept any completed response when no schema is declared - silently unwrap Markdown-fenced JSON before schema validation and allow one corrective retry - add schemas to the migration workflow outputs consumed downstream ## Testing - failing-first schema/no-schema runtime tests - `make lint` - `make test` - `go test -cover ./internal/workflows ./internal/mcp` - `pnpm exec tsc -b`

dries added 1 commit

2026-07-17 23:48:39 +02:00

fix: harden workflow JSON output handling

CI / Build Desktop (macOS arm64) (pull_request) Successful in 2m8s

Details

CI / Frontend (pull_request) Successful in 5m58s

Details

CI / Backend (pull_request) Successful in 6m6s

Details

CI / Playwright E2E (pull_request) Successful in 9m3s

Details

CI / Build (pull_request) Successful in 6m22s

Details

CI / Semantic Tag (pull_request) Waiting to run

Details

CI / Coverage Results (pull_request) Successful in 32s

Details

a6281c63f6

Append a JSON-output instruction to every agent prompt and silently
strip a surrounding Markdown code fence from agent and command output
before validation, so a fenced JSON result no longer triggers a
correction round-trip or a hard failure.

forgejo-actions commented

2026-07-18 00:03:37 +02:00

Coverage ratchet: ✅ pass

Suite	Baseline	This PR	Δ
frontend	65.73%	65.73%	+0.00	✅
go	77.40%	77.50%	+0.10	✅

Tolerance: -0.1%. Baseline stored on gh-pages.

### Coverage ratchet: ✅ pass | Suite | Baseline | This PR | Δ | | |---|---|---|---|---| | frontend | 65.73% | 65.73% | +0.00 | ✅ | | go | 77.40% | 77.50% | +0.10 | ✅ | _Tolerance: -0.1%. Baseline stored on `gh-pages`._

dries added 1 commit

2026-07-18 00:04:20 +02:00

feat: add workflow agent output schemas

CI / Build Desktop (macOS arm64) (pull_request) Successful in 2m0s

Details

CI / Frontend (pull_request) Successful in 6m20s

Details

CI / Build (pull_request) Successful in 6m55s

Details

CI / Backend (pull_request) Successful in 9m18s

Details

CI / Playwright E2E (pull_request) Successful in 9m17s