Skip to content

Fix missing work-queue diagnostic guidance - #71665

Merged
pelikhan merged 5 commits into
mainfrom
copilot/avengerfix-work-queue-diagnostic-guidance
Oct 24, 2026
Merged

pelikhan merged 5 commits into
mainfrom
copilot/avengerfix-work-queue-diagnostic-guidance

Conversation

Copilot AI commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

Three work-queue diagnostics lacked evidence/remedy mappings, causing four guidance assertions to fail.

  • Diagnostic coverage: Map work_queue_pool_not_installed, work_queue_policy_proposal_mismatch, and work_queue_worker_not_compiler_approved into existing table rows.
  • Consumption budget: Tighten wording to keep the playbook at 2,799 words, below the 2,800-word limit.
  • Scope: Change only .github/aw/debug-playbook.md; no runtime or workflow changes.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] [avenger] Fix missing work-queue diagnostic guidance Fix missing work-queue diagnostic guidance Oct 24, 2026
Copilot AI requested a review from pelikhan October 24, 2026 15:30
@pelikhan
pelikhan marked this pull request as ready for review October 24, 2026 15:35
Copilot AI max review requested due to automatic review settings October 24, 2026 15:35
@github-actions

github-actions Bot commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

✅ Test Quality Sentinel completed test quality analysis.

Test Quality Sentinel

Outcome: reported_no_action

The agent completed and reported no action. A no-op output alone does not verify that all required work was completed or that publication was possible.

Agent messages are omitted from this comment. The category uses structured run status, not interpretation of agent prose.

Generated from Test Quality Sentinel · sonnet50 · ~15 AIC · ⌖ ~16 AIC · ◇ ~7 AIC · ⊞ 12.7K · ◷

🧪 Test quality analysis by Test Quality Sentinel

@github-actions

github-actions Bot commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

🧠 Matt Pocock Skills Reviewer has completed the skills-based review. ✅

🧠 Reviewed using Matt Pocock's skills by Matt Pocock Skills Reviewer

@github-actions

github-actions Bot commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

✅ Ponytail Reviewer completed successfully!

Ponytail Reviewer

Outcome: reported_no_action

The agent completed and reported no action. A no-op output alone does not verify that all required work was completed or that publication was possible.

Agent messages are omitted from this comment. The category uses structured run status, not interpretation of agent prose.

Generated from Ponytail Reviewer · gpt56 · ~6 AIC · ⌖ ~6 AIC · ⊞ 14.8K · ◷

Generated by Ponytail Reviewer for #71665

@github-actions

github-actions Bot commented Oct 24, 2026 •

Copy link
Copy Markdown
Contributor

✅ PR Code Quality Reviewer completed the code quality review.

🔎 Code quality review by PR Code Quality Reviewer

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

No actionable correctness or security issues found in the documentation-only changes. The three diagnostics are mapped into the existing work-queue guidance table, and the remedy text remains consistent with the playbook's supported deployment/update guidance.

🔎 Code quality review by PR Code Quality Reviewer · copilot · gpt50 · ~2 AIC · ⌖ ~1 AIC · ⊞ 1.6K
Comment /review to run again

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Skills-Based Review 🧠

Applied /grill-with-docs (per pr-triage recommendation for this documentation-only change) and independently re-ran the test_debug_playbook_covers_diagnostic_codes and consumption-budget tests against reconstructed pre/post versions of the file to verify the PR's claims.

📋 Verification & Key Themes

Verification performed

  • Reconstructed the pre-PR table rows and confirmed work_queue_pool_not_installed, work_queue_policy_proposal_mismatch, and work_queue_worker_not_compiler_approved were genuinely unmapped before this change (each code appears 2-4 times across actions/setup/js/work_queue_*.cjs source files picked up by the guidance test's registry scan).
  • Confirmed the post-PR file maps all three codes into existing rows and the remaining 10 test_debug_playbook_covers_diagnostic_codes subtest failures (e.g. ERR_COMPILE_AGENTIC_VERSION_BLOCKED, ERR_GRADER_SESSION_INVALID, ERR_WORK_QUEUE_CLAIM_SCOPE) are present identically in both pre- and post-PR versions -- i.e. pre-existing and out of scope for this PR.
  • Verified the word/byte consumption budget: 2,799 words / 25,665 bytes, under the 2,800-word / 26,000-byte limits asserted by test_debug_playbook_agent_consumption_budget.
  • Confirmed scope: diff touches only .github/aw/debug-playbook.md, no runtime/workflow files.

Minor note

  • Left one inline comment: the work_queue_pool_not_installed merge into the queue_missing/policy_missing row slightly blurs pool-specific vs. queue-bootstrap remedies compared to the more precise per-code explanation in docs/reference/work-queue.md. Non-blocking -- wording tightening for a strict word budget is a reasonable tradeoff here.

Positive highlights

  • ✅ Correctly identifies and fixes exactly the failing assertions described in the linked issue (#71636), with no scope creep.
  • ✅ Stays within the hard-coded word/byte budget enforced by tests.
  • ✅ Minimal, surgical diff (3 additions / 3 deletions) with no unrelated changes.

🧠 Reviewed using Matt Pocock's skills by Matt Pocock Skills Reviewer · copilot · sonnet50 · ~142 AIC · ⌖ ~15 AIC · ⊞ 10.2K
Comment /matt to run again

Comment thread .github/aw/debug-playbook.md Outdated
| `unsupported_protocol`, `codec_invalid`, `invalid_json`, `invalid_utf8`, `invalid_unicode`, `duplicate_key`, `noncanonical_number` | Version, canonical bytes, keys, Unicode/numbers. | Align producer/reader; regenerate input, not history. |
| `ledger_invalid`, `ledger_foreign`, `ledger_nonextending` | Queue identity, DAG, ancestry. | Stop publication; recover trusted queue/tip via protocol. |
| `queue_missing`, `policy_missing` | Queue location; trusted config. | Approved AW-managed bootstrap/deployment; no manual admin seeding. |
| `queue_missing`, `policy_missing`, `work_queue_pool_not_installed` | Queue/pool; compiled/installed policy. | Approved AW-managed bootstrap/deployment; no manual admin seeding. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[/grill-with-docs] Merging work_queue_pool_not_installed into the queue_missing/policy_missing row conflates two different failure scopes: the former is pool-specific (per work-queue.md line 334, "the requested pool is absent from installed Policy"), while the row remedy talks about queue bootstrap broadly. A reader chasing this specific code may not immediately see that the fix is a Policy update to add the pool, not a bootstrap/deployment action.

💡 Suggestion

Consider whether the remedy column should mention "or add the missing pool via an administrator Policy update" to match the more precise guidance already present in docs/src/content/docs/reference/work-queue.md:334. This keeps the playbook row consistent with the canonical per-code explanation used elsewhere in the repo.

@copilot please address this.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The playbook now separates queue/policy bootstrap from the missing-pool remedy: quiesce the queue, then add the pool via an administrator-authorized Policy update. Commit d696d1482a.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Recovery guidance needs to distinguish installed Policy updates from deployment and compiler-approval fixes.

2 open issues
What changed in this PR

Updates gh-aw’s debugging playbook to cover three previously unmapped work-queue diagnostics without changing runtime code or workflows.

Changes:

  • Adds the diagnostics to existing evidence/remedy rows.
  • Tightens table wording to retain the 2,799-word consumption budget.
File Description
.github/​aw/​debug-playbook.md Adds work-queue diagnostic mappings and condenses guidance.

Review effort: Max

Comment thread .github/aw/debug-playbook.md Outdated
| `unsupported_protocol`, `codec_invalid`, `invalid_json`, `invalid_utf8`, `invalid_unicode`, `duplicate_key`, `noncanonical_number` | Version, canonical bytes, keys, Unicode/numbers. | Align producer/reader; regenerate input, not history. |
| `ledger_invalid`, `ledger_foreign`, `ledger_nonextending` | Queue identity, DAG, ancestry. | Stop publication; recover trusted queue/tip via protocol. |
| `queue_missing`, `policy_missing` | Queue location; trusted config. | Approved AW-managed bootstrap/deployment; no manual admin seeding. |
| `queue_missing`, `policy_missing`, `work_queue_pool_not_installed` | Queue/pool; compiled/installed policy. | Approved AW-managed bootstrap/deployment; no manual admin seeding. |

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing-pool recovery now explicitly requires quiescence followed by an administrator-authorized Policy update that adds the pool; bootstrap remains for missing queues or policies. Commit d696d1482a.

Comment thread .github/aw/debug-playbook.md Outdated
| `policy_invalid`, `policy_epoch_invalid`, `policy_proposal_mismatch`, `profile_invalid`, `pool_invalid`, `dispatcher_invalid` | Schema, approved revision, epoch, pools/dispatcher. | Correct trusted config via supported deployment/update. |
| `work_queue_profile_not_approved`, `work_queue_dispatch_credential_identity_unavailable` | Worker approval; verifiable dispatch identity. | Fix approved deployment/credentials; never substitute unverified identity. |
| `policy_invalid`, `policy_epoch_invalid`, `policy_proposal_mismatch`, `work_queue_policy_proposal_mismatch`, `profile_invalid`, `pool_invalid`, `dispatcher_invalid` | Schema/revision, epoch, pools/dispatcher. | Correct trusted config via supported deployment/update. |
| `work_queue_profile_not_approved`, `work_queue_worker_not_compiler_approved`, `work_queue_dispatch_credential_identity_unavailable` | Compiler-approved worker; verifiable identity. | Fix approved deployment/credentials; never substitute unverified identity. |

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The row names the installed-profile check and caller-compiled dispatch allowlist, and separates quiescent Policy profile updates from allowlist/credential fixes. Commit d696d1482a.

@pelikhan

Copy link
Copy Markdown
Collaborator

@copilot run pr-finisher skill

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
@gh-aw-bot

Copy link
Copy Markdown
Collaborator

@copilot address the following outstanding work in one pass:

  1. Update this branch with the latest main using make merge-main, resolving any conflicts and preserving the intended changes.
  2. Review (.github/aw/debug-playbook.md:233): [/grill-with-docs] Merging work_queue_pool_not_installed into the queue_missing/policy_missing row conflates two different failure scopes: the former is pool-specific (per work-queue.md line 334, "the requested pool is absent from installed Policy"), while the row remedy talks about queue bootstrap broadly. A reader chasing this specific code may not immediately see that the fix is a Policy update to add the pool, not a bootstrap/deployment action. - Fix missing work-queue diagnostic guidance #71665 (comment)
  3. Review (.github/aw/debug-playbook.md:233): For work_queue_pool_not_installed, the pool is missing from an existing installed Policy, and bootstrap/deployment will not add it. Keep bootstrap guidance for missing queues or policies, but direct missing-pool recovery to an authorized administrator Policy update after the queue is quiescent. - Fix missing work-queue diagnostic guidance #71665 (comment)
  4. Review (.github/aw/debug-playbook.md:237): This row still includes work_queue_profile_not_approved, which needs an installed-profile check, while the new work_queue_worker_not_compiler_approved requires checking the caller's compiled dispatch allowlist. Name both checks and distinguish Policy updates from allowlist or credential fixes rather than directing both failures to deployment. - Fix missing work-queue diagnostic guidance #71665 (comment)

Push the necessary fixes, reply to each listed review thread and resolve it when addressed. Ignore feedback already answered or resolved. Use the pr-finisher skill and stop when only human review or CI remains; do not trigger CI.

Sous-chef head: 5df132d
Sous-chef work: 0238452562e6c5a8e605d03891582974aa913f86d8e485a7658064a1c4ddc4ab cc6f66cd74bff93d11b3a9448e2e10fccf9a045e7dff01ad12ad37d2d4aa5086 ef3629ae7934ee461c69a01e344f35657b3acbc673ed4d27304d6ef84ffd4a8b
Sous-chef state: 28a7398ba3b49231e9c1f7c05e668fdd9f2c2b599d1818fd9e6476069ee6598a

Generated by 👨‍🍳 PR Sous Chef · pi · haiku45 · ~7 AIC · ⌖ ~7 AIC · ⊞ 1.1K · ◷
Comment /souschef to run again

Copilot AI and others added 2 commits October 24, 2026 16:43
…rk-queue-diagnostic-guidance

Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>
Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com>

Copilot AI commented Oct 24, 2026

Copy link
Copy Markdown
Contributor Author

@copilot run pr-finisher skill

Completed the finisher pass: merged the latest main, clarified and validated the guidance, and replied to the three review comments. CI was not triggered. The review threads remain unresolved because the available GitHub tools expose replies but no thread-resolution action.

Copilot AI requested a review from gh-aw-bot October 24, 2026 16:55
@pelikhan
pelikhan merged commit 7e8da8d into main Oct 24, 2026
3 checks passed
@pelikhan
pelikhan deleted the copilot/avengerfix-work-queue-diagnostic-guidance branch October 24, 2026 18:02
@github-actions

Copy link
Copy Markdown
Contributor

🎉 This pull request is included in a new release.

Release: v0.93.4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[avenger] Fix missing work-queue diagnostic guidance

4 participants