Skip to content

feat(changelog): Ground AI summaries in PR descriptions - #918

Merged
MathurAditya724 merged 3 commits into
masterfrom
feat/ai-summary-concrete-context
Oct 22, 2026
Merged

MathurAditya724 merged 3 commits into
masterfrom
feat/ai-summary-concrete-context

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Oct 21, 2026

Copy link
Copy Markdown
Contributor

Category summaries in the 3.0.0 release preview were vague ("Release communication…", "Internal maintenance…"), and the breaking-change summary didn't say why the change was breaking. The model only had PR titles to work with, and the prompt pushed category summaries toward abstract themes.

  • Each changelog entry now goes to the model with a condensed copy of its PR description: HTML comments and code blocks are removed, whitespace is collapsed, and it's capped at 600 characters. The description is context only and never shows up in the rendered changelog. Entries that come from a Changelog Entry section or #body-in-changelog don't get one, since their curated text is already the entry.
  • The prompt now asks scope and category summaries to name the specific features, targets and options that changed, bans vague umbrella phrases, and asks breaking-change summaries to say what users must change when the data says so. It also tells the model not to guess when the data doesn't say. The top-level release overview instructions are unchanged because that output was already good.
  • serializeChangelog now passes each group's source PRs alongside its rendered items. The important-title and description lookups both come from that one list, so there's no more index-offset merging.

I left reasoning level / model settings alone. Whether those need tuning is easier to judge once a real release has run with the richer input.

Closes #917

via adm.

--

View Junior Session [Sentry]

Co-Authored-By: Aditya Mathur <aditya.mathur@sentry.io>
@github-actions

github-actions Bot commented Oct 21, 2026 •

Copy link
Copy Markdown
Contributor
PR Preview Action v1.8.1
Preview removed because the pull request was closed.
2026-10-22 10:22 UTC

Comment thread src/utils/ai-summary.ts Outdated

@MathurAditya724 MathurAditya724 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed all five changed files and the surrounding generation, hierarchy, provider and rendering paths at fc2585d. The Markdown-parser update fixes the fence/comment cases from the earlier revision. The 150 affected tests, TypeScript check and focused ESLint check pass locally; current CI, including live summarizer replay and five-platform artifact verification, also passes. One actionable issue remains in shortcode normalization, noted inline.

Comment thread src/utils/ai-summary.ts

@MathurAditya724 MathurAditya724 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the final head and verified the fix for the reported shortcode issue: inline-code configuration values are retained, with regression coverage. No remaining blocking findings. All 28 applicable CI checks pass, including live summarizer replay and five-platform artifact verification; the 150 focused tests, typecheck, lint and build also pass locally.

@MathurAditya724
MathurAditya724 merged commit 2fd2b1a into master Oct 22, 2026
30 checks passed
@MathurAditya724
MathurAditya724 deleted the feat/ai-summary-concrete-context branch October 22, 2026 10:21

This branch was successfully deployed

1 active deployment
false — f6bf3098 Deployed Oct 22, 2026 by sentry-junior[bot] via Build #3152
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve AI-generated changelog category summaries

2 participants