Skip to content

[M.E.AI.Evaluation.Reporting] Fix context and metric interpretation visualization - #7738

Merged
peterwald merged 10 commits into
dotnet:mainfrom
grafanaKibana:ai-eval-report-bugfix
Sep 9, 2026
Merged

[M.E.AI.Evaluation.Reporting] Fix context and metric interpretation visualization#7738
peterwald merged 10 commits into
dotnet:mainfrom
grafanaKibana:ai-eval-report-bugfix

Conversation

@grafanaKibana

@grafanaKibana grafanaKibana commented Sep 4, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Closes #7736

Summary

Fixes the findings from the linked issue:

  • StringMetrics are no longer rendered, they appear as "?".
  • Ground Truth is no longer visible.

What changed

Description Image
Metrics that don't have interpretation now show a grey pill with a value, instead of a grey pill with a question mark. Metrics with no interpretation AND no value continued to show question mark. image
Metrics that have provided context now show it, previously was missed. image
Moved scope selection to the side drawer for the mobile and small tables image
  • Additional style improvements:
    • In expanded state value is shown aligned to right, previously was right after interpretation
    • Width of the interpretation pills was increased in 1.5x times, to add more space for the values without interpretation
    • Removed hover and click effects from the non-clickable tables
    • Added the missing dark-theme warning token
    • Aligning "Current" identity dots in the comparison and history tabs
    • Made History summaries 2×2 on mobile
    • Compact Comparison summaries on mobile
    • Dark surface depth tokens adjustment
    • Various CSS tokens refactoring and consolidations

Verification

  • npm test -- --no-file-parallelism — passed.
  • Forced TypeScript build — passed.
  • ESLint — 0 errors; one Fast Refresh warning in the Azure DevOps entry point.
  • Standalone report build — passed.
Microsoft Reviewers: Open in CodeFlow

@grafanaKibana
AI Evaluation report fixes and improvements.
e6be3e4 
- Fixed mising context visualisation.
- Improved the visualisation of the metrics without interpretation.
- Sligtly adjusted styles to fit the value when interpretation not present
- Added more test data to cover fixed cases

Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Removed hover/click effect from unclickable table rows. Added more deâ€Ķ
8cc3a1e 
â€Ķv data

Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Added scope drawer for mobile/tablet
bbb6259 
Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Added Compact Comparison summaries on mobile
45ee203 
Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Polish the report with responsive navigation, consistent comparison mâ€Ķ
42f003e 
â€Ķarkers, semantic rating and trend styling.

Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Consolidate theme tokens and shared styles, normalize token names
cd479cd 
Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Fixed Overview hero responsiveness
0884fdf 
Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
grafanaKibana marked this pull request as ready for review September 6, 2026 16:27
@grafanaKibana
grafanaKibana requested a review from a team as a code owner September 6, 2026 16:27
@grafanaKibana grafanaKibana changed the title [M.E.AI.Evaluation.Reporting] Fix context and non-interpretable value visualization [M.E.AI.Evaluation.Reporting] Fix context and metric interpretation visualization Sep 7, 2026
peterwald
peterwald reviewed Sep 8, 2026
View reviewed changes
Comment thread ...Libraries/Microsoft.Extensions.AI.Evaluation.Reporting/TypeScript/components/shell/theme.css
Comment thread ...raries/Microsoft.Extensions.AI.Evaluation.Reporting/TypeScript/components/shell/AppShell.tsx Outdated
peterwald
peterwald requested changes Sep 8, 2026
View reviewed changes

@peterwald peterwald left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly LGTM, with a few minor suggested changes.

@dotnet-policy-service dotnet-policy-service Bot added waiting-author-feedback 📭 The author of this issue needs to respond in order for us to continue investigating this issue. and removed waiting-author-feedback 📭 The author of this issue needs to respond in order for us to continue investigating this issue. labels Sep 8, 2026
@grafanaKibana
Made history stats wrap on long values + a bit of responsivness of spâ€Ķ
aaedfd3 
â€Ķacings

Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
@grafanaKibana
Fixed sidebar state was dropped after closing it on the mobile.
aea749e 
Signed-off-by: nikitareshetnik <reshetnik.nikita@gmail.com>
peterwald
peterwald approved these changes Sep 9, 2026
View reviewed changes

@peterwald peterwald left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @grafanaKibana !

@peterwald
peterwald merged commit c74cd51 into dotnet:main Sep 9, 2026
5 checks passed
@jamiewest jamiewest mentioned this pull request Sep 21, 2026
Closed
@github-actions github-actions Bot locked and limited conversation to collaborators Oct 10, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@peterwald peterwald peterwald approved these changes

Assignees

@grafanaKibana grafanaKibana

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

#7609 AI Evaluation Redesign bugs

2 participants

@grafanaKibana @peterwald