Skip to content

Add Hey Nativ wake-word dictation - #567

Merged
Blaizzy merged 9 commits into
mainfrom
pc/hey-nativ-wake-word
Sep 22, 2026
Merged

Blaizzy merged 9 commits into
mainfrom
pc/hey-nativ-wake-word

Conversation

@Blaizzy

@Blaizzy Blaizzy commented Sep 15, 2026 •

Copy link
Copy Markdown
Owner

Summary

Adds opt-in Hey Nativ dictation: say the wake phrase and continue speaking. Two seconds of silence or the shortcut finishes capture; the wake phrase is removed before insertion.

An adaptive energy gate activates the bundled HN-2 classifier on CPU/Neural Engine. The selected local speech model confirms candidates while audio continues buffering. Requires a running Nativ server and an installed speech model.

Validation

  • 40 focused tests passed, excluding the existing unrelated SystemMonitorIdentityTests.swift build issue.
  • Synthetic replay: 42/54 detected with both gates, no added misses; 4/4 ASR/capture checks passed.
  • Optimized Release build, signing, and launch succeeded. No benchmark scripts or audio fixtures in the PR.

Battery measurements

12 unplugged trials over 17.8 minutes on an M5 Max; built-in microphone for live trials, optimized native probes, ASR model kept loaded. App UI was excluded.

Condition Listener CPU, fixed → adaptive¹ Whole-Mac mean power, fixed → adaptive
Live microphone 5.56% → 6.23% 10.51 → 11.80 W
Identical noise replay, mic off 6.78% → 0.22% 10.51 → 10.12 W

¹ Percentage of one CPU core. Steady-noise classifier calls fell from approximately 50/sec to zero after warm-up. Battery charge displayed 100% → 99% across the mixed-condition session.

Power includes desktop activity; live audio varied between trials. Battery telemetry refreshed about once per minute, providing 2–4 fresh readings per condition.

Confirm HN-2 candidates through the selected speech-to-text pipeline while retaining contiguous microphone audio. Add bounded pre-roll, confirmation reuse, adaptive ambient-noise gating, model fixtures, and capture regression coverage.
@Blaizzy Blaizzy changed the title Add opt-in Hey Nativ wake-word dictation Add Core ML Hey Nativ wake-word dictation preview Sep 21, 2026
@Blaizzy Blaizzy changed the title Add Core ML Hey Nativ wake-word dictation preview Add Hey Nativ wake-word dictation Sep 21, 2026
@Blaizzy
Blaizzy marked this pull request as ready for review September 21, 2026 22:25
@Blaizzy
Blaizzy force-pushed the pc/hey-nativ-wake-word branch from 08c8813 to 437d0ea Compare September 21, 2026 22:37
@Blaizzy
Blaizzy requested a review from lucasnewman September 21, 2026 22:38
@Blaizzy
Blaizzy merged commit f36c6e7 into main Sep 22, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants