Skip to content
This repository was archived by the owner on Nov 8, 2026. It is now read-only.

Commit db945be

Browse files
committed
Track M4 speech and Neural Engine qualification
1 parent 7bf0e6b commit db945be

2 files changed

Lines changed: 14 additions & 0 deletions

File tree

‎mseries/ROADMAP.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,9 @@ Track Gravity, Omarchy and native macOS on matched workloads in the
44
[M4 performance tracker](local-ai/M4-PERFORMANCE.md). Record exact model and
55
artifact hashes, correctness and per-run metrics; exceeding native is a goal,
66
not a measured result. No M4 model-speed baseline has been established yet.
7+
The tracker now includes matched Parakeet speech CPU/GPU/ANE and macOS
8+
comparisons. M4 ANE remains unqualified; existing M1 results are not M4
9+
baselines, and speech accuracy, latency and energy need their own receipts.
710

811
## WD22TB4 and wip4 candidate status — 2026-10-28
912

‎mseries/local-ai/M4-PERFORMANCE.md‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,17 @@ the target set, not a claim that a run completed.
3232
| Language and code | Qwen3.5 2B, MLX 4-bit | Pending | Pending | Pending |
3333
| Larger language model | Qwen3.5 4B, MLX 4-bit | Pending | Pending | Pending |
3434
| Native Vulkan engine comparison | TensorFold, Qwen3.5 2B | Pending | Pending | Pending |
35+
| Speech-to-text | Parakeet TDT 0.6B v3, fixed audio; CPU, GPU and ANE where supported | Pending | Pending | Pending |
36+
37+
## Speech and Neural Engine
38+
39+
The requested [speech-encoding article](https://joshuawarren.com/blog/speech-encoding-31-percent-faster-m1-max-neural-engine/) is a lead for optimizing the encoder. Its text was inaccessible during this review, so its title's percentage and exact method are unverified here and are not M4 measurements. The author's [omarchy-mlx](https://github.com/joshuaswarren/omarchy-mlx) supplies a Parakeet path, while [omarchy-ane](https://github.com/joshuaswarren/omarchy-ane) describes an experimental, manually opted-in M4 H16 bring-up module: its README reports no packaged M4 driver or real inference. Do not treat the M1 Max result as M4 support.
40+
41+
On this M4 mini, the running Gravity system has no `/dev/accel` node; the unbooted Aurora candidate enables the ANE driver as a module but its current match tables have no T8132 entry. Neither observation proves ANE inference works. Separately, our M1 Pro ran a 20-call bit-exact ANE smoke and a Parakeet fixture after a private Mesa correction; those are M1 results, not M4 performance. See [M1 speech research](../dictation/STT-RESEARCH.md).
42+
43+
For an M4 comparison, use a pinned Parakeet model and public fixed WAV clips with known reference transcripts. Record both SHA-1 and SHA-256 for every model file, clip, transcript and result, plus model revision, preprocessing and exact commands. Compare the same clips and model across Gravity and Omarchy CPU, GPU and ANE when each backend is qualified, and macOS on the same mini; document model conversion, precision and runtime differences. Record word-error rate, encoder-only time and end-to-end transcription latency separately, cold-start and individual warm runs, audio duration and real-time factor, peak memory, CPU load, power and thermals when available. Measure at least 10 warm runs after an explicitly recorded warmup, keep failures, and separate standalone runs from GPU/ANE contention. Do not claim a speedup where correctness or workload equivalence has not been established.
44+
45+
ANE work is a later qualification track: first establish a safe M4 device/firmware and recovery path and driver binding, then follow the backend's read-only checks and qualified smoke/fixture instructions before running speech inference. Do not load experimental modules, reboot, or run a hardware workload as part of merely adding this plan.
3546

3647
Track CPU, GPU, memory bandwidth, storage, graphics responsiveness, sustained
3748
power and thermals alongside AI. Add other workloads when a reproducible

0 commit comments

Comments
 (0)