Skip to content
This repository was archived by the owner on Nov 8, 2026. It is now read-only.

F5 dictation and Smart Reply on the shared LFM3-Audio assistant (#649) - #654

Merged
techmore merged 1 commit into
devfrom
claude/f5-lfm3-engine
Oct 28, 2026
Merged

techmore merged 1 commit into
devfrom
claude/f5-lfm3-engine

Conversation

@techmore

Copy link
Copy Markdown
Owner

Part of #649.

What changes

  • F5 on LFM3: new lfm3 engine for stream-dictate.py (dictation_lfm.py). It cuts the mic stream into phrases at pauses, sends each to mseries-assistd /v1/audio/transcriptions, and types each phrase as it returns. F5, F6 and Smart Reply share one resident model.
  • Memory reserve: MSERIES_ASSIST_RESERVE_GIB makes assistd's fixed 6 GiB desktop reserve configurable (default unchanged). The lfm3 F5 engine uses the same value.
  • Smart Reply: drafts fall back to the assistant (LFM3) when the default Qwen endpoint (8766) has no model. Before this, Ctrl+Alt+R failed whenever the Qwen profile wasn't loaded.

Checked on the M1 Pro

  • LFM3 transcribed a 10 s speech sample correctly: 4.3 s model load, then 2.1 s warm.
  • Full F5 pipeline in file test mode: correct text about 1 s after the speech ended.
  • F6 /v1/complete: sensible continuation in 1.6 s.
  • mseries-reply draft fixtures/lunch.json: a draft in 3.3 s via the fallback.
  • cargo test: mseries-ai 24 passed, mseries-reply 78 passed.

Not checked: a live F5 press with a real voice.

🤖 Generated with Claude Code

- stream-dictate: new `lfm3` engine (dictation_lfm.py) that sends pause-cut phrases to
  mseries-assistd /v1/audio/transcriptions and types each as it returns.
- assistd: MSERIES_ASSIST_RESERVE_GIB makes the 6 GiB desktop reserve configurable;
  the lfm3 F5 engine uses the same reserve.
- mseries-ai: Smart Reply drafts fall back to the assistant (LFM3) when the default
  Qwen endpoint has no model, so Ctrl+Alt+R works without the Qwen profile loaded.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@techmore
techmore enabled auto-merge (squash) October 28, 2026 03:23
@techmore
techmore merged commit efa8f70 into dev Oct 28, 2026
21 of 22 checks passed
@techmore
techmore deleted the claude/f5-lfm3-engine branch October 28, 2026 16:41
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant