Repository navigation

Android chat: faster follow-ups and complete answers in conversations - #72

Open

bgrana75 wants to merge 19 commits into

rferrari:mainfrom

bgrana75:perf/android-chat-conversations

Open

Android chat: faster follow-ups and complete answers in conversations#72
bgrana75 wants to merge 19 commits into
rferrari:mainfrom
bgrana75:perf/android-chat-conversations

Commits on Oct 5, 2026
- fix(chat): one send per tap while a background task stops
  
  bgrana75
  and
  claude
  committed
  bcd0542
- perf(chat): keep conversation history within a token budget
  
  bgrana75
  and
  claude
  committed
  674e918
- fix(engine): make the answer-prefix warm-up actually prefill
  
  bgrana75
  and
  claude
  committed
  91fa0ee
- feat(chat): search follow-up questions with the previous question
  
  bgrana75
  and
  claude
  committed
  7c95c80
- docs: the test phone is a Pixel 6a
  
  bgrana75
  and
  claude
  committed
  30d645f
- feat(chat): give the model an answer length this phone can write in time
  
  bgrana75
  and
  claude
  committed
  4b362bd
- feat(chat): size the answer to the phone's current speed
  
  bgrana75
  and
  claude
  committed
  c62071a
- fix(chat): keep the question being sent out of its own history
  
  bgrana75
  and
  claude
  committed
  a0245c0
- perf(engine): keep the KV cache at 8 bits
  
  bgrana75
  and
  claude
  committed
  ff0e229
- perf(engine): repack weights only when the phone has room for them
  
  bgrana75
  and
  claude
  committed
  ec3bee3
- feat(chat): size the answer from this prompt, after retrieval
  
  bgrana75
  and
  claude
  committed
  429917b
- docs(evidence): Android chat before/after on a Pixel 6a
  
  bgrana75
  and
  claude
  committed
  41e80ab
Commits on Oct 6, 2026
- perf(engine): skip repacking only when the model file doesn't fit
  
  bgrana75
  and
  claude
  committed
  568ad1c
- perf(engine): 8-bit KV cache only for models that stream from storage
  
  bgrana75
  and
  claude
  committed
  4622454
- docs(evidence): final runs with the narrowed repack rule and 16-bit KV when repacked
  
  bgrana75
  and
  claude
  committed
  74eb9f2
- fix(chat): size the answer with the speed of the model the router picked
  
  bgrana75
  and
  claude
  committed
  3078fab
- docs(evidence): driver usage, output names and file handles
  
  bgrana75
  and
  claude
  committed
  9670543
- fix(chat): size the answer to the generate step's token cap
  
  bgrana75
  and
  claude
  committed
  6008179
Commits on Oct 10, 2026
- fix(chat): existential 'there' and a first-word name in the follow-up rule
  bgrana75
  committed
  5015aa0

Commits

Commits on Oct 5, 2026

Commits on Oct 6, 2026

Commits on Oct 10, 2026