fix(core): Generate title once there's enough user context#28721
Conversation
There was a problem hiding this comment.
No issues found across 3 files
Architecture diagram
sequenceDiagram
participant Service as InstanceAiService
participant Memory as Conversation Memory
participant TitleGen as Title Generation Logic
participant LLM as LLM Provider
participant DB as Thread Metadata
Note over Service,DB: Title Generation Flow (Post-Message)
Service->>DB: Check if titleRefined is true
opt Title not yet refined
Service->>Memory: recall(threadId, last 5 messages)
Memory-->>Service: Message list
Service->>Service: CHANGED: Concat all user messages into single string
alt No user messages found
Service-->>Service: Abort
else User text exists
Service->>TitleGen: generateTitleFromMessage(combinedText)
TitleGen->>TitleGen: isTrivialMessage(text)
alt NEW: Message is trivial (e.g. "hey", "hi there")
TitleGen-->>Service: Return null
Note right of TitleGen: Defer generation until more context
else Message has substance
TitleGen->>LLM: generateText()
LLM-->>TitleGen: Refined Title
TitleGen-->>Service: Return Title
Service->>DB: Update title and set titleRefined: true
end
end
end
Codecov Report❌ Patch coverage is
📢 Thoughts on this report? Let us know! |
Instance AI Workflow Eval Results8/8 built | 11/27 passed (40%)
Failure detailspartial-action-failure [builder_issue]
happy-path [builder_issue]
multi-team-creator [builder_issue]
unknown-creator [builder_issue]
api-error [builder_issue]
channel-not-found [builder_issue]
insufficient-permissions [builder_issue]
happy-path [builder_issue]
no-bugs [builder_issue]
high-priority [builder_issue]
medium-priority [builder_issue]
low-priority [builder_issue]
happy-path []
all-filtered [builder_issue]
happy-path [builder_issue]
no-alerts [builder_issue]
|
Performance ComparisonComparing current → latest master → 14-day baseline Idle baseline with Instance AI module loaded
Memory consumption baseline with starter plan resources
docker-stats
How to read this table
|
|
Successfully created backport PR for |
|
Got released with |
Summary
Makes us generate the title only after we have a bit of context - so if user sends message "hey", the title isn't immediately generated, but then on the second message once a bit of user context exists the title generation happens.
This should make the titles a bit more accurate, and we can later tune what is considered a trivial message.
Related Linear tickets, Github issues, and Community forum posts
Review / Merge checklist
Backport to Beta,Backport to Stable, orBackport to v1(if the PR is an urgent fix that needs to be backported)