Skip to content

FEAT: Add multimodal chat converter pipelines - #2699

Merged
Richard Lundeen (richlundeen) merged 5 commits into
microsoft:mainfrom
richlundeen:rlundeen2-chat-multimodal-registry
Sep 19, 2026
Merged

Richard Lundeen (richlundeen) merged 5 commits into
microsoft:mainfrom
richlundeen:rlundeen2-chat-multimodal-registry

Conversation

@richlundeen

@richlundeen Richard Lundeen (richlundeen) commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

Summary

  • use configured converter registry instances in chat pipelines
  • support ordered multimodal conversion with exact message-piece targeting
  • reuse the shared converter creation dialog and remove temporary class catalogs
  • add focused frontend, API, and Playwright coverage

Multi-Converter Pipelines

image

Multi-Modal also:

image

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 3d4f8cf3-df9c-4d65-bede-373fa3f5f59f
Keep converter state outside the panel, track each draft piece, and invalidate stale or failed conversions before applying or sending. Add focused unit and real-backend browser regression coverage.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 3d4f8cf3-df9c-4d65-bede-373fa3f5f59f

@romanlutz Roman Lutz (romanlutz) left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are GHCP comments. I'll do a manual review as well.

Comment thread frontend/src/components/Chat/ConverterPanel/ConverterPanel.tsx Outdated
Comment thread frontend/src/components/Chat/converterTypes.ts Outdated
@romanlutz

Copy link
Copy Markdown
Contributor

Can you share screenshots?

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 3d4f8cf3-df9c-4d65-bede-373fa3f5f59f
Give each pipeline occurrence a stable identity and share the request ID fallback with attachment and stage IDs. Add keyboard focus and non-secure-origin regression coverage.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 3d4f8cf3-df9c-4d65-bede-373fa3f5f59f
Select a registered converter instance and assert exact piece configurations across recovery. Delay the send-time attachment read instead of waiting for the removed background preview read.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 3d4f8cf3-df9c-4d65-bede-373fa3f5f59f
@richlundeen
Richard Lundeen (richlundeen) added this pull request to the merge queue Sep 19, 2026
Merged via the queue into microsoft:main with commit 4753ad4 Sep 19, 2026
49 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants