feat: add sference batch inference provider#68
Conversation
|
hi @vienneraphael. I was playing around with batchling (love it) and validated it against sference (I'm a cofounder).
|
Hi @apejcic, thanks for your PR I really appreciate you contributing to batchling through implementing sference! PR looks good to me, can you just make sure to run the |
|
CI fix was just merged on my end, I'll let you rebase and run |
- Updated navigation and documentation to include the Sference provider. - Implemented Sference provider functionality, including inline batch submission and result handling. - Added tests for Sference provider's batch payload and response handling. Co-authored-by: Cursor <cursoragent@cursor.com>
53f1c64 to
c5182f6
Compare
|
Thanks for fixing CI. Fixed formatting with ruff-check. Waiting for CI workflow approval. |
Match prek ruff-format hook settings so CI passes. Co-authored-by: Cursor <cursoragent@cursor.com>
|
Fixed line width format cf17bd27cca2b7c81127bd40b711a2cf0b7ff1a5 |
|
Awesome thank you, merging the PR right now! |
Summary
POST /v1/batches).OpenAIProviderwith sference-specific inline submission, polling, and result decoding (result_json/error_jsonrows)./v1/chat/completions— sference's batch executor rejects Responses-shaped bodies at execution time.Test plan
pytest tests/test_provider_registry.py tests/test_provider_contracts.pyhttps://api.sference.comwithmoonshotai/Kimi-K2.6(chat completions path)Made with Cursor