Skip to content

feat: automatic retry and failover for rate-limited LLM requests - #733

Closed
raheelshahzad wants to merge 2 commits into
katanemo:mainfrom
raheelshahzad:feat/retry-on-ratelimit
Closed

feat: automatic retry and failover for rate-limited LLM requests#733
raheelshahzad wants to merge 2 commits into
katanemo:mainfrom
raheelshahzad:feat/retry-on-ratelimit