feat(litellm): add local-qwen-3.6-hass model route and update request_timeout to 600s#377
Conversation
Reviewer's GuideAdds audio STT/TTS compatibility aliases, updates the local-qwen-3.6 route to preserve thinking with a longer timeout, and introduces a new local-qwen-3.6-hass route with thinking disabled, wiring these models into the allowed models list. File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
|
Warning Review limit reached
Next review available in: 12 minutes Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available. How can I continue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews. How do review limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window. Please refer docs for additional details. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Caution The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased. |
There was a problem hiding this comment.
Hey - I've left some high level feedback:
- You define the
gpt-4o-mini-transcribealias inmodel_listbut don’t add it tolitellm_settings.allowed_model_group, which may prevent it from being usable like the other audio aliases. - For the new TTS aliases pointing to
openrouter/openai/tts-1, consider explicitly configuringapi_base/api_keyhere if they differ from global defaults to avoid environment-dependent behavior.
Prompt for AI Agents
Please address the comments from this code review:
## Overall Comments
- You define the `gpt-4o-mini-transcribe` alias in `model_list` but don’t add it to `litellm_settings.allowed_model_group`, which may prevent it from being usable like the other audio aliases.
- For the new TTS aliases pointing to `openrouter/openai/tts-1`, consider explicitly configuring `api_base`/`api_key` here if they differ from global defaults to avoid environment-dependent behavior.Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.
aaae557 to
1215757
Compare
sheepdestroyer
left a comment
There was a problem hiding this comment.
PR Global Review — #377
- Scope:
litellm/config.yaml(Qwen Home Assistant route configuration) - Files & Sections Analyzed:
model_list(addedlocal-qwen-3.6-hassroute withenable_thinking: falseand 600s timeout; updatedlocal-qwen-3.6withpreserve_thinking: trueand 600s timeout). - Rebase & Compatibility: Rebased onto master containing PR #375 and PR #376. 100% clean integration.
- Test Verification: 363 passed, 0 failures.
- Verdict: READY TO MERGE
Adds
local-qwen-3.6-hassmodel route withenable_thinking: falseand increasesrequest_timeoutto 600s forlocal-qwen-3.6withpreserve_thinking: true.Summary by Sourcery
Add new local-qwen model variants and configure audio transcription/speech aliases in LiteLLM, including longer timeouts for qwen models.
New Features:
Enhancements: