Skip to content

feat(litellm): add local-qwen-3.6-hass model route and update request_timeout to 600s#377

Merged
sheepdestroyer merged 1 commit into
masterfrom
feature/add-qwen-hass-model-route
Jul 24, 2026
Merged

feat(litellm): add local-qwen-3.6-hass model route and update request_timeout to 600s#377
sheepdestroyer merged 1 commit into
masterfrom
feature/add-qwen-hass-model-route

Conversation

@sheepdestroyer

@sheepdestroyer sheepdestroyer commented Jul 24, 2026

Copy link
Copy Markdown
Owner

Adds local-qwen-3.6-hass model route with enable_thinking: false and increases request_timeout to 600s for local-qwen-3.6 with preserve_thinking: true.

Summary by Sourcery

Add new local-qwen model variants and configure audio transcription/speech aliases in LiteLLM, including longer timeouts for qwen models.

New Features:

  • Introduce local-qwen-3.6-hass model route with thinking disabled.
  • Expose whisper-1, gpt-4o-mini-transcribe, gpt-4o-mini-tts, and tts-1 as audio transcription and speech compatibility aliases.
  • Add whisper-1, gpt-4o-mini-tts, and tts-1 to the list of allowed models.

Enhancements:

  • Increase request_timeout for local-qwen-3.6 to 600 seconds and enable thinking preservation via chat template settings.

@sourcery-ai

sourcery-ai Bot commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Reviewer's Guide

Adds audio STT/TTS compatibility aliases, updates the local-qwen-3.6 route to preserve thinking with a longer timeout, and introduces a new local-qwen-3.6-hass route with thinking disabled, wiring these models into the allowed models list.

File-Level Changes

Change Details Files
Update local-qwen-3.6 configuration to preserve thinking and allow longer-running requests.
  • Attach extra_body.chat_template_kwargs.preserve_thinking=true to local-qwen-3.6 litellm_params.
  • Increase request_timeout for local-qwen-3.6 from 120s to 600s to accommodate longer inference.
  • Keep existing api_base, api_key, and model mapping for local-qwen-3.6 unchanged.
litellm/config.yaml
Introduce a local-qwen-3.6-hass route with thinking disabled but sharing the same backend.
  • Add a new model_list entry mapping model_name local-qwen-3.6-hass to backend model openai/local-qwen-3.6-hass.
  • Set extra_body.chat_template_kwargs.enable_thinking=false for the hass variant.
  • Configure request_timeout=600s to match the long-running behavior of local-qwen-3.6.
litellm/config.yaml
Add audio STT/TTS compatibility aliases and expose them as allowed models.
  • Include whisper-1, gpt-4o-mini-tts, and tts-1 in litellm_settings.allowed_model_groups so they can be requested.
  • Define whisper-1 and gpt-4o-mini-transcribe as audio_transcription aliases pointing to local openai/whisper-1 at 127.0.0.1:8084 with a 60s timeout.
  • Define gpt-4o-mini-tts and tts-1 as audio_speech aliases pointing to openrouter/openai/tts-1 with a 60s timeout and mark them public.
litellm/config.yaml

Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

@coderabbitai

coderabbitai Bot commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

@sheepdestroyer, you've reached your PR review limit, so we couldn't start this review.

Next review available in: 12 minutes

Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available.
You're only billed for reviews past your plan's rate limits ($0.25/file).

How can I continue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews.

How do review limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please refer docs for additional details.

Review details
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: fb62eb67-a78f-4d38-a711-b00037b477f4

📥 Commits

Reviewing files that changed from the base of the PR and between ff5b840 and 1215757.

📒 Files selected for processing (1)
  • litellm/config.yaml
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feature/add-qwen-hass-model-route

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@sourcery-ai sourcery-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey - I've left some high level feedback:

  • You define the gpt-4o-mini-transcribe alias in model_list but don’t add it to litellm_settings.allowed_model_group, which may prevent it from being usable like the other audio aliases.
  • For the new TTS aliases pointing to openrouter/openai/tts-1, consider explicitly configuring api_base/api_key here if they differ from global defaults to avoid environment-dependent behavior.
Prompt for AI Agents
Please address the comments from this code review:

## Overall Comments
- You define the `gpt-4o-mini-transcribe` alias in `model_list` but don’t add it to `litellm_settings.allowed_model_group`, which may prevent it from being usable like the other audio aliases.
- For the new TTS aliases pointing to `openrouter/openai/tts-1`, consider explicitly configuring `api_base`/`api_key` here if they differ from global defaults to avoid environment-dependent behavior.

Sourcery is free for open source - if you like our reviews please consider sharing them ✨
Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.

@sheepdestroyer
sheepdestroyer force-pushed the feature/add-qwen-hass-model-route branch from aaae557 to 1215757 Compare July 24, 2026 20:12

@sheepdestroyer sheepdestroyer left a comment

Copy link
Copy Markdown
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Global Review — #377

  • Scope: litellm/config.yaml (Qwen Home Assistant route configuration)
  • Files & Sections Analyzed: model_list (added local-qwen-3.6-hass route with enable_thinking: false and 600s timeout; updated local-qwen-3.6 with preserve_thinking: true and 600s timeout).
  • Rebase & Compatibility: Rebased onto master containing PR #375 and PR #376. 100% clean integration.
  • Test Verification: 363 passed, 0 failures.
  • Verdict: READY TO MERGE

@sheepdestroyer
sheepdestroyer merged commit dcdd018 into master Jul 24, 2026
8 checks passed
@sheepdestroyer
sheepdestroyer deleted the feature/add-qwen-hass-model-route branch July 24, 2026 20:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant