Skip to content

feat(xtask): auto-generate the edition registry docs from the Rust declarations - #8878

Closed
joseph-isaacs wants to merge 1 commit into
developfrom
claude/auto-gen-editions-docs-r9otqn
Closed

joseph-isaacs wants to merge 1 commit into
developfrom
claude/auto-gen-editions-docs-r9otqn

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

Include editions in the vortex docs/

Follows #8871 (now merged), which introduced the edition declarations this generator reads.

What changes are included in this PR?

Add a manifest generator from rust (toml).

Uses the manifest to generate static docs.

@joseph-isaacs joseph-isaacs added the changelog/docs A docs change label Jul 21, 2026
@joseph-isaacs
joseph-isaacs force-pushed the claude/auto-gen-editions-docs-r9otqn branch from 286037c to b9741e0 Compare July 21, 2026 13:20
Base automatically changed from claude/editions-impl-fiicrg to develop July 21, 2026 13:47
@joseph-isaacs
joseph-isaacs force-pushed the claude/auto-gen-editions-docs-r9otqn branch from b9741e0 to ef8bb5f Compare July 21, 2026 13:51
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done c4cbb90 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done ef8bb5f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: Likely regression (medium confidence)
Attributed Vortex impact: +11.2%
Engines: DataFusion No clear signal (+8.3%, medium confidence) · DuckDB Likely regression (+14.2%, high confidence)
Vortex (geomean): 1.167x ❌
Parquet (geomean): 1.106x ❌
Shifts: Parquet (control) +10.6% · Median polish +18.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.240x ❌, 0↑ 2↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 🚨 11348549 9541200 1.19
vortex_q01/datafusion:vortex-file-compressed 🚨 7719139 5974462 1.29
datafusion / parquet (1.144x ❌, 0↑ 2↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 🚨 23935118 21214230 1.13
vortex_q01/datafusion:parquet 🚨 5498090 4736768 1.16
duckdb / vortex-file-compressed (1.222x ❌, 0↑ 2↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 🚨 11857870 9885437 1.20
vortex_q01/duckdb:vortex-file-compressed 🚨 7499585 6028973 1.24
duckdb / parquet (1.070x ➖, 0↑ 0↓)
name PR c4cbb90 (ns) base 94e593e (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 24996672 23250798 1.08
vortex_q01/duckdb:parquet 9978243 9373387 1.06

No file size changes detected.

…clarations

Generate the edition registry pages from the edition declarations in
`vortex/src/editions/`, in two stages:

1. A new `editions_manifest` example in the `vortex` crate validates the
   declarations and dumps them (with each edition's computed full encoding
   set) as a TOML manifest under `target/` — a build artifact, never
   committed.
2. A new `cargo xtask generate-editions-docs` subcommand runs the example,
   parses the manifest, and rewrites `docs/specs/editions/` wholesale:
   `index.md` with an editions table and a per-encoding index, plus one
   page per edition with its status, minimum Vortex reader, the encodings
   it adds, and its full encoding set.

The static pages link into the registry: `docs/specs/editions.md` from its
"Edition registry" section (previously a "Coming soon.." placeholder) and
the unknown-encoding troubleshooting flow, and the docs landing page from
a short static "Editions" section.

The generated-files CI job now also runs `generate-editions-docs` before
its "no files changed after regenerating" check, so a declaration change
without a regen fails CI, including added or removed registry pages.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XKRaAHmFNvb7JoKTJVW8Pw
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs
joseph-isaacs force-pushed the claude/auto-gen-editions-docs-r9otqn branch from ef8bb5f to c4cbb90 Compare July 21, 2026 14:00
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Aug 5, 2026
@github-actions

Copy link
Copy Markdown
Contributor

This PR was closed because it has been inactive for 7 days since being marked as stale.

@github-actions github-actions Bot closed this Aug 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/docs A docs change stale This PR is stale and will be auto-closed soon

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants