Skip to content

ci: check out test sources at the commit the wheels were built from - #2974

Merged
mdboom merged 1 commit into
NVIDIA:mainfrom
mdboom:segfauly
Sep 30, 2026
Merged

mdboom merged 1 commit into
NVIDIA:mainfrom
mdboom:segfauly

Conversation

@mdboom

@mdboom mdboom commented Sep 30, 2026

Copy link
Copy Markdown
Contributor

Problem

The nightly "standard (linux-aarch64)" cuda.bindings jobs crashed with exit code 139 (run 36513361710). The log shows:

Push runs build wheels from the same commit as the tests, which is why they pass. Only nightlies reuse wheels from an older commit.

Changes

  • test-wheel-linux.yml / test-wheel-windows.yml: the test-job checkout now uses ref: ${{ inputs.sha || github.sha }}, so test sources match the wheels under test. With no sha input (PR/push) behavior is unchanged.
  • test_cuda.py: assert helper.cptr != 0 before the ctypes write, so a regression fails instead of crashing the interpreter.

Verification

Not run. The next nightly should show the aarch64 cuda.bindings jobs passing, or at least not crashing. Main CI run 36680216954 (8845a79, today) means the next nightly will also pick up fresher wheels.

🤖 Generated with Claude Code

Nightly runs reuse wheels from the latest successful CI run on main, but
the test job checked out the workflow's own commit.  When main moved on
after that run, new tests ran against old wheels: the aarch64
cuda.bindings job saw a cascade of failures and then a segfault in
test_ffi_coverage_jit_wall_time_pointer_is_valid, where the old wheel
returns a NULL cptr that the test dereferences through ctypes.

Check out `inputs.sha || github.sha` in the Linux and Windows test
workflows so sources match the wheels under test, and assert cptr is
non-NULL in that test so a regression fails instead of crashing.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@github-actions github-actions Bot added CI/CD CI/CD infrastructure cuda.bindings Everything related to the cuda.bindings module labels Sep 30, 2026
@mdboom mdboom self-assigned this Sep 30, 2026
@mdboom mdboom added this to the cuda.bindings next milestone Sep 30, 2026
@github-actions

github-actions Bot commented Sep 30, 2026 •

Copy link
Copy Markdown
Contributor
Doc Preview CI
Preview removed because the pull request was closed or merged.

@mdboom
mdboom merged commit e95a7ed into NVIDIA:main Sep 30, 2026
116 of 117 checks passed
github-actions Bot pushed a commit that referenced this pull request Oct 1, 2026
Removed preview folders for the following PRs:
- PR #2939
- PR #2953
- PR #2962
- PR #2966
- PR #2968
- PR #2969
- PR #2972
- PR #2974
- PR #2976
- PR #2977
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI/CD CI/CD infrastructure cuda.bindings Everything related to the cuda.bindings module

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants