feat: add community assessment tooling and workflow proposal - #4489
feat: add community assessment tooling and workflow proposal#4489dajiaohuang wants to merge 6 commits into
Conversation
Assisted-by: OpenAI Codex (model: GPT-6, autonomous)
|
Thanks for the substantial effort here — this is a thoughtful implementation, and the care around the |
|
Posted on behalf of @dajiaohuang by OpenAI Codex (model: GPT-5, autonomous). Review-round update for The branch remains intentionally unchanged while #4410's assessment schema, label vocabulary, and pilot mechanics are settled and the requested dedicated security review is completed. No hosted checks are currently reported, and this update makes no pilot-deployment or maintainer-approval claim. |
|
Thanks @dajiaohuang — disclosure noted, and freezing the branch while we settle #4410 is exactly the right call. The gating item is on my side: #4410 is still in clarification, so the assessment schema and the pilot decision need to land there before this gets a full review. I'll drive that on the issue; no further changes needed here in the meantime. Appreciate the care on the |
Description
Adds the assessment extension and retrospective baseline tooling for #4410, with the GitHub Agentic Workflow retained as an inactive proposal. No assessment or label-cleanup automation is activated by this PR: the generated lockfile and the proposed
pull_request_targetcleanup workflow are absent. Running the fork-PR pilot still requires maintainers to approve a trusted execution and publication context consistent with the issue'spull_requestboundary.The extension captures the assessed PR head, gathers policy/scope/validation/disclosure evidence without executing PR content, and writes a SHA-qualified local assessment. The proposed publisher checks freshness before every mutation and leaves newer revisions' outcome labels untouched. Its behavior is covered with mocked GitHub API tests; this is not evidence of a deployed pilot.
The baseline collector records a deterministic, stratified 100-PR sample with cutoff-bounded review/check evidence. Maintainer triage time and clarification rounds remain unknown. The review stage remains gated on the eight-week/50-PR assessment pilot criteria in #4410.
Testing
.venv/Scripts/python -m pytest tests/test_community_assess_baseline.py tests/contract/test_wheel_core_pack_scripts.py tests/test_github_workflows.py tests/extensions/test_community_assess_extension.py -q: 20 passed, 3 skipped.node --test tests/community_assess_publish.test.mjs: 6 passed, including a delayed old publisher preserving a newer head's labels.WinError 1314); this is not an all-green suite.git diff --checkpassed. No current hosted CI result or maintainer acceptance is claimed.AI Disclosure
OpenAI Codex agents authored and reviewed the implementation, tests, workflow proposal, and audit artifacts, and executed the validation above. AI assistance included code generation and PR description drafting. No human-review or pilot-success claim is made.