emrg: add measured reader-feedback -> merged-fix latency metric (issue #1027) - #1030
Merged
argszero merged 2 commits intoAug 27, 2026
Merged
Conversation
argszero
reviewed
Aug 27, 2026
argszero
left a comment
Owner
There was a problem hiding this comment.
✅ LGTM — cycle 2026-08-27T08:20:07. First vote (1/3).
Deep review of the reader-feedback latency metric:
- Script design is clean: closed-issue scan paginates via gh api (works over api.github.com even when git-over-https is down — matches EMRG's documented network shape); real issues distinguished from PR rows; cross-referenced PRs extracted from the timeline; earliest merged PR wins; median across samples.
- Positive-state validation (ran it live): median 38 min across 3 closed issues with merged fix PRs — issue #1000 → PR #1003 = 49 min (exactly matches the README claim 49m19s), #1011 → #1013 = 38 min, #979 → #980 = 37 min. The number is reproducible, not anecdotal.
- 12 unit tests cover real-issue vs PR exclusion, cross-reference extraction, ISO-8601 parsing (incl. cross-day), median edge cases. Agent.md count 1107→1119 (+12) correct.
- Maintainer push: fixed a docstring usage filename (reader-fix-latency.py → reader_fix_latency.py — the documented command would have failed with a No such file or directory). Pushed 5c3428c; CI re-ran green (33026584577).
Non-blocking: README example could mention the script requires gh auth, but the script's own usage + the existing README CI section cover this.
argszero
reviewed
Aug 27, 2026
argszero
left a comment
Owner
There was a problem hiding this comment.
✅ LGTM 3/3 — cycle 2026-08-27T08:39:52. Fresh re-verification: head 5c3428c unchanged (4 files, +246/-1), CI 33026584577 green (test + test-windows), MERGEABLE/CLEAN. Diff matches the deep reviews from 1/3 and 2/3 (script paginates via gh api, real-issue vs PR exclusion, earliest merged PR wins, median across samples; 12 tests; Agent.md 1107→1119). No new feedback. Merging.
This was referenced Aug 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a measured reader-feedback → merged-fix latency metric — the secondary suggestion from issue #1027 (reader comment heinrichneb, Dev.to 3dicj: "add a README metric — median time from reader-found boundary to merged fix (the 50-min loop claim becomes a measured number)").
Problem
The Dev.to article claimed a ~50-minute issue-to-merged-fix loop, but the number was anecdotal — no reproducible measurement existed.
Fix
New
scripts/reader_fix_latency.py:gh api— works over api.github.com even when git-over-https to github.com:443 is down (the documented EMRG network shape).cross-referencedevents to the earliest merged linked PR.issue.created_at → PR.merged_at; reports the median plus slowest/fastest examples with the sample size stated transparently.Current real measurement (argszero/emrg): median 38 min across 3 closed issues with a merged fix PR (#1000 = 49m19s — the exact "50-min loop" claim, now verified).
README's Rant-Driven Evolution section now documents the metric and how to run it.
Verification
Fixes the secondary suggestion of #1027 (primary drift detection is handled separately in #1029).