Gate empty-gold negatives on utterance shape - #2861

Queued

Dominic Nguyen (datduyng) wants to merge 9 commits into

mainfrom

domnguyen/tb-empty-gold-utterance

Dominic Nguyen (datduyng) commented Aug 12, 2026 •

edited

Loading

Contributor

Reject empty-gold utterances that are questions, sibling commands, or refuse-then-alternate.

This is a cheap and deterministic way to filter out utterances catching 90% of LLm generated utterances

Dominic Nguyen (datduyng) and others added 2 commits

August 12, 2026 15:08


          feat(benchmarks): gate empty-gold on utterance shape

7ec94d5

Reject questions, sibling commands, and refuse-then-alternate forms
even when an LLM labels the empty as a pure refusal.


          docs: regenerate README.AUTOGEN.md, command reference, and action bro…

d235685

…wser

Dominic Nguyen (datduyng) enabled auto-merge

August 12, 2026 22:39

Dominic Nguyen (datduyng) and others added 3 commits

August 12, 2026 15:43


          chore: requeue CI after smoke install flake

e0141d9


          chore: requeue CI after smoke install flake

b05505e


          Merge remote-tracking branch 'origin/main' into _heal

cbc238d

# Conflicts:
#	ts/packages/benchmarks/README.AUTOGEN.md

George Ng (GeorgeNgMsft) reviewed

View reviewed changes

ts/packages/benchmarks/src/translationBench/synthesizer/emptyGoldUtterance.ts

George Ng (GeorgeNgMsft) approved these changes

View reviewed changes

George Ng (GeorgeNgMsft) left a comment

Contributor

Approving, there is an improvement that can be made but as discussed offline, you are incrementally working on the data cleaning quality.

Dominic Nguyen (datduyng) and others added 2 commits

August 12, 2026 18:58


          Merge branch 'main' into domnguyen/tb-empty-gold-utterance

db6cd01


          docs: regenerate README.AUTOGEN.md, command reference, and action bro…

9062d67

…wser

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Dominic Nguyen (datduyng) removed this pull request from the merge queue due to a manual request

typeagent-bot Bot added 2 commits

August 13, 2026 01:20


          Merge remote-tracking branch 'origin/main' into _heal

c97c0ab

# Conflicts:
#	ts/packages/benchmarks/README.AUTOGEN.md


          docs: regenerate README.AUTOGEN.md, command reference, and action bro…

ee8cd4f

…wser

Dominic Nguyen (datduyng) enabled auto-merge

August 13, 2026 01:52

Dominic Nguyen (datduyng) added this pull request to the merge queue

Any commits made after this event will not be merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet