Add Support for Annotating Embedding and Retrieval Documents

[sabrenner]

What Does This Do

Adds proper support for annotating embedding and retrieval documents for LLM Observability spans by adding two new annotateEmbeddingIO(List<LLMObs.Document>, String) and annotateRetrievalIO(String, List<LLMObs.Document>) functions for embedding and retrieval spans respectively.

Motivation

In-parity support with Node.js and Python. Additionally, unblocks proper span processing support in #12112

Additional Notes

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors
• Once approved, use merge queue to merge the PR

Jira ticket: MLOB-7937

[sabrenner]

@codex review

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b4184fb6d5

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

[dd-octo-sts]

🟡 Java Benchmark SLOs — Performance SLO warning (near threshold)

Suite	Status
Startup	🟡 warning

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Candidate	master	Δ (95% CI of mean)
startup:insecure-bank:iast:Agent	14.76 s	14.69 s	[-0.6%; +1.6%] (no difference)
startup:insecure-bank:tracing:Agent	13.58 s	13.71 s	[-1.8%; -0.1%] (maybe better)
startup:petclinic:appsec:Agent	17.44 s	17.38 s	[-0.7%; +1.4%] (no difference)
startup:petclinic:iast:Agent	17.43 s	17.51 s	[-1.3%; +0.3%] (no difference)
startup:petclinic:profiling:Agent	17.44 s	17.41 s	[-1.0%; +1.4%] (no difference)
startup:petclinic:sca:Agent	17.44 s	17.18 s	[+0.5%; +2.5%] (maybe worse)
startup:petclinic:tracing:Agent	16.46 s	16.54 s	[-1.6%; +0.6%] (no difference)

Commit: 27cb6073 · CI Pipeline · Benchmarking Platform UI

---

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

[sabrenner]

@codex review

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 2c241d4eb5

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

[sabrenner]

@codex review

[chatgpt-codex-connector]

Codex Review: Didn't find any major issues. Swish!

Reviewed commit: 27cb6073be

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

[datadog-datadog-prod-us1]

More details

The embedding and retrieval document paths preserve legacy string behavior while emitting the new document shape, including optional name, id, and score fields. Focused domain and mapper tests passed across legacy, metadata-rich, partial, empty, and invalid-value scenarios; no diff-attributable behavioral regression was found.

Was this helpful? React 👍 or 👎

_{📊 Validated against 8 scenarios · Open Bits AI session}

_{🤖 Datadog Autotest · Commit 27cb607 · What is Autotest? · @DataDog review to ask questions · Any feedback? Reach out in #autotest}

[ygree]

AnnotateIO taking two arguments does not seem to be a flexible API design. Since we need to add more combinations of different types, we might want to consider splitting it into two separate methods, at least for new methods. WDYT?

[ygree]

LGTM

[dd-octo-sts]

/merge

[gh-worker-devflow-routing-ef8351]

View all feedbacks in Devflow UI.

2026-08-06 14:03:22 UTC ℹ️ Start processing command /merge

---

2026-08-06 14:03:27 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

---

2026-08-06 14:17:15 UTC ❌ MergeQueue: The build pipeline contains failing jobs for this merge request

Build pipeline has failing jobs for 76a5bad:

• create-multiarch-lib-injection-image

⚠️ Do NOT retry failed jobs directly (why?).

What to do next?

• Investigate the failures and when ready, re-add your pull request to the queue!
• If your PR checks are green, try to rebase/merge. It might be because the CI run is a bit old.
• Any question, go check the FAQ.

Details

Since those jobs are not marked as being allowed to fail, the pipeline will most likely fail.
Therefore, and to allow other builds to be processed, this merge request has been rejected and the pipeline got canceled.