Manual test FastAPI POtel integration

[antonpirker]

Manually test instrumentation using the POtel branch of the SDK.

Have a look at the Notion page to see what to test:
https://www.notion.so/sentry/Test-Plan-dad180396cdf4c8c971e1ab9af909ced
(employees only, sorry)

If you have JSON files of transactions or errors you can attach them to this issue for later reference.

[antonpirker]

JSON of transactions using Sentry only or Sentry with Potel:

fastapi-sentry.json

fastapi-potel.json

[antonpirker]

Transaction differences:

• new contexts["otel"]: OK
• way more data in contexts["trace"]["data"]: OK
• more data in spans[*]["data"]: OK
• status moved from spans[*]["tags"]["status"] to spans[*]["status"]: OK
• same_process_as_parent is gone: OK
• spans[*]["tags"]["http.status_code"] is now in span[*]["data"]["http.response.status_code"]: OK
• tags["http.status_code"] on transaction is now only in contexts["trace"]["data"]["http.response.status_code"]: OK

Diff of transaction:

Last login: Wed Apr 30 20:03:52 on ttys014
antonpirker@Y7CYJ0XDQY ~ » cd code/testing-sentry/sentry-test-server 
antonpirker@Y7CYJ0XDQY testing-sentry/sentry-test-server (main *%) » ls
2.27.0         2.27.0_x0      3.0.0          3.0.0_x0       README.md      __pycache__    main.py        pyproject.toml run.sh         utils.py       uv.lock
antonpirker@Y7CYJ0XDQY testing-sentry/sentry-test-server (main *%) » diff 2.27.0/envelope-transaction-0.json 3.0.0/envelope-transaction-0.json
18a19,26
>     "otel": {
>       "resource": {
>         "service.name": "unknown_service",
>         "telemetry.sdk.language": "python",
>         "telemetry.sdk.name": "opentelemetry",
>         "telemetry.sdk.version": "1.32.1"
>       }
>     },
34a43,58
>         "client.address": "127.0.0.1",
>         "client.port": 63817,
>         "http.request.header.accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8",
>         "http.request.header.accept-encoding": "gzip, deflate, br, zstd",
>         "http.request.header.accept-language": "en-US,en;q=0.5",
>         "http.request.header.connection": "keep-alive",
>         "http.request.header.cookie": "[Filtered]",
>         "http.request.header.host": "localhost:5000",
>         "http.request.header.priority": "u=0, i",
>         "http.request.header.sec-fetch-dest": "document",
>         "http.request.header.sec-fetch-mode": "navigate",
>         "http.request.header.sec-fetch-site": "none",
>         "http.request.header.sec-fetch-user": "?1",
>         "http.request.header.upgrade-insecure-requests": "1",
>         "http.request.header.user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:138.0) Gecko/20100101 Firefox/138.0",
>         "http.request.method": "GET",
35a60,68
>         "network.protocol.name": "http",
>         "network.protocol.version": "1.1",
>         "sentry.name": "/error",
>         "sentry.op": "http.server",
>         "sentry.origin": "auto.http.starlette",
>         "sentry.source": "route",
>         "sentry.tag.asgi.type": "http",
>         "server.address": "127.0.0.1",
>         "server.port": 5000,
37c70,73
<         "thread.name": "MainThread"
---
>         "thread.name": "MainThread",
>         "url.full": "http://127.0.0.1:5000/error",
>         "url.path": "/error",
>         "url.scheme": "http"
39d74
<       "description": null,
43c78
<       "span_id": "b232cd679af4566a",
---
>       "span_id": "f8ce91cb77cf755f",
45c80
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
48,49c83,84
<   "environment": "test-potel-fastapi-2.27.0",
<   "event_id": "fa543f51c820475cafb857ea95f5d142",
---
>   "environment": "test-potel-fastapi-3.0.0",
>   "event_id": "85f8bdb71a224640a681500ed794c7dc",
59d93
<   "measurements": {},
61c95
<   "release": "2.27.0",
---
>   "release": "3.0.0",
99c133
<         "version": "2.27.0"
---
>         "version": "3.0.0"
102c136
<     "version": "2.27.0"
---
>     "version": "3.0.0"
107a142,146
>         "sentry.name": "ServerErrorMiddleware",
>         "sentry.op": "middleware.starlette",
>         "sentry.origin": "auto.http.starlette",
>         "sentry.source": "custom",
>         "sentry.tag.starlette.middleware_name": "ServerErrorMiddleware",
114,117c153,156
<       "parent_span_id": "b232cd679af4566a",
<       "same_process_as_parent": true,
<       "span_id": "9dda25c304df7668",
<       "start_timestamp": "2025-05-05T10:44:16.509713Z",
---
>       "parent_span_id": "f8ce91cb77cf755f",
>       "span_id": "7e2e2bd4206aa34a",
>       "start_timestamp": "2025-05-05T10:45:08.063680Z",
>       "status": "internal_error",
119,120c158
<         "starlette.middleware_name": "ServerErrorMiddleware",
<         "status": "internal_error"
---
>         "starlette.middleware_name": "ServerErrorMiddleware"
122,123c160,161
<       "timestamp": "2025-05-05T10:44:16.981299Z",
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "timestamp": "2025-05-05T10:45:08.534673Z",
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
127a166,170
>         "sentry.name": "ExceptionMiddleware",
>         "sentry.op": "middleware.starlette",
>         "sentry.origin": "auto.http.starlette",
>         "sentry.source": "custom",
>         "sentry.tag.starlette.middleware_name": "ExceptionMiddleware",
134,137c177,180
<       "parent_span_id": "9dda25c304df7668",
<       "same_process_as_parent": true,
<       "span_id": "b18cba960ce22026",
<       "start_timestamp": "2025-05-05T10:44:16.509781Z",
---
>       "parent_span_id": "7e2e2bd4206aa34a",
>       "span_id": "5aa29c2c7bec844e",
>       "start_timestamp": "2025-05-05T10:45:08.063760Z",
>       "status": "internal_error",
139,140c182
<         "starlette.middleware_name": "ExceptionMiddleware",
<         "status": "internal_error"
---
>         "starlette.middleware_name": "ExceptionMiddleware"
142,143c184,185
<       "timestamp": "2025-05-05T10:44:16.980519Z",
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "timestamp": "2025-05-05T10:45:08.533765Z",
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
151a194,197
>         "sentry.name": "POST http://localhost:9999/api/0/envelope/",
>         "sentry.op": "http.client",
>         "sentry.origin": "auto.http.stdlib.httplib",
>         "sentry.source": "custom",
159,168c205,210
<       "parent_span_id": "b18cba960ce22026",
<       "same_process_as_parent": true,
<       "span_id": "a7bd279269d9eec7",
<       "start_timestamp": "2025-05-05T10:44:16.511717Z",
<       "tags": {
<         "http.status_code": "200",
<         "status": "ok"
<       },
<       "timestamp": "2025-05-05T10:44:16.515983Z",
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "parent_span_id": "f8ce91cb77cf755f",
>       "span_id": "aa3d05143416bcaf",
>       "start_timestamp": "2025-05-05T10:45:08.579330Z",
>       "status": "ok",
>       "timestamp": "2025-05-05T10:45:08.583792Z",
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
171a214,216
>         "sentry.name": "test-span",
>         "sentry.origin": "manual",
>         "sentry.source": "custom",
176c221
<       "op": null,
---
>       "op": "test-span",
178,186c223,228
<       "parent_span_id": "b18cba960ce22026",
<       "same_process_as_parent": true,
<       "span_id": "beb06b3c4956a9aa",
<       "start_timestamp": "2025-05-05T10:44:16.516305Z",
<       "tags": {
<         "status": "internal_error"
<       },
<       "timestamp": "2025-05-05T10:44:16.977075Z",
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "parent_span_id": "5aa29c2c7bec844e",
>       "span_id": "2b3a63a7ee458c61",
>       "start_timestamp": "2025-05-05T10:45:08.070385Z",
>       "status": "internal_error",
>       "timestamp": "2025-05-05T10:45:08.529972Z",
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
189a232,234
>         "sentry.name": "test-span-2",
>         "sentry.origin": "manual",
>         "sentry.source": "custom",
194c239
<       "op": null,
---
>       "op": "test-span-2",
196,204c241,246
<       "parent_span_id": "beb06b3c4956a9aa",
<       "same_process_as_parent": true,
<       "span_id": "addf7915c96e4bbf",
<       "start_timestamp": "2025-05-05T10:44:16.516350Z",
<       "tags": {
<         "status": "internal_error"
<       },
<       "timestamp": "2025-05-05T10:44:16.977012Z",
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "parent_span_id": "2b3a63a7ee458c61",
>       "span_id": "3aa66b25d05dc243",
>       "start_timestamp": "2025-05-05T10:45:08.070461Z",
>       "status": "internal_error",
>       "timestamp": "2025-05-05T10:45:08.529914Z",
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
212a255,258
>         "sentry.name": "POST http://localhost:9999/api/0/envelope/",
>         "sentry.op": "http.client",
>         "sentry.origin": "auto.http.stdlib.httplib",
>         "sentry.source": "custom",
220,229c266,271
<       "parent_span_id": "b18cba960ce22026",
<       "same_process_as_parent": true,
<       "span_id": "932c4c3e8b00ad08",
<       "start_timestamp": "2025-05-05T10:44:16.978043Z",
<       "tags": {
<         "http.status_code": "200",
<         "status": "ok"
<       },
<       "timestamp": "2025-05-05T10:44:16.980351Z",
<       "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
---
>       "parent_span_id": "5aa29c2c7bec844e",
>       "span_id": "426b8fbc154062f6",
>       "start_timestamp": "2025-05-05T10:45:08.064846Z",
>       "status": "ok",
>       "timestamp": "2025-05-05T10:45:08.069933Z",
>       "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
232a275,279
>         "sentry.name": "SentryAsgiMiddleware._run_app.<locals>._sentry_wrapped_send",
>         "sentry.op": "middleware.starlette.send",
>         "sentry.origin": "auto.http.starlette",
>         "sentry.source": "custom",
>         "sentry.tag.starlette.middleware_name": "ServerErrorMiddleware",
239,242c286,289
<       "parent_span_id": "9dda25c304df7668",
<       "same_process_as_parent": true,
<       "span_id": "ae8d8d69065e70fd",
<       "start_timestamp": "2025-05-05T10:44:16.980595Z",
---
antonpirker@Y7CYJ0XDQY testing-sentry/sentry-test-server (main *%) » git diff --no-index 2.27.0/envelope-transaction-0.json 3.0.0/envelope-transaction-0.json










































































       },
       "description": "SentryAsgiMiddleware._run_app.<locals>._sentry_wrapped_send",
       "op": "middleware.starlette.send",
       "origin": "auto.http.starlette",
-      "parent_span_id": "9dda25c304df7668",
-      "same_process_as_parent": true,
-      "span_id": "9e99bb00d5a34cb0",
-      "start_timestamp": "2025-05-05T10:44:16.981077Z",
+      "parent_span_id": "7e2e2bd4206aa34a",
+      "span_id": "e4550530b66488b0",
+      "start_timestamp": "2025-05-05T10:45:08.534354Z",
+      "status": "ok",
       "tags": {
         "starlette.middleware_name": "ServerErrorMiddleware"
       },
-      "timestamp": "2025-05-05T10:44:16.981291Z",
-      "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
+      "timestamp": "2025-05-05T10:45:08.534651Z",
+      "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
     },
     {
       "data": {
@@ -271,6 +323,10 @@
         "http.query": "",
         "http.response.status_code": 200,
         "reason": "OK",
+        "sentry.name": "POST http://localhost:9999/api/0/envelope/",
+        "sentry.op": "http.client",
+        "sentry.origin": "auto.http.stdlib.httplib",
+        "sentry.source": "custom",
         "thread.id": "8658291840",
         "thread.name": "MainThread",
         "url": "http://localhost:9999/api/0/envelope/"
@@ -278,25 +334,20 @@
       "description": "POST http://localhost:9999/api/0/envelope/",
       "op": "http.client",
       "origin": "auto.http.stdlib.httplib",
-      "parent_span_id": "b232cd679af4566a",
-      "same_process_as_parent": true,
-      "span_id": "a2841502a04d8745",
-      "start_timestamp": "2025-05-05T10:44:17.030932Z",
-      "tags": {
-        "http.status_code": "200",
-        "status": "ok"
-      },
-      "timestamp": "2025-05-05T10:44:17.035966Z",
-      "trace_id": "f6a3c88ed996477ba3ffb0e6f612c7dc"
+      "parent_span_id": "5aa29c2c7bec844e",
+      "span_id": "8d8b0414b3f6b528",
+      "start_timestamp": "2025-05-05T10:45:08.530865Z",
+      "status": "ok",
+      "timestamp": "2025-05-05T10:45:08.533586Z",
+      "trace_id": "74949f3b7b8a11c268e2fda589dc1e4d"
     }
   ],
-  "start_timestamp": "2025-05-05T10:44:16.508708Z",
+  "start_timestamp": "2025-05-05T10:45:08.063195Z",
   "tags": {
     "asgi.type": "http",
-    "http.status_code": "500",
     "test-tag": "test-value"
   },
-  "timestamp": "2025-05-05T10:44:17.036209Z",
+  "timestamp": "2025-05-05T10:45:08.583921Z",
   "transaction": "/error",
   "transaction_info": {
     "source": "route"
@@ -306,4 +357,4 @@
     "id": "testuser",
     "username": "Test User"
   }
-}
\ No newline at end of file

[antonpirker]

Profiles look good.

2.27.0: envelope-profile-0.json
3.0.0: envelope-profile-0.json

[antonpirker]

Errors:

• way more data in contexts["trace"]["data"]: OK
• breadcrumbs have now always a level: OK
• exception groups work: OK

[antonpirker]

After some fixes in potel-base also Feature Flags and Attachments work as before: OK

[antonpirker]

Check-Ins:

• way more data in contexts["trace"]["data"]: OK
• rest is the same

[antonpirker]

Full test output files from 2.27.0:

envelope-attachment-0.json
envelope-attachment-1.json
envelope-attachment-2.json
envelope-attachment-3.json
envelope-attachment-4.json
envelope-check_in-0.json
envelope-check_in-1.json
envelope-event-0.json
envelope-profile-0.json
envelope-transaction-0.json

[antonpirker]

Full test output from 3.0.0:

envelope-attachment-0.json
envelope-attachment-1.json
envelope-attachment-2.json
envelope-attachment-3.json
envelope-attachment-4.json
envelope-check_in-0.json
envelope-check_in-1.json
envelope-event-0.json
envelope-profile-0.json
envelope-transaction-0.json