Improve perf through better overlapping of api calls by ben-hansen-db · Pull Request #6677 · databricks/cli

ben-hansen-db · 2026-09-14T16:26:33Z

Changes

Make uploadArtifacts create the launch directory once and upload its files concurrently.
Add stageRunArtifacts to overlap launch uploads with snapshotViaDABsUpload, while still waiting for both before runs/submit.
Stop polling MLflow IDs after a text-mode submit and pass the resolved snapshot artifact base through the uploader, removing the second SCIM Me lookup.

Why

AIR submission latency was dominated by sequential remote calls. These changes shorten the critical path without changing snapshot packaging or content-addressing behavior.

Change	Why it is safe
Remove post-submit MLflow polling	MLflow links are best-effort enrichment. The command still returns the Job run ID and URL, and `air get`, `air logs`, and `--watch` resolve run details when needed.
Upload launch files concurrently	The files have independent names and contents. The launch directory is created before writes begin, overwrite behavior is preserved, and any write error fails staging.
Overlap launch and snapshot staging	The two branches write to separate destinations and only converge when building the Jobs payload. `runs/submit` is called only after both complete successfully.
Reuse the resolved workspace base	Both paths belong to the same authenticated user. Passing the already-resolved base removes an identical SCIM lookup, while configured `remote_volume` behavior remains unchanged.

Tests

Live submission latency on df1:

Scenario	Before	After	Improvement
No-code JSON	1.36s median	0.93s median	31% faster
Tiny `ts_smoke` snapshot	2.52s median	1.62s median	36% faster
Text mode	3.30s observed	0.73s median	78% faster

Validation:

go test ./experimental/air/cmd — pass.
Focused race tests for concurrent uploads and staging — pass.
AIR run-submit acceptance tests — 3/3 pass.
Full lint — 0 issues.

This PR was written with Codex.

eng-dev-ecosystem-bot · 2026-09-14T17:05:32Z

Integration test report

Commit: 7ee573a

Run: 34870253893

	Env	💚RECOVERED	✅pass	🙈skip	Time
💚	aws linux	1	275	15	8:40
💚	aws windows	1	277	13	6:32
💚	azure linux	1	274	15	7:47
💚	azure windows	1	276	13	6:04
💚	gcp linux	1	275	15	7:40
💚	gcp windows	1	277	13	5:53

	Test Name	aws linux	aws windows	azure linux	azure windows	gcp linux	gcp windows
💚	TestAccept	💚R	💚R	💚R	💚R	💚R	💚R

Top 4 slowest tests (at least 2 minutes):

duration	env	testname
3:16	aws windows	TestAccept
3:06	gcp windows	TestAccept
3:05	azure windows	TestAccept
2:39	azure linux	TestFilerWorkspaceFilesExtensionsReadDir

## Changes - Make `uploadArtifacts` create the launch directory once and upload its files concurrently. - Add `stageRunArtifacts` to overlap launch uploads with `snapshotViaDABsUpload`, while still waiting for both before `runs/submit`. - Stop polling MLflow IDs after a text-mode submit and pass the resolved snapshot artifact base through the uploader, removing the second SCIM `Me` lookup. ## Why AIR submission latency was dominated by sequential remote calls. These changes shorten the critical path without changing snapshot packaging or content-addressing behavior. | Change | Why it is safe | |---|---| | Remove post-submit MLflow polling | MLflow links are best-effort enrichment. The command still returns the Job run ID and URL, and `air get`, `air logs`, and `--watch` resolve run details when needed. | | Upload launch files concurrently | The files have independent names and contents. The launch directory is created before writes begin, overwrite behavior is preserved, and any write error fails staging. | | Overlap launch and snapshot staging | The two branches write to separate destinations and only converge when building the Jobs payload. `runs/submit` is called only after both complete successfully. | | Reuse the resolved workspace base | Both paths belong to the same authenticated user. Passing the already-resolved base removes an identical SCIM lookup, while configured `remote_volume` behavior remains unchanged. | ## Tests Live submission latency on df1: | Scenario | Before | After | Improvement | |---|---:|---:|---:| | No-code JSON | 1.36s median | 0.93s median | 31% faster | | Tiny `ts_smoke` snapshot | 2.52s median | 1.62s median | 36% faster | | Text mode | 3.30s observed | 0.73s median | 78% faster | Validation: - `go test ./experimental/air/cmd` — pass. - Focused race tests for concurrent uploads and staging — pass. - AIR run-submit acceptance tests — 3/3 pass. - Full lint — 0 issues. _This PR was written with Codex._

eng-dev-ecosystem-bot · 2026-09-15T22:25:43Z

Integration test report

Commit: 86afe92

Run: 34995620555

	Env	❌FAIL	🟨KNOWN	🔄flaky	🙈SKIP	✅pass	🙈skip	Time
❌	aws linux	32	7		1	1589	1057	345:50
❌	aws windows	43	7		1	1479	1082	341:53
🟨	azure linux		7		1	1434	1106	267:27
🟨	azure windows		7	2	1	1333	1131	270:11
❌	gcp linux	41	7		1	1379	1110	275:19
❌	gcp windows	38	7		1	1283	1135	285:10

97 interesting tests: 87 FAIL, 7 KNOWN, 2 flaky, 1 SKIP

	Test Name	aws linux	aws windows	azure linux	azure windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
❌	TestAccept/bundle/deploy/spark-jar-task	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/deployment/bind/vector_search_endpoint	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/vector_search_endpoint/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/dms/multiple-resources	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/dms/multiple-resources/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	✅p	✅p	✅p	✅p	❌F
❌	TestAccept/bundle/invariant/delete_idempotent	❌F	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=secret_scope.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent	❌F	❌F	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/destroy_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift	❌F	❌F	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=cluster_policy.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=dashboard.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=dashboard.yml.tmpl/READPLAN=1	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=job_apply_policy_default_values_task_cluster.yml.tmpl/READPLAN=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=vector_search_endpoint.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=vector_search_index.yml.tmpl/READPLAN=1	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/cluster_policies/definition_multiline	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/cluster_policies/definition_multiline/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	❌F	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/resources/cluster_policies/policy_family_overrides	✅p	✅p	✅p	🔄f	✅p	✅p
🔄	TestAccept/bundle/resources/cluster_policies/policy_family_overrides/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	🔄f	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/data_security_mode	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/data_security_mode/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/data_security_mode/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/simple	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/simple/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/simple/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/update-after-create	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started-toggle	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/resize-terminated-fallback	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	❌F	❌F	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	❌F	✅p	✅p	✅p	✅p
🟨	TestAccept/bundle/resources/mcp_services/lifecycle	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/mcp_services/lifecycle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/model_provider_services/lifecycle	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/model_provider_services/lifecycle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/model_services/lifecycle	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/model_services/lifecycle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	🟨K	🟨K	🟨K	🟨K	🟨K	🟨K
❌	TestAccept/bundle/resources/pipelines/recreate	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/pipelines/recreate/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/pipelines/update	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/pipelines/update/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	❌F	✅p	✅p	✅p	✅p	✅p
❌	TestAccept/bundle/resources/postgres_projects/recreate	✅p	❌F	🙈s	🙈s	🙈s	🙈s
❌	TestAccept/bundle/resources/postgres_projects/recreate/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	❌F
❌	TestAccept/bundle/resources/vector_search_endpoints/basic	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_endpoints/basic/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_endpoints/basic/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	✅p	❌F	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	❌F	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/basic	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/basic/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/basic/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/grants/select	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/grants/select/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/schema_normalization	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/schema_normalization/DATABRICKS_BUNDLE_ENGINE=direct/DMS=	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/vector_search_indexes/schema_normalization/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true	✅p	✅p	✅p	✅p	❌F	❌F
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
❌	TestFsCpFileToDirFileNotOverwritten	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestFsCpFileToDirFileNotOverwritten/dbfs_to_uc-volumes	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestFsCpFileToDirWithOverwriteFlag	✅p	✅p	✅p	✅p	❌F	✅p
❌	TestFsCpFileToDirWithOverwriteFlag/uc-volumes_to_uc-volumes	✅p	✅p	✅p	✅p	❌F	✅p

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
19:11	aws linux	TestAccept/bundle/resources/clusters/deploy/data_security_mode/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
18:27	aws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
14:55	aws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
14:28	aws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
14:06	gcp windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
14:05	gcp windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
13:57	gcp linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
13:41	aws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
13:32	aws windows	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
13:27	gcp linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
12:40	aws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
11:55	aws linux	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
11:54	aws windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
11:06	gcp linux	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
10:46	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
10:44	azure windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
10:35	aws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=
10:33	aws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
10:13	aws windows	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=1
10:10	gcp windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=
10:06	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
9:39	gcp windows	TestAccept/bundle/resources/clusters/resize-terminated-fallback/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
9:35	aws linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
9:33	aws windows	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
9:20	aws linux	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
8:57	aws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
8:56	aws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
8:35	azure linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
8:30	aws linux	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=1
8:30	gcp linux	TestAccept/bundle/resources/apps/lifecycle-started-omitted/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
8:26	azure windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
8:26	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
8:21	aws linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
8:07	azure windows	TestAccept/bundle/deploy/spark-jar-task/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=
8:07	azure linux	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
8:07	aws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=
8:05	gcp linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
8:05	aws windows	TestAccept/bundle/resources/apps/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
8:02	aws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
7:58	aws linux	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
7:56	gcp linux	TestAccept/bundle/resources/clusters/deploy/data_security_mode/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
7:54	aws linux	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:54	gcp linux	TestAccept/bundle/resources/clusters/deploy/local_ssd_count/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
7:53	gcp windows	TestAccept/bundle/resources/clusters/lifecycle-started-toggle/DATABRICKS_BUNDLE_ENGINE=direct/DMS=
7:38	aws windows	TestAccept/bundle/invariant/delete_idempotent/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:29	azure linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster.yml.tmpl/READPLAN=
7:25	aws linux	TestAccept/bundle/invariant/no_drift/DATABRICKS_BUNDLE_ENGINE=direct/DMS=/INPUT_CONFIG=cluster_apply_policy_default_values.yml.tmpl/READPLAN=
7:21	gcp linux	TestAccept/bundle/config-remote-sync/multiple_resources/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=
7:21	gcp linux	TestAccept/bundle/resources/clusters/lifecycle-started/DATABRICKS_BUNDLE_ENGINE=direct/DMS=true
7:19	aws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform/DMS=

ben-hansen-db added 2 commits September 14, 2026 16:25

Improve perf through better overlapping of api calls

0d5a75b

Clarify AIR staging concurrency invariants

7ee573a

ben-hansen-db requested a review from vinchenzo-db September 14, 2026 16:47

vinchenzo-db approved these changes Sep 14, 2026

View reviewed changes

ben-hansen-db added this pull request to the merge queue Sep 15, 2026

Merged via the queue into main with commit 86afe92 Sep 15, 2026
34 checks passed

ben-hansen-db deleted the ben/air_cli_api_perf branch September 15, 2026 16:31

Navigation Menu

Uh oh!

Improve perf through better overlapping of api calls - #6677

Improve perf through better overlapping of api calls#6677
ben-hansen-db merged 2 commits into
mainfrom
ben/air_cli_api_perf

ben-hansen-db commented Sep 14, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Sep 14, 2026

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Sep 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

ben-hansen-db commented Sep 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Sep 14, 2026

Integration test report

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Sep 15, 2026

Integration test report

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ben-hansen-db commented Sep 14, 2026 •

edited

Loading