feat: url-pipeline core — parser, adapter ABC, registry, store hooks - #6
Closed
jhamman wants to merge 2 commits into
Closed
feat: url-pipeline core — parser, adapter ABC, registry, store hooks#6jhamman wants to merge 2 commits into
jhamman wants to merge 2 commits into
Conversation
jhamman
force-pushed
the
feature/url-pipeline-core
branch
2 times, most recently
from
July 27, 2026 02:12
03bed15 to
5ae451e
Compare
jhamman
force-pushed
the
feature/zipstore-file-like
branch
from
July 27, 2026 15:12
7d33da8 to
ef00953
Compare
jhamman
force-pushed
the
feature/url-pipeline-core
branch
2 times, most recently
from
July 27, 2026 19:10
fb71546 to
ec2c8bf
Compare
jhamman
force-pushed
the
feature/zipstore-file-like
branch
from
July 27, 2026 19:14
54fa1dd to
b5f99fb
Compare
jhamman
force-pushed
the
feature/url-pipeline-core
branch
from
July 27, 2026 19:14
ec2c8bf to
f26b436
Compare
…#4187) Allows constructing a ZipStore from any seekable binary reader, enabling zip archives on remote storage: - io objects (BytesIO, fsspec file objects) are used directly - minimal readers that are not io.IOBase instances and whose read() may return buffer-protocol objects rather than bytes (e.g. obstore.ReadableFile) are adapted via a small io.RawIOBase wrapper when opened for reading clear()/move() raise NotImplementedError for file-object-backed stores. Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
jhamman
force-pushed
the
feature/url-pipeline-core
branch
from
July 28, 2026 02:33
f26b436 to
d77e88f
Compare
Implements URL pipeline support (https://github.com/jbms/url-pipeline): '|'-chained URLs resolve through pluggable adapters registered under the 'zarr.url_adapters' entry-point group (entry-point name = URL scheme). - zarr.abc.url_pipeline: PipelineSegment, AdapterResolution, PipelineContext, URLPipelineAdapter (single-classmethod contract) - zarr.storage._url_pipeline: parse_pipeline / resolve_pipeline; the root sub-URL delegates to make_store so existing file/memory/fsspec routing is unchanged - registry: register_url_adapter / get_url_adapter / list_url_adapter_schemes (name check only; no adapter imports) - make_store/make_store_path route strings containing '|' (or a registered root scheme) through the resolver; residual store paths combine with the user-supplied path - StorePath gains a zarr_format attribute (populated by format segments in a follow-up) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
jhamman
force-pushed
the
feature/url-pipeline-core
branch
from
July 28, 2026 12:30
d77e88f to
10cb73b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Implements URL pipeline support (https://github.com/jbms/url-pipeline): '|'-chained URLs resolve through pluggable adapters registered under the 'zarr.url_adapters' entry-point group (entry-point name = URL scheme).
For reviewers
This is the second of a series of Pull Requests toward zarr-developers#2943.
Author attestation
TODO:
docs/user-guide/*.mdchanges/