Zarrquet implementation: Adding Zarrs-based TableProvider with bindings in Python.#69

Open

alxmrs wants to merge 65 commits intomainfrom

Commits on Jul 15, 2025

Integrated rust into the project via maturin
alxmrs
committed

Commits on Jul 16, 2025

Properly set up the rust project (with dummy table provide, can compile with `uv build`.
alxmrs
committed
Phase 1 and 2 implementation of zarr store plan!
alxmrs
committed
Next step: only processes a single array in the zarr group as record batches
alxmrs
committed
Attempting to minimize copying.
alxmrs
committed
Had Claude refactor the code to introduce generics, in order to reduce duplicate logic.
alxmrs
committed
Better explained requirements for tables, claude wrote tests.
alxmrs
committed
Applied automatic Zarr fixes from the compiler.
alxmrs
committed
Core data var to table logic implemented, according to Claude. Needs some refactoring.
alxmrs
committed
Adding test_data to gitignore.
alxmrs
committed
Added example and test scripts as sanity checks. might delete later.
alxmrs
committed
Adding predicate pushdown logic, but I think it may need revision, will investigate later.
alxmrs
committed

Commits on Jul 17, 2025

Commits on Jul 18, 2025

Attempt to fix minor warnings.
alxmrs
committed

Commits on Jul 22, 2025

Commits on Jul 24, 2025

Apply clippy suggestions and rustfmt to #69 (#70)
kylebarron
authored

Commits on Jul 25, 2025

Commits on Sep 11, 2025

Attempting to take a much simpler approach via an adapter.
alxmrs
committed

Commits on Sep 12, 2025

New, simpler approach that makes use of `arrow-zarr`.
alxmrs
committed

Commits on Sep 26, 2025

Commits on Sep 27, 2025