-
-
Notifications
You must be signed in to change notification settings - Fork 14
Add support for Uuid for ArrowDeserialize and ArrowSerialize #28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Please double check the following review of the pull request:
Changes in the diff
Identified Issues
Issue 001: Unsafe unwrap in
|
Reference: https://arrow.apache.org/docs/format/CanonicalExtensions.html#uuid Rely on FixedSizeBinary(16) as the arrow format as mentionned in the spec
4e99855 to
8858107
Compare
arrow_convert/Cargo.toml
Outdated
| glam = { workspace = true, optional = true } | ||
| rust_decimal = { workspace = true, optional = true } | ||
| tinystr = { workspace = true, optional = true } | ||
| uuid = { workspace = true } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@mchataigner we might want to set this optional = true if part of this block
|
@mchataigner Thanks for the changes. Happy to have uuid support. However we want to keep core with fewer dependencies are possible. So as @redox mentioned this should an optional feature. Take a look at how glam, rust-decimal are implemented here, if you need an example. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR adds UUID support to the arrow_convert library, enabling serialization and deserialization of UUID values to/from Apache Arrow's FixedSizeBinary(16) format.
Key changes:
- Implementation of
ArrowField,ArrowSerialize, andArrowDeserializetraits foruuid::Uuid - Comprehensive test suite covering serialization, deserialization, null handling, and iterator-based operations
- Feature-gated dependency on the
uuidcrate (version 1.18.1)
Reviewed Changes
Copilot reviewed 5 out of 5 changed files in this pull request and generated 6 comments.
Show a summary per file
| File | Description |
|---|---|
| arrow_convert/src/features/uuid.rs | Implements trait support for UUID type using FixedSizeBinary(16) Arrow representation |
| arrow_convert/src/features/mod.rs | Registers the uuid feature module under conditional compilation |
| arrow_convert/tests/test_uuid.rs | Comprehensive test suite for UUID serialization/deserialization including null handling |
| arrow_convert/Cargo.toml | Adds optional uuid dependency and corresponding feature flag |
| Cargo.toml | Declares uuid 1.18.1 as a workspace dependency |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Default was required for the builder, so I created a thin wrapper on FixedSizeBinaryBuilder adding Default trait on it
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Copilot reviewed 6 out of 6 changed files in this pull request and generated 5 comments.
Comments suppressed due to low confidence (1)
arrow_convert/Cargo.toml:44
- The
uuiddependency is missing from[dev-dependencies]. Other optional feature dependencies (glam,rust_decimal,tinystr) are included in dev-dependencies to support their respective tests. Adduuid = { workspace = true }to the dev-dependencies section to be consistent with the pattern and ensure tests can run.
[dev-dependencies]
arrow = { workspace = true }
arrow_convert_derive = { workspace = true }
criterion = { workspace = true }
glam = { workspace = true }
pretty_assertions = { workspace = true }
rust_decimal = { workspace = true }
tinystr = { workspace = true }
trybuild = { workspace = true }
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Copilot reviewed 5 out of 5 changed files in this pull request and generated 1 comment.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Reference: https://arrow.apache.org/docs/format/CanonicalExtensions.html#uuid
Rely on FixedSizeBinary(16) as the arrow format as mentionned in the spec