Update deltalake requirement from 0.17.3 to 0.18.1

[dependabot]

Updates the requirements on deltalake to permit the latest version.

Release notes

Sourced from deltalake's releases.

rust-v0.17.3

rust-v0.17.3 (2024-05-01)

Full Changelog

Implemented enhancements:

• Limit concurrent ObjectStore access to avoid resource limitations in constrained environments #2457
• How to get a DataFrame in Rust? #2404
• Allow checkpoint creation when partion column is "timestampNtz " #2381
• is there a way to make writing timestamp_ntz optional #2339
• Update arrow dependency #2328
• Release GIL in deltalake.write_deltalake #2234
• Unable to retrieve custom metadata from tables in rust #2153
• Refactor commit interface to be a Builder #2131

Fixed bugs:

• Handle rate limiting during write contention #2451
• regression : delta.logRetentionDuration don't seems to be respected #2447
• Issue writing to mounted storage in AKS using delta-rs library #2445
• TableMerger - when_matched_delete() fails when Column names contain special characters #2438
• Generic DeltaTable error: External error: Arrow error: Invalid argument error: arguments need to have the same data type - while merge data in to delta table #2423
• Merge on predicate throw error on date colum: Unable to convert expression to string #2420
• Writing Tables with Append mode errors if the schema metadata is different #2419
• Logstore issues on AWS Lambda #2410
• Datafusion timestamp type doesn't respect delta lake schema #2408
• Compacting produces smaller row groups than expected #2386
• ValueError: Partition value cannot be parsed from string. #2380
• Very slow s3 connection after 0.16.1 #2377
• Merge update+insert truncates a delta table if the table is big enough #2362
• Do not add readerFeatures or writerFeatures keys under checkpoint files if minReaderVersion or minWriterVersion do not satisfy the requirements #2360
• Create empty table failed on rust engine #2354
• Getting error message when running in lambda: message: "Too many open files" #2353
• Temporary files filling up _delta_log folder - increasing table load time #2351
• compact fails with merged schemas #2347
• Cannot merge into table partitioned by date type column on 0.16.3 #2344
• Merge breaks using logical datatype decimal128 #2343
• Decimal types are not checked against max precision/scale at table creation #2331
• Merge update+insert truncates a delta table #2320
• Extract add.stats_parsed with wrong type #2312
• Process fails without error message when executing merge #2310
• delta_rs don't seems to respect the row group size #2309
• Auth error when running inside VS Code #2306
• Unable to read deltatables with binary columns: Binary is not supported by JSON #2302
• Schema evolution not coercing with Large arrow types #2298
• Panic in deltalake_core::kernel::snapshot::log_segment::list_log_files_with_checkpoint::{{closure}} #2290
• Checkpoint does not preserve reader and writer features for the table protocol. #2288
• Z-Order with larger dataset resulting in memory error #2284

... (truncated)

Changelog

Sourced from deltalake's changelog.

rust-v0.17.3 (2024-05-01)

Full Changelog

Implemented enhancements:

• Limit concurrent ObjectStore access to avoid resource limitations in constrained environments #2457
• How to get a DataFrame in Rust? #2404
• Allow checkpoint creation when partion column is "timestampNtz " #2381
• is there a way to make writing timestamp_ntz optional #2339
• Update arrow dependency #2328
• Release GIL in deltalake.write_deltalake #2234
• Unable to retrieve custom metadata from tables in rust #2153
• Refactor commit interface to be a Builder #2131

Fixed bugs:

• Handle rate limiting during write contention #2451
• regression : delta.logRetentionDuration don't seems to be respected #2447
• Issue writing to mounted storage in AKS using delta-rs library #2445
• TableMerger - when_matched_delete() fails when Column names contain special characters #2438
• Generic DeltaTable error: External error: Arrow error: Invalid argument error: arguments need to have the same data type - while merge data in to delta table #2423
• Merge on predicate throw error on date colum: Unable to convert expression to string #2420
• Writing Tables with Append mode errors if the schema metadata is different #2419
• Logstore issues on AWS Lambda #2410
• Datafusion timestamp type doesn't respect delta lake schema #2408
• Compacting produces smaller row groups than expected #2386
• ValueError: Partition value cannot be parsed from string. #2380
• Very slow s3 connection after 0.16.1 #2377
• Merge update+insert truncates a delta table if the table is big enough #2362
• Do not add readerFeatures or writerFeatures keys under checkpoint files if minReaderVersion or minWriterVersion do not satisfy the requirements #2360
• Create empty table failed on rust engine #2354
• Getting error message when running in lambda: message: "Too many open files" #2353
• Temporary files filling up _delta_log folder - increasing table load time #2351
• compact fails with merged schemas #2347
• Cannot merge into table partitioned by date type column on 0.16.3 #2344
• Merge breaks using logical datatype decimal128 #2343
• Decimal types are not checked against max precision/scale at table creation #2331
• Merge update+insert truncates a delta table #2320
• Extract add.stats_parsed with wrong type #2312
• Process fails without error message when executing merge #2310
• delta_rs don't seems to respect the row group size #2309
• Auth error when running inside VS Code #2306
• Unable to read deltatables with binary columns: Binary is not supported by JSON #2302
• Schema evolution not coercing with Large arrow types #2298
• Panic in deltalake_core::kernel::snapshot::log_segment::list_log_files_with_checkpoint::{{closure}} #2290
• Checkpoint does not preserve reader and writer features for the table protocol. #2288
• Z-Order with larger dataset resulting in memory error #2284
• Successful writes return error when using concurrent writers #2279
• Rust writer should raise when decimal types are incompatible (currently writers and puts table in invalid state) #2275

... (truncated)

Commits

• See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #60.