Skip to content

Allow custom s3 endpoint_url for use with boto3[crt]#4643

Open
masudio wants to merge 2 commits intoboto:developfrom
masudio:bettercrtforprivates3
Open

Allow custom s3 endpoint_url for use with boto3[crt]#4643
masudio wants to merge 2 commits intoboto:developfrom
masudio:bettercrtforprivates3

Conversation

@masudio
Copy link

@masudio masudio commented Oct 22, 2025

Description

The tl;dr is that boto3 has an option to use a faster underlying package called CRT (Common RunTime) for far greater S3 throughput. However, the integration with the underlying library is not complete for custom S3 endpoints (e.g. a company hosts an internal S3 API).

In addition, there is a bug this diff fixes where 'compare_identity' function doesn't treat "" and None as equal - this also prevents users from using CRT with boto3 with a custom endpoint_url.

More concretely, this particular diff does these pieces:

  • change to let crt request serializer factory method use a custom endpoint_url
  • there’s a bug in an equality comparison where “” == None needs to evaluate to true in context of credential providers

Testing

Added unit tests to cover the changes.

meisamrezapuran02-collab referenced this pull request Oct 23, 2025
Available since Python 3.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments