sync with open source how #118
Draft
+935,668
−268,800
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Fix TestStream so kv coder is preserved. Put keyBytes into TestStream elements. * Fix a bug when panic in watermark eval goroutine not triggering job failure * Minor fix. * Sickbay some failed tests for later investigation.
Fix python postcommit
* ml module setup * openai handler, remoteinference impl * prompt, example pipeline * output format and comments * add license header * batching and structured outputs * unit test and handler IT * api docs * api docs * retries * refactor inference module * handle json string * module comments * comments * update beam/build.gradle * commit * fix workflow * fix openai dependencies * update dependencies
* Update Python Dependencies * Python postcommit --------- Co-authored-by: damccorm <actions@main-runner-frrkx-t5bq7.local> Co-authored-by: Danny Mccormick <dannymccormick@google.com>
Bumps [jws](https://github.com/brianloveswords/node-jws) from 4.0.0 to 4.0.1. - [Release notes](https://github.com/brianloveswords/node-jws/releases) - [Changelog](https://github.com/auth0/node-jws/blob/master/CHANGELOG.md) - [Commits](auth0/node-jws@v4.0.0...v4.0.1) --- updated-dependencies: - dependency-name: jws dependency-version: 4.0.1 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Support Vertex Flex API in GeminiModelHandler * Fix lint errors. * Fix lint. * Import the correct HttpOptions * Fix the unit test so it runs successfully. * Fix lint again.
* Fix too-many-pings on FnAPI runner under grpc mode * Fix lints
* Update spanner client version. * Edit comments with a new issue id.
This reverts commit 84684ae.
…#36271) * Save Logical Type Registry and Coder Registry on cloudpickle save main session fix naming * Track custom_urn set in logical type registry * Fix, add tests * Set save_main_session default to true for cloudpickle and introduce overwrite flag * Fix test; trigger postcommits * Fix test as Dataflow runner submission now staging a main session file
Revert "Reduce weighing overhead for caching blocks"
Undo #35962 and move from distutils to setuptools instead
* Make a copy of GcsUtil.java as GcsUtilLegacy.java * Change references from GcsUtil to GcsUtilLegacy in GcsUtilLegacy.java * Change public apis in GcsUtil.java to call the GcsUtilLegacy.java * Add mocking GcsUtilLegacy for tests and remove unnecessary references of gcsio in GcsUtil * Possible breaking change: removed unused public functions. * Get rid of the last bit (read option) gcsio references in GcsUtil.java. * Route the code path of open reading files to include api count metric. * Spotless check * Remove BatchInterface and RewriteOp from GcsUtil.java. Simplify some functions. * Rename GcsUtilLegacy to GcsUtilV1 * Make GcsUtilV1 package private * Import ExperimentalOptions * Move GcsReadOptionsFactory from GcsUtilV1 to GcsOptions * Fix a failed test * Add comments to SupressWarnings * Fix test
* remove ReadWrite PubsubLite Yaml * add back pubsub oops * and the configuration
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.21 to 4.17.23. - [Release notes](https://github.com/lodash/lodash/releases) - [Commits](lodash/lodash@4.17.21...4.17.23) --- updated-dependencies: - dependency-name: lodash dependency-version: 4.17.23 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…xamples/inference/large_language_modeling (#37394) * Bump sentencepiece Bumps [sentencepiece](https://github.com/google/sentencepiece) from 0.1.97 to 0.2.1. - [Release notes](https://github.com/google/sentencepiece/releases) - [Commits](google/sentencepiece@v0.1.97...v0.2.1) --- updated-dependencies: - dependency-name: sentencepiece dependency-version: 0.2.1 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update requirements.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>
* Update bom to 26.74.0 (excluding spanner) * remove explicit sm dep
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.58.0 to 1.59.1. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@spanner/v1.58.0...storage/v1.59.1) --- updated-dependencies: - dependency-name: cloud.google.com/go/storage dependency-version: 1.59.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
This PR adds documentation and examples for using calcite_connection_properties in YAML SQL transforms. This enables users to use dialect-specific SQL functions such as PostgreSQL's INITCAP and STRING_TO_ARRAY functions. Changes: - Add new example file: sql/sql_calcite_connection_properties.yaml showing how to configure PostgreSQL functions in YAML SQL queries - Add test case in tests/sql.yaml to verify calcite_connection_properties works with PostgreSQL functions Fixes #36614
* Install yarn via corepack * Add corepack home dir
- Add filter() method following same pattern as map() and flatMap() - Add 5 test cases covering various filtering scenarios - Support optional context parameter for side inputs
* Fixed failures in Python PreCommit tests * Remove explicit runner parameter * Removed Python 3.13 special case for bundle timeout
* Simplify encoding kw_only args and test init=False args. 1. Replace the helper function for determining whether to use kw_only with a simpler to follow condition. 2. Add test coverage for the init=False case. * Fix pre-commit.
#36667) the change stream partition mode For MUTABLE_KEY_RANGE change stream, use read_proto_bytes_, else use read_json_
… for portable SchemaCoders.
Bumps [python-multipart](https://github.com/Kludex/python-multipart) from 0.0.21 to 0.0.22. - [Release notes](https://github.com/Kludex/python-multipart/releases) - [Changelog](https://github.com/Kludex/python-multipart/blob/master/CHANGELOG.md) - [Commits](Kludex/python-multipart@0.0.21...0.0.22) --- updated-dependencies: - dependency-name: python-multipart dependency-version: 0.0.22 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Enable some tests in runner v2 batch mode. * Skip the failed tests after re-enabling some categories.
… only claim timestamps that have been fully processed from the restriction tracker. (#37326)
* Update yaml colab notebook * add runners * remove old copy * update yaml version * change to master * fix error in patch and update yaml example * correct path
…#37439) Bumps [github.com/nats-io/nats-server/v2](https://github.com/nats-io/nats-server) from 2.12.3 to 2.12.4. - [Release notes](https://github.com/nats-io/nats-server/releases) - [Commits](nats-io/nats-server@v2.12.3...v2.12.4) --- updated-dependencies: - dependency-name: github.com/nats-io/nats-server/v2 dependency-version: 2.12.4 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, commentfixes #<ISSUE NUMBER>instead.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.