Upstream master 2023-12-21 #3

badaiaqrandista · 2023-12-19T23:31:23Z

Rebase to openmessaging/benchmark master branch as of 2023-12-21

* Load balance topics on RabbitMQ nodes * Replace isOpen() checks by catching AlreadyClosedException

… script (openmessaging#246) * [Pulsar] Fix available zone not configured and clean up the terraform script * Fix wrong output of zookeeper instances

* Support configuring protocol handlers and many other options * Fix deployment failure for RedHat 8 * Fix protocol handlers not loaded * Adjust the extra_vars.yaml * Use the original name of deloy.yaml * Add document for skip_journal * Update README * Support configuring max heap/direct memory

…ssaging#259) * Update gRPC version for Pravega 0.12. Signed-off-by: Andrey Koltsov <a99920641@gmail.com> * Add comment @ pom.xml Signed-off-by: AndreyKoltsov1997 <a99920641@gmail.com>

* update git repository address * Cannot create topic with partitions in RabbitMQ, so use 1 partition for rabbitmq

Bumps [jackson-databind](https://github.com/FasterXML/jackson) from 2.9.10.8 to 2.12.6.1. - [Release notes](https://github.com/FasterXML/jackson/releases) - [Commits](https://github.com/FasterXML/jackson/commits) --- updated-dependencies: - dependency-name: com.fasterxml.jackson.core:jackson-databind dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…openmessaging#259)" (openmessaging#264) This reverts commit 800e1af.

…: NoClassDefFoundError (openmessaging#266) Co-authored-by: zhangjidi2016 <zhangjidi@cmss.chinamobile.com>

…g#269) Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>

…#276)

…enmessaging#282) * Fix license check and modify configurations for multi topics test * Update driver-pulsar/pom.xml Co-authored-by: Matteo Merli <mmerli@apache.org>

…messaging#277) * Fixing infinite loop waiting for consumers to be ready * Throw an exception when the timeout is raised when waiting for consumers to be ready

Bumps [jetty-server](https://github.com/eclipse/jetty.project) from 9.4.42.v20210604 to 10.0.10. - [Release notes](https://github.com/eclipse/jetty.project/releases) - [Commits](jetty/jetty.project@jetty-9.4.42.v20210604...jetty-10.0.10) --- updated-dependencies: - dependency-name: org.eclipse.jetty:jetty-server dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps commons-text from 1.9 to 1.10.0. --- updated-dependencies: - dependency-name: org.apache.commons:commons-text dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Configurable pulsar subscription type * End with newline * Reformat pulsar driver * Support shared subscriptions

Restart Rename for consistency

License

Update comment Spotless Pass credentials Remove final Typo

* Resilient resource creation # Conflicts: # benchmark-framework/src/main/java/io/openmessaging/benchmark/worker/LocalWorker.java # driver-api/src/main/java/io/openmessaging/benchmark/driver/BenchmarkDriver.java Resilient resource creation # Conflicts: # benchmark-framework/src/main/java/io/openmessaging/benchmark/worker/LocalWorker.java # driver-api/src/main/java/io/openmessaging/benchmark/driver/BenchmarkDriver.java # driver-rabbitmq/deploy/templates/rabbitmq-quorum.yaml License header Missing import spotless * findbugs exclude

* Pulsar 2.10.2 * More version changes Co-authored-by: Matteo Merli <mmerli@apache.org>

Bumps [testng](https://github.com/cbeust/testng) from 7.6.1 to 7.7.0. - [Release notes](https://github.com/cbeust/testng/releases) - [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt) - [Commits](testng-team/testng@7.6.1...7.7.0) --- updated-dependencies: - dependency-name: org.testng:testng dependency-type: direct:development ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix failed drive-kop tests * Fix format violation

…essaging#376) * exclude artemis netty transitive dependency * lint pom.xml --------- Co-authored-by: sky.kistler <sky.kistler@reddit.com>

* [nats] Add storage type to config so one can test with file or memory stream. * [nats] Add maxBytes to config so one can prevent NATS running out of memory incase the storage type is set to "Memory"

…aging#390)

…nmessaging#392)

…n-plugin:2.25.0:check (check) on project driver-rocketmq: The following files had format violations: [ERROR] src/main/java/io/openmessaging/benchmark/driver/rocketmq/RocketMQBenchmarkDriver.java' (openmessaging#399) Co-authored-by: nuolin <lushiji@xiaohongshu.com>

cla-assistant · 2023-12-19T23:31:42Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 3 committers have signed the CLA.

❌ travisdowns
❌ StevenLuMT
❌ dependabot[bot]
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

cla-assistant · 2023-12-19T23:31:42Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ badaiaqrandista
❌ ConfluentTools
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

* Grow the histogram buffer if it is too small When we serialize a histogram to a byte array, the intermediate ByteBuffer that we pass may be too small which may result in silent truncation of the encoded histogram. This will manifest on the driver side as a decoding failure. This change detects this case and grows the buffer by a factor of 2 until it fits. Fixes openmessaging#369. * Add Histogram deserialization test Add an addition test to the HistogramSerDeTest which tests that histogram deserialization roundtrips even when the serialized size exceeds the initial buffer. * Fixed spotbugs warnings --------- Co-authored-by: Matteo Merli <mmerli@apache.org>

openmessaging#394) Bumps [com.rabbitmq:amqp-client](https://github.com/rabbitmq/rabbitmq-java-client) from 4.8.0 to 5.18.0. - [Release notes](https://github.com/rabbitmq/rabbitmq-java-client/releases) - [Commits](rabbitmq/rabbitmq-java-client@v4.8.0...v5.18.0) --- updated-dependencies: - dependency-name: com.rabbitmq:amqp-client dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

codelipenghui and others added 30 commits January 19, 2022 21:22

Bump Pulsar 2.9.1 and Kafka client 3.0.0 (openmessaging#238)

4a555ea

Set flushEntrylogBytes (openmessaging#240)

3b793a2

Fix missing dash (openmessaging#244)

ddd4b90

Use the latest apache pulsar grafana dashboard (openmessaging#252)

8c116f5

Load balance topics on RabbitMQ nodes (openmessaging#239)

44293d5

* Load balance topics on RabbitMQ nodes * Replace isOpen() checks by catching AlreadyClosedException

Create a benchmark driver for KoP (https://github.com/streamnative/kop)…

73081cf

… (openmessaging#245)

[Pulsar] Fix available zone not configured and clean up the terraform…

380acf7

… script (openmessaging#246) * [Pulsar] Fix available zone not configured and clean up the terraform script * Fix wrong output of zookeeper instances

[Pulsar] Add ansible playbook to restart broker (openmessaging#257)

1701fca

[Pravega Driver] [Draft] Update dependencies for Pravega 0.12 (openme…

800e1af

…ssaging#259) * Update gRPC version for Pravega 0.12. Signed-off-by: Andrey Koltsov <a99920641@gmail.com> * Add comment @ pom.xml Signed-off-by: AndreyKoltsov1997 <a99920641@gmail.com>

Fix RabbitMQ docs (openmessaging#255) (openmessaging#256)

0d02d56

* update git repository address * Cannot create topic with partitions in RabbitMQ, so use 1 partition for rabbitmq

Test warmup option (openmessaging#260)

64cc01d

Fixes openmessaging#247 Fix Coordinated Omission (openmessaging#248)

64eff25

Fix copyright (openmessaging#243) (openmessaging#263)

0209bd1

Revert "[Pravega Driver] [Draft] Update dependencies for Pravega 0.12 (…

214e33e

…openmessaging#259)" (openmessaging#264) This reverts commit 800e1af.

[ISSUE openmessaging#265]Fix com/fasterxml/jackson/annotation/JsonKey…

2d5e568

…: NoClassDefFoundError (openmessaging#266) Co-authored-by: zhangjidi2016 <zhangjidi@cmss.chinamobile.com>

[ISSUE openmessaging#268]rocketmq benchmark support acl (openmessagin…

c1200d6

…g#269) Co-authored-by: zhangjidi <zhangjidi@cmss.chinamobile.com>

Switch to RHEL-8 since RHEL-7.4 doesn't work anymore on EC2

4a02411

Simplified JVM GC options

7ec1817

Disabling protocol handlers in ansible

48c31db

Upgrade to Pulsar 2.10.1

0aa74e3

[Pulsar] Specify the NIC speed when deploying brokers

72778d8

Fixed benchmark worker config to work with Java 17

3241915

Use bigger VMs for ZooKeeper deployment

5b8209f

Fixed BK memory settings

7a16bc5

Fixing infinite loop waiting for consumers to be ready (openmessaging…

cca7698

…#276)

Fix license check and modify configurations for multi topics test (op…

31855cd

…enmessaging#282) * Fix license check and modify configurations for multi topics test * Update driver-pulsar/pom.xml Co-authored-by: Matteo Merli <mmerli@apache.org>

[issue openmessaging#275] fix waiting for consumers to be ready (open…

df0d9d3

…messaging#277) * Fixing infinite loop waiting for consumers to be ready * Throw an exception when the timeout is raised when waiting for consumers to be ready

dependabot bot and others added 23 commits October 24, 2022 10:06

Increase buffer sizes (openmessaging#349)

276693b

NATS config changes (openmessaging#348)

1c3eece

Allow deployment of benchmark code in isolation (openmessaging#347)

d707b87

[Feature] Support shared subscriptions (openmessaging#353)

dc4da71

* Configurable pulsar subscription type * End with newline * Reformat pulsar driver * Support shared subscriptions

Convenience ansible (openmessaging#350)

620419d

Restart Rename for consistency

Create and share consumer (openmessaging#356)

1066759

Stream type (openmessaging#357)

7f910c4

Set partition handling behaviour (openmessaging#358)

9cb6764

License

Clients require all broker address to fail over (openmessaging#359)

d04724a

Update comment Spotless Pass credentials Remove final Typo

[Improvement] Pulsar 2.10.2 (openmessaging#354)

ed82764

* Pulsar 2.10.2 * More version changes Co-authored-by: Matteo Merli <mmerli@apache.org>

Pulsar 2.11.0

defa46f

Fix failed drive-kop tests (openmessaging#387)

6a947eb

* Fix failed drive-kop tests * Fix format violation

Bump log4j from 2.17.1 to 2.20.0 (openmessaging#374)

31215cc

Add maven exclusion for netty transitive dependency in artemis (openm…

1c681e9

…essaging#376) * exclude artemis netty transitive dependency * lint pom.xml --------- Co-authored-by: sky.kistler <sky.kistler@reddit.com>

[NATS] Extend to support in-memory stream (openmessaging#370)

b3a9044

* [nats] Add storage type to config so one can test with file or memory stream. * [nats] Add maxBytes to config so one can prevent NATS running out of memory incase the storage type is set to "Memory"

Bumped Jedis to v5.0.0 - fixed breaking changes from v3.7.0 (openmess…

f2a4e8c

…aging#390)

Issue 391: Update Pravega library versions and deployment script (ope…

0a68a61

…nmessaging#392)

update rocketmq engine

71b6ff2

fix codestyle

d0c0277

shriram-sridharan previously approved these changes Dec 19, 2023

View reviewed changes

travisdowns and others added 2 commits December 19, 2023 17:36

badaiaqrandista dismissed shriram-sridharan’s stale review via 13785ca January 2, 2024 06:55

badaiaqrandista force-pushed the upstream-master branch from e0a2201 to 13785ca Compare January 2, 2024 06:55

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Upstream master 2023-12-21 #3

Upstream master 2023-12-21 #3

Uh oh!

badaiaqrandista commented Dec 19, 2023

Uh oh!

cla-assistant bot commented Dec 19, 2023 •

edited

Loading

Uh oh!

cla-assistant bot commented Dec 19, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Upstream master 2023-12-21 #3

Are you sure you want to change the base?

Upstream master 2023-12-21 #3

Uh oh!

Conversation

badaiaqrandista commented Dec 19, 2023

Uh oh!

cla-assistant bot commented Dec 19, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cla-assistant bot commented Dec 19, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

cla-assistant bot commented Dec 19, 2023 •

edited

Loading