Pulsar - Spark adapter for scala 2.11

[aditiwari01]

The pulsar-spark adapter available seems to be using spark-streaming-2_10.
Is there any plan for adapter for spark_2_11?

[eolivelli]

There is no much activity on the Spark adapter.

Would you like to send a patch ?

[aditiwari01]

I'm exploring options as of now. If I end up writing a patch, would definitely send it.

[aditiwari01]

The current available spark pulsar adapter seems to be unreliable. I've written a reliable connector with addition consideration for back-pressure and rate limit. Currently testing around it. Can raise a PR if that's fine.

[eolivelli]

Can raise a PR if that's fine

Sure! thanks

[aditiwari01]

@eolivelli
I have raised a PR with a new receiver. I'm yet to add examples/documentation for the same, but would appreciate if you can go through it and provide the review.

[aditiwari01]

Also can you approve running workflows so I can check if there are any issues.

[aditiwari01]

@eolivelli Need a small help. In local I've been building with skip License. Flow is failing because of
Some files do not have the expected license header

How can I add license to the new files that I have added?

[michaeljmarshall]

@aditiwari01 - try running mvn initialize license:format from the base directory of the project. Let me know if that doesn't work.