Jelly support

[MadsHolten]

The binary RDF serialisation format Jelly and Oxigraph to me seems like a match made in heaven.

The particular use case I have in mind is the possibility of stream loading RDF directly from cloud storage to an Oxigraph instance on the client. In their paper they write "We switched over the communication to Jelly
streams over HTTP, which reduced the time to retrieve 60,000 nanopubs from the server from over an
hour to less than 4 seconds."¹ which clearly demonstrates the potential.

It seems like they are currently working on a Rust implementation so maybe it will soon be a straight-forward task 🤞

[Ostrzyciel]

Hi! Jelly maintainer here. Thanks for the kind words!

The Rust implementation is currently community-led, so you (and anybody else) are very welcome to contribute to it. The lead community developer is @ajuvercr

The implementation is still largely experimental, but parsing works and there is 100% coverage of conformance tests. :) The parsing code is generic and should be possible to integrate with any RDF library. There is an integration with the sophia library, so you would need a similar one for oxigraph. I made an issue for that: Jelly-RDF/jelly_rs#10

Let me know if there is any commercial interest in this – we can supercharge the effort to implement this integration.

---

Note on performance: in the scenario you quoted, a large part of the speed improvement came from simply merging many small files into one binary stream – this is something that Jelly can also do. It let us skip the overhead of repeated HTTP requests. If you are making a more "apples-to-apples" comparison – say, compare parsing a 10GB N-Triples file with its equivalent in Jelly, the speedup is only around 12x.

See our benchmarks: https://jelly-rdf.github.io/dev/performance/#flat-streaming-deserialization-throughput

[MadsHolten]

I would love to contribute but unfortunately, I don't code Rust. Perhaps I can help with the JavaScript bindings but this is a pretty automated task as I understand it.

Thanks for the clarification on the performance gains!