Currently, the library makes a lot of extra allocations. We should avoid these more and set up benchmarks to safeguard that.