Skip to content

optimizing jj -l @this #31

@pkoppstein

Description

@pkoppstein

I've successfully used jj to "splat" a very large top-level by running:

jj -l @this

This is very fast but consumes a large amount of memory: for my 1GB file, it requires 5GB RAM, even though each top-level array item is very small.

I was wondering whether there is another way to "splat" a top-level array that would (ignoring overhead) essentially require only as much memory as the largest item in the array, while still being reasonably fast.

If not, could the presence of the -l flag be taken into account when optimizing the use of memory?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions