Skip to content

Suggestion: Add Threaded read-ahead decompression #34

@kcgen

Description

@kcgen

Threaded read-ahead decompression

  • Threaded, so latency isn't added to the current requested read block.
  • The Read-ahead thread should wait until the requested block is returned to avoid competing for IO simultaneously versus the current request.
  • If a requested location already exists in the decoded read-ahead blocks, then it's returned immediately and any new delta read-ahead block are decoded to the cache.
  • Read-ahead distance in KiB is configurable via API (which gets converted to N compressed blocks internally).
  • If -1 is passed in for the read-ahead distance, then the read-ahead thread will keep going until it decodes the last block (only pausing to yield to current requests to avoid contention), likewise the read-ahead memory cache will expand to hold all decoded blocks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions