Skip to content

Conversation

@t0mdavid-m
Copy link
Member

@t0mdavid-m t0mdavid-m commented Dec 10, 2024

This PR adds a caching solution to the template. Files/Data can be stored using a simple interface (store_file/store_data). Cached data is written to disk and kept track of using a sqlite3 database. Files are stored in a central location and their path is stored as a reference. Python objects are pickled and gzipped, with the exception of dataframes, which are written to parquet.

ToDos:

  • Avoid troubles while pickling the FileManager under windows
  • Add File Manager Page
  • Complete Documentation
  • Check if the complete file manager can be moved to this solution without breaking backwards compatibility

@t0mdavid-m
Copy link
Member Author

@Arslan-Siraj

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants