feat(runtime): formats and documents #8
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add TextExtractor trait for native text extraction from documents - extract_text() returns ExtractedText with raw, by-page, by-region text - extract_text_for_page() for single page extraction - needs_ocr() heuristic check for scanned documents - Add TableExtractor trait for table extraction and normalization - extract_tables() returns Vec<NormalizedTable> - NormalizedTable, NormalizedRow, NormalizedCell types - CellDataType inference (Text, Number, Date, Boolean, Formula, Empty) - Add prelude.rs to nvisy-archive crate - Refactor nvisy-core: - ContentData now supports Bytes or HipStr via ContentBytes enum - Content struct wraps ContentData + optional ContentMetadata - Remove from_file_extension/common_extensions from ContentKind - Move extension-to-kind mapping to nvisy-archive - Add runtime documentation: - docs/README.md - overview and crate structure - docs/PIPELINE.md - processing stages with pseudocode - docs/DATATYPES.md - core data structures
…l files - Add nvisy-image stub crate with ImageDocument and ImageFormat - Add dynamic FormatRegistry with type erasure for runtime format selection - Split nvisy-text structured formats into separate modules (xml, yaml, toml, ini) - Use csv 1.4 crate for CSV parsing - Use markdown 1.0 crate for Markdown parsing - Remove write operations from nvisy-document (operation module) - Reformat all Cargo.toml files with grouped dependencies and comments - Standardize package section format across all crates
martsokha
added
feat
- Remove nvisy-document error module, re-export from nvisy-core - Add load_file method to DocumentFormat trait - Use data.as_string()? instead of String::from_utf8_lossy in nvisy-text - Split ImageFormat into JpegFormat and PngFormat - Register image formats in nvisy-engine
- Rename all crate packages to avoid conflicts with consumer library - Update all Cargo.toml dependencies and features - Update all source file imports (nvisy_* -> nvisy_rt_*) - Update README doc examples with new crate names - Fix clippy lints and doc warnings - Add diff module with Differ trait, Change, ChangeKind, RegionChange, Diff types
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.