Fixes and cleanup script

[coffandro]

This PR:

• Fixes Webui ID gen bug found in Added Professional LAB Brand #127
• Fixes update profiles edge case bug found in Added Professional LAB Brand #127
• Removes a temp script from our previous schema migration
• Adds functionality which auto sorts our data
• Adds a way to see validation errors in the WebUI

Fixes (vault) #111

[Copilot]

Pull request overview

This pull request addresses several bugs and adds significant new functionality to the Open Filament Database project. It fixes a WebUI ID generation bug, resolves an edge case in the update profiles workflow, removes a temporary migration script, implements automatic data sorting, and adds a comprehensive validation feedback system to the WebUI.

Changes:

• Fixed ID generation bug in WebUI by adding hyphen and space replacement logic
• Added conditional checks to prevent update_profiles workflow from running on pull requests
• Removed temporary migrate_schema.py script after schema migration completion
• Implemented sort_data.py script with progress reporting and validation integration
• Added validation and sort API endpoints with SSE streaming for real-time progress updates
• Created comprehensive UI components for validation feedback and data sorting
• Enhanced data_validator.py with JSON output and progress modes for WebUI integration
• Updated extensive documentation across multiple guide files

Reviewed changes

Copilot reviewed 36 out of 36 changed files in this pull request and generated 11 comments.

Show a summary per file

File	Description
webui/src/lib/globalHelpers.ts	Fixed ID generation with additional character replacements (contains bug)
.github/workflows/update_profiles.yaml	Added condition to prevent running on PRs
scripts/migrate_schema.py	Removed temporary schema migration script
scripts/sort_data.py	New comprehensive data sorting script with schema-based key ordering
webui/src/routes/api/validate/+server.ts	New validation API endpoint with job management
webui/src/routes/api/sort/+server.ts	New sort API endpoint with job management
webui/src/routes/api/validate/stream/[jobId]/+server.ts	SSE streaming endpoint for validation progress
webui/src/routes/api/sort/stream/[jobId]/+server.ts	SSE streaming endpoint for sort progress
webui/src/lib/server/jobManager.ts	Job tracking system with automatic cleanup
webui/src/lib/hooks/useSSE.ts	SSE client hook for real-time updates
webui/src/lib/stores/validationStore.ts	Validation state management store
webui/src/lib/utils/pathToRoute.ts	Path-to-route conversion for navigation
webui/src/lib/components/ValidationTriggerButton.svelte	Validation trigger UI component
webui/src/lib/components/ValidationProgressModal.svelte	Progress modal for long-running operations
webui/src/lib/components/ValidationDropdown.svelte	Validation errors dropdown display
webui/src/lib/components/SortDataButton.svelte	Sort data trigger UI component
webui/src/routes/+layout.svelte	Layout updated with validation and sort controls
data_validator.py	Enhanced with JSON output and progress reporting
docs/webui.md	Comprehensive documentation of validation and sorting features
docs/validation.md	Updated validation guide with WebUI and CLI instructions
docs/pull-requesting.md	Updated PR guide emphasizing validation and sorting
docs/manual.md	Improved manual contribution guide
docs/installing-software.md	Minor documentation improvements
docs/forking.md	Enhanced forking instructions
docs/cloning.md	Improved cloning guide
README.md	Updated with validation and sorting workflow

[Copilot]

Pull request overview

Copilot reviewed 36 out of 36 changed files in this pull request and generated 7 comments.