feat(benchmarking): added bugs to QA benchmarking [FOU-83] #1
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
📋 Summary
This PR introduces a QA Benchmark Seed containing a set of intentional, toggleable bugs for use in QA benchmarking and performance evaluation. These bugs are safe, isolated, and can be enabled/disabled locally via localStorage variables without impacting production.
�� Included Demo Bugs
localStorage.QA_BUG_SKIP_NEW_EVENT_TYPES = '1'localStorage.QA_BUG_VALIDATION_ERROR_PERSISTS = '1'localStorage.QA_BUG_TIMEZONE_NOT_UPDATING = '1'NANA�� Usage
Each bug is documented with:
These can be found in
qa-benchmarks/along withtickets.csv, which lists the bugs as realistic QA tickets with difficulty levels and detailed reproduction steps.🛡️ Safety
📁 Files Modified
apps/web/modules/bookings/views/bookings-listing-view.tsx- New event types filtering bugpackages/features/form-builder/FormBuilderField.tsx- Validation error persistence bugpackages/features/bookings/Booker/components/BookEventForm/BookEventForm.tsx- Form submission prevention bugpackages/features/bookings/Booker/components/EventMeta.tsx- Timezone selector bugqa-benchmarks/README.md- Complete documentation for all bugsqa-benchmarks/tickets.csv- QA tickets with reproduction steps and difficulty levels🎯 Purpose
These bugs serve as:
Each bug simulates real-world issues that QA teams commonly encounter, providing a standardized set of test cases for benchmarking and evaluation purposes.