Skip to content

Conversation

@mrchocha
Copy link

📋 Summary

This PR introduces a QA Benchmark Seed containing a set of intentional, toggleable bugs for use in QA benchmarking and performance evaluation. These bugs are safe, isolated, and can be enabled/disabled locally via localStorage without impacting production.


�� Included Demo Bugs

Bug Name Trigger Flag Scope Description
File Names with Special Characters Display Incorrectly localStorage.QA_BENCHMARK_ENABLE_SPECIAL_CHARACTERS_BUG = '1' Client File names containing emojis or special characters are corrupted in the UI
Upload Progress Bar Shows Incorrect Percentage localStorage.QA_BENCHMARK_ENABLE_PROGRESS_BUG = '1' Client Upload progress bar displays wrong percentage values and jumps between values
Files Uploaded Successfully but Still Show Error Messages localStorage.QA_BENCHMARK_ENABLE_SUCCESS_ERROR_BUG = '1' Client Files are successfully uploaded but still display error messages in the UI
File Preview Crashes if File Name Has Special Characters localStorage.QA_BENCHMARK_ENABLE_PREVIEW_CRASH_BUG = '1' Client File preview shows error popup when trying to preview files with special characters
Shared with Others Tab Doesn't Show Shared Files localStorage.QA_BENCHMARK_ENABLE_SHARED_WITH_OTHERS_BUG = '1' Client Files are shared with others but don't appear in the "shared with others" tab

🔧 Usage

Each bug is documented with:

  • Enable/Disable instructions
  • Reproduction steps
  • Modified files and line numbers
  • Expected incorrect behavior

These can be found in qa-benchmarks/README.MD along with tickets.csv, which lists the bugs as realistic QA tickets.


��️ Safety

  • Bugs are opt-in only (disabled by default)
  • No side effects without explicitly enabling the respective localStorage flags
  • No changes to production behavior unless deliberately toggled
  • All bugs are client-side localStorage flags; no server restart required

@mrchocha mrchocha changed the title feat(benchmarking): added bugs to QA benchmarking feat(benchmarking): added bugs to QA benchmarking [FOU-81] Aug 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants