Pros:
Could be easier to change test fast (anyway it's possible to change files using form)
Possibility to create named tests
No tests in source code of runner.
Cons:
Tons of files for a single task. One should maintain synced state
Work with filesystem