test-runner: fix rerun ambiguous test failures #2287

Job	Run time
Build slim tarball	1m 37s
x86_64-linux: with shared libraries	26m 47s
x86_64-darwin: with shared libraries	40m 5s
aarch64-linux: with shared libraries	21m 59s
aarch64-darwin: with shared libraries	22m 43s
	1h 53m 11s

Provide feedback