Example of two PRs running the Release job at the same time, resulting in a conflict (failed push) for one of them:
We currently use https://github.com/softprops/turnstyle for this use case, but that apparently did not successfully block in that case. We should investigate.
Github has now a way to control concurrency on a job or workflow level but this misses a crucial feature for our use case discussed here