When we open a new backport PR the actions are not run on that PR. This is because the PR is opened by the github-actions bot.
I believe the fix for this is to not use the default GITHUB_TOKEN when creating the PR and instead using a PAT from a user.