The issue arose with version 2.2.0 (with Neos UI 8.3.16 / Neos 8.3.28). The applied block style would not be detected by the toolbar dropdown menu and therefore it's impossible to remove an existing format.