The speed is relatively slow despite its low MACs.

[ccx1997]

We have tried FocalNet in our recognition task, but found it slower than ViT obviously, though it cost much less card memory.
Have you found the same problem? I guess it is because the inner detailed operations are not paralleled well.