Object with BoxCollider2D seems to block UI interaction

We have a scene that's made of:
1. A UI Button
2. An object with BoxCollider2D (layer: custom).

The canvas is in "World Space".

There's currently only 1 camera in the scene, with a Physics2DRaycaster (set to "Everything).

My problem is that the object with the BoxCollider2D seems to "block" any interaction i want to have with UI objects, even though it is not positioned

See a better explanation in this screenshot:
View attachment 212743

Note that the button is seen on the canvas,...

Object with BoxCollider2D seems to block UI interaction