Well, I tried it here quickly ... much like your picture.

Box
Small box
mirror
boolean diff

It worked as expected. Not like yours.

I did not save the file ...

???
cheers,
eric