Seems your frame rectangle has some internal intricated complex forms :)
So filet can't follow the entiere curves!
From your existing frame you can make that Select all "up surface facetts" / delete it / Select all / Make planar / Now select the new "facett up"/ Filet works :)