You may just need to use a very small radius as a fillet can sometimes consume surprisingly large areas of a part where faces meet at less than 90 degrees to each other, as per your picture close to the two outer holes.


Martin.