This happens when your parts aren't perfectly aligned...

Zoom in on the front view and make sure the bottoms match in height (snap on to the other), then zoom in top view and make sure your "circles" align. (again, snap one to the other)
Then the Boolean union works.

Example attached (curves hidden, unhide if you want to see the sweep curves)