I did some more testing, it has to do with the angle between the spiral end and the straight line.

helix axis is 10mm, desired fillet is 2mm.