In general Click something (Point (not control pts), segment (edge), surface will select only this nature selected with your general selection!

Use also the Type Selector Browser!