Could we use ctrl+alt+click for group drilldown? It's a little bit more complicated, but if it's a less-common action, a combo like that seems fine. Assuming we're already set up for using multiple modifiers on a click, this should be easy, and then folks can customize the keybindings if they care.