Ah - I see the issue. I prefer to have preferences set to:
Multiple selection = only with Shift key

Ctrl drag doesn't seem work with that set.

Can it be made to work in that circumstance?