You can change the selection mode from Task with Assignments to Task, which will then only select the Tasks and not the assigned Resources -