Focus switching to Accudraw distance lock after pan drag - how to disable?

Hi all,

Whenever I use middle mouse hold (pan drag command), focus immediately switches to Accudraw distance lock, meaning I have to hit ESC to deselect it to use shortcut keys. It's infuriating and slowing me down quite a lot.

How can I disable this behaviour so that I can pan drag and immediately use shortcut keys?

Thanks!