The Pan Drag tool should work like this:
Hold down the button (don't let go) and it will Drag the area, until button is released. If you do a quick button (single) click and release, it will hold onto the pan, until clicked again. If you give it 2 (two…