Tested out myself and can replicate the behavior. Can confirm there is no setting for this. Will have to ask development if this is working as designed or if this is a bug. I noticed if I close the reference dialog and reopen it has the ref selected.