Is there a way to prevent Microstation ss10 from loading a reference file when it is not active

We are like many and working form home. With limited bandwidth between the office and our home based workstations there have been quite a few challenges. One of them is dealing with projects that have quite a few references (both dgn and dwg). We noticed that even though the references are not turned on, the progress bar shows them being loaded in the background. This takes a long time. I can't seem to find a way to prevent this from happening without just detaching the file. Since we are wanting to turn off the file just to make changing files less time consuming.