CE / How do you stop loading heavy references files ?

File opening can be very long when you have big references files attached.

Is there a way to bypass the loading of the reference files, or better, delay it ?  (a SKIP button in the loading screen could be nice).

I know you can avoid all reference with a command line parameter but that's not what i need. I want the files to be attached but not loaded at startup.