Summer Function - Room temp lower than ambient

I have a room where I am trying to compare two materials on a given day using the Summer function. The issue I'm having is that beyond a certain amount of fresh air changes, the room temp is lower than the ambient temperature. The room with materials with less time lag exhibits this effect more so than the other.

Any suggestions as to why this is happening?
Thanks.