That's what I do, usually make water late at night... And store a 5 gallon jug of RO water for top offs inside the house house on the floor.... If I am going to change water and it's too warm, i pop in a couple frozen bottles of water.. It works fast to bring the temp down....