Close all of your windows properly. This includes making sure storm windows are installed and closed in place if you have them. Windows should be latched. Open them during the day if the outside temperature is higher than the inside temperature.
Keep your windows air-tight. You may want to purchase removable window-caulk or plastic to better seal them. At a minimum, stuff a towel or shirt in front of any noticeable leaks.