Light a candle. A candle/candles can produce a lot of heat, just be mindful of where they are placed and do not leave them unattended. A trip to most any grocery store or discount store can provide you with a number of candles cheap!
Use a candle heater. It doesn't create as much heat as a fireplace or real heater, but will create warmth very cheaply.