Among all the other good ideas here the only one I would add right off is discovering cardboard as insulation. Maybe not the best, but it's free, easily replaced, and easy to cut and work with. In particular, cutting pieces to fit over unnecessary, west and north facing windows in the winter. I made panels of 3-5 thicknesses, duct taped together on the edges, just the right size to press into the window wells from the outside, with a couple of pieces of wood jammed into place to help hold them. The windows are enough under the overhang to keep the cardboard from getting wet except in the worst storms, and wow the difference it made in those rooms. I wish they were easier to place and remove and I'd be tempted to see if they help in summer heatwaves as well. In comparison this seems to help even more than taping plastic up on the inside, although this does continue to let light in.