I personally go with a thin stocking cap and gloves. Keeping my head & hands warm goes a long way toward keeping the rest of me feeling warm. I typically wear long dry fit tights & a long sleeve dry fit shirt under my normal running clothes (which are also some type of dry fit). By dressing in a couple of layers, I am able remove something if I start to get too warm. I don't suggest bulky clothing (like fleece) or anything made of cotton because it tends to absorb the sweat & then you're out in the cold wearing wet clothing. Brrrrr...
As for the cost of the dry fit, your best bet is probably the Internet at this point in time because winter weather has already begun in a lot of places. What I generally do is buy my running gear "off season". At the end of this winter, I will hit the clearance racks at the local sporting goods & running stores to buy my gear for next winter. In fact, now is a great time to buy anything you think you might need for next summer.