Eric,
You might try the (bucket of water/board with a towel wrapped around it) method close to the wine, especially if the wine area can be somewhat isolated. If you don't plan to build the cellar soon (and appearance isn't an issue) you could tack up some plastic film with a minimum of framing. Places that sell construction supplies have plastic film zipper doors that can be included for access.
http://www.growerssolution.com/page/GS/PROD/gc/ZipUp It also look like some hardware stores carry them, too.
One very cold/dry winter I had to put a humidifier in the cellar for a few weeks to assist the built-in regulator. This past (humid) summer, the humidity got a bit high (70%) for a month or so. I doubt that hurt the wine, but it was pretty unpleasant in there - clammy and the fabric arms of the office chair I use stayed unpleasantly damp.
When it gets really cold 50% in the house will cause condensation on the windows (and in places where you CAN'T see it) and maybe be a problem (mold, dry rot, etc.). Houses in cold locations do better at 35-40%. Much less and you get wood splitting and colds that last forever; much more and you get condensation. Windows are a good indicator: condensation, dial it down; no condensation, try dialing up a bit. You will eventually find the proper humidity for each range of outside temps - keep notes so you don't have to experiment the next winter. Changing humidity can take a while, as all the wood, plaster, fabric and the like take time to change their moisture content. Since it is so slow to change, you don't have to be tweaking it every day or even every week. Once a month take a guess at the likely outside temps to come and check your notes to pick a humidity setting.