I was out there last weekend. I don't know if it was too cold for everyone, but the crowd wasn't bad at all. Even when it gets really busy there, most people just ride around by the lakebed and leave the rest of the place to us!
Ive been out their the last three weekends and I have to agree, most everyone is on the lakebed or nearby that area. Take the west or east trail and you wont see hardly a sole. Outside of the wind which you normally get before a storm the riding is great.