There are plenty of things you didn't mention that are important. Some basic setup issues, like fred said..sag for one.
My point is a particular failure that, if I understand your description, was exactly the case with my bike.
It turned out to be the bottom bearing on the steering stem. The bars moved without a hitch I could feel, didn't bind anywhere. BUT, taking off the bars, the wheel and the top clamp..THEN I could feel the bearing tick.
Just greasing it up while waiting for a part helped a lot. After replacement of the bearing, the bike was COMPLETELY different front-end wise.