Nope. You should be fine! I just got one yesterday on Christmas Eve as a Christmas Present! Its been raining like hell so besides revving it in the garage, I really haven't done any riding, but today is looking good, so I'll get some of the break in period of the bike complete :)
The size of the bike is perfect for me and I am maybe an inch or two bigger than you. You should be fine, and you could always adjust the suspension if you think its too big.