Well, if it helps, think of it this way: a person with a PhD is just like anyone else who's successfully completed grad school, only with a slightly more rigorous and specialized course of study.
I wouldn't say that you're being a wimp, but you'll probably feel better once you appreciate that the professor is an ordinary human being, same as you. Just follow standard dating protocol, keep it discrete, and you'll be fine.