Really? I was the same way for several years until I saw the first disc of FMP in English, then started permanently considered both options whenever I started a new series.
Remember, as Chris Patton himself said, both the Japanese and English voice acting is post-lay, so it literally comes down to acting ability.
Oh and just to piss people off:
http://www.ranting-gryphon.com/Rants/2rant-anime.mp3I always make sub purists listen to this guy. :P
P.S. Gauron is the most bitchin villain ever created