Nerd rage ITT.

Don't listen to these assholes, OP. It's not your fault you couldn't bring yourself to get rid of him sooner, and if he gets all emo over it that's his problem - you don't owe him anything. However, it'll be worse the longer you leave it, so just break up with him quick, like ripping off a bandage.