Just be frank about it. Problems pile up when you refuse to assume your feelings. So just let him know that you are not interested anymore. There is no reason for a bad break up, or to fight, if you stick to your position. Do not make recriminations, but give him some explanation, if he wants some. Otherwise he may keep pressing you.