Yeah, don't sweat it. Ya know, a lot of married women end up one day finding porn folders or pornsites in the browser's history or (for the elderly amongst us) playboy magazines behind the toilets. Then they act all surprised, disappointed, jealous, start doubting themselves, etc. And it's okay, because that's what women do.
What men do is look at porn. I'm slightly amplifying the thing but that's in order to make a point. Don't fret, he's a guy, that's normal. He also probably already masturbated to you, if that can make it right :p