You are totally right, OP should ask for exclusivity first, complain later.
If you are annoyed or disturbed that this girl is having sex with some other guy [name it Ex-Boyfriend] you should make your relation something serious. Be the Alpha Male, mark your territory.
... Well, only you are seriously concerned.