Should I just break up with him?

The way i see it if he has you crying over the fact that you cant get a strait answer i'd save yourself the suffering of waiting and possibly finding out something that you don't want to know