Last Friday my boyfriend was out late, past 1am, do I have a right to be mad and breakup?

We don't live together and don't have any kids together, but I am upset that he went out without telling me. I still don't know where he was, whenever I ask him where he was he avoids answering directly and says that I always act controlling about his whereabouts.