My boyfriend is mad at me?

No, you're not doing anything wrong. You're boyfriend is cautious that you don't like him anymore so you should explain it all to him when he cools and isn't so pissed off.