Wow!!!
Which dealership is that? PM me.
I assume you haven't signed any papers and therefore you were under no obligation to buy. Even then, you have the 3 days cooling off period. The manager shouldn't have abused you. That's very unprofessional.
I would take it up to his superiors, at least. Not to get something out of it, but sometimes people need to learn a lesson.