Well first of all, i would have said the same thing with admin on the server or not.
I don't remember this talk, but i have no doubt i could have said that. However, i am not into trashtalking anyone for pleasure, so i bet there were a very good reason. I mean, what's wrong to say you were a bad team player if it was indeed the case ?

Maybe you should be able to take certain remarks without necessarily using your admin rights over other people.