Hilchos Lashon Hara, chapter 3, section 3

The prohibition of lashon hara applies even if does is not speaking out of hatred and has no intent to denigrate him, but is speaking in jest and levity. Even so, because what he is saying is derogatory, it is forbidden by the Torah.