Passing Judgment Quotes

When one says, I won't judge you for that, what they're really saying is, I am judging you for that. Think about it. If you walk into my house and I tell you, "I won't judge you for wearing those pants," what am I really saying?