It's not about disagreeing with him. It's him (much like yourself in the past) being WRONG.
His comment suggests bald men are to blame themselves for being socially despised. So yes, it's an ignorant statement.
What a ****ty personality you have, and wonder why people reject you...