So, you know how all Kasanoda’s men think he’s gay because he has to keep Haruhi’s gender secret?
Well in the manga, his men become a “Young Master’s Road-To-Romance Support Group”, where they try and get him a boyfriend.
So I imagine if he ever brought any male friend home, they’d be all.
"Only the best for young master"
And then would accidentally put off any potential friends.