Why aren't straight men more open-minded to dating their own sex other then just women?

It's not being prejudice, it's just saying something about themselves. It's not like they're saying "I hate gays" THAT would be prejudice. How do you know that you're not attracted to someone ugly or doesn't have the best, maybe even the worst, personality? The same concept goes for STRAIGHT men not wanting to date their own sex.