Husband cheated with men for 6 years and I took him back? Is it too late?

Gay, bi...doesn't matter, really; either way, he's got serious issues, and is apparently uninterested in dealing with them. (Maybe he's fixated on other guys' interest in you because he's restraining himself from chasing after them? Again, not that it makes much of a difference: the point is, this is not how marriage should operate.) You're not obligated to explain anything to his family, no matter how much they "come after you" or what he claims the "real" reason is. And you're not obligated to safeguard his fragile emotional stability, either. But you do need to take care of yourself and your mental health, and it doesn't sound to me like you can do that in this relationship.