No, we really don’t care what someone’s temptations are. But we care deeply about apostasy. When you define yourself by your temptations and, rather than wanting to be a faithful member overcoming temptations, you want to instead be converting the rest of the church to your delusion that your temptations are who you really are as a person, that is called apostasy. We don’t really understand apostasy very much these days, because we don’t really understand conversion very well these days.
But there is a world of difference between a person who, like everyone else, has temptations, but ignores them and moves along with life, and a person who thinks their temptations are who they fundamentally are as a person, and wants to convert the rest of the church to their own personal apostasy.