But in case you're curious about the actual answer
Ages ago I was doing some research on the prevalence of different paraphilias (my main focus being zoophilia as I was contributing to WikiFur), and this was one of the few large representative studies I came across. There's one more from Canada, but they didn't ask about autogynephilia/androphilia.
It's quite clear by now that it has practically nothing to do with gender incongruence, i.e. trans folks, doesn't mean that it doesn't exist as a paraphilia. That is, just because Blanchard got his theory wrong based on incomplete data and probably a good dose of being born into certain social constructs doesn't mean that no cis men get aroused at the thought of them as a woman. It is, as the study in the comment you replied to shows, actually quite common.
Gotta distinguish between the phenomenon auto[gyno/andro]philia (exists), Blanchard's interpretation wrt. trans folks, (falsified), and TERFs (hateful anti-science assclowns). Otherwise we'd be kink shaming.
Many of Freud’s early patients were dissatisfied housewives. I have no difficulty believing he accidentally discovered trans men and came to the conclusion all women wish they have a penis. Hirschfeld he was not.
In a society where women were repressed into a very narrowly defined role with no room for deviation, the other half enjoyed an attitude of "boys will be boys" and could behave "freely" from their perspective, within a less narrow but no less rigid societal constrain.
Women were literally prohibited, or at least severely frowned upon, to embark on a myriad activities that were acceptable and expected for men. Women were literally prohibited from entering many physical spaces, and were expected to be confined to other spaces - like the kitchen, the parlor and the tea room.
I guess it was impossible even for Freud to see how "penis envy" might have been, at root, "I wish I was a man so I could escape this narrow set of rules I was born and peer-pressured into, with no choice by me, I wish I was free" (not quite free, just "less trapped").
Its a bit rough at the campus, but the science building has great architecture! So very tall!
But we mustn't forget about the two buildings beside it. Never neglect those or you won't get a PhD (pretty huge dick).