So that’s mostly true in patriarchal polygyny (one man multiple wives). In polyandrous (one woman multiple husbands) it doesn’t look like there’s much gendered abuse. And in polyamorous there’s not supposed to be any gendered inequality. Sometimes people are abused, but that’s more of a relationships have that problem situation.
cults often practice polygamy as a few men in power "marry" girls (teenagers or younger), and control the assets. this is a power imbalance that can easily be abused.
polyamory as a modern term is trying to differentiate from that. proponents emphasize enthusiastic consent (from all parties) and communication, and often will warn against any rigid hierarchy among the polycule members.
that's an ideal, so it's certainly possible to find examples that fail, but the intent is that people are all equally respected.