I would modify the electoral college rather than get rid of it. Make it so that states are obligated to assign their electoral votes to candidates in proportion to the number of votes received. For example, Maryland might go 60% blue and 40% red, so they would give 6 of their 10 votes to blue and 4 to red.
This would de-emphasize the importance of swing states, not completely disenfranchise rural voters, and would return a result that more closely mirrored the popular vote. It might also pave the way for a 3rd party to be relevant if the stars aligned elsewhere.
Might work for MD size states, but most smaller even EV states would split their EVs evenly, even if the state voted 60/40 one way or the other -- while odd EV states would always cast a net vote for the winner.
For example, using the 2020 election numbers Trump would win if the election included only the following states:
AK (R+10) Trump 2-1 Biden
GA (D+0) Trump 8-8 Biden
WI (D+1) Trump 5-5 Biden
PA (D+1) Trump 10-10 Biden
NV (D+2) Trump 3-3 Biden
NH (D+7) Trump 2-2 Biden
ME (D+9) Trump 2-2 Biden
RI (D+20) Trump 2-2 Biden
I don't know that it's any nobler to for electoral influence to discriminate on the basis of even states and odd states than swing states vs safe states. Unless you're also one of the group wanting to expand the legislature until there are no 4 and 6 EV states ...