I grew up in the era of Photoshop and people would post fake nudes. Why is it now a big deal that AI is doing it? Kinda like the Taylor Swift thing on twitter.
Because previously if someone had the skills to get rich off the skill making convincing fake nudes we could arrest and punish them - people with similar skillsets would usually prefer more legitimate work.
Now some ass in his basement can crank them out and it's a futile game of whack-a-mole to kill them dead.
It's still going to be futile even with this law in place. Society is going to have to get used to the fact that photo-realistic images aren't evidence of anything (especially since the technology will keep improving).
It blows my mind when I think about where we might be headed with this tech. We've gotten SO used to the ability to communicate instantly with people far away in the technology age, how will we adapt when we have to go back 300 years and can only trust something someone tells us in person. Will we go back to local newspapers? Or can we not even trust that? Will we have public amphitheaters in busy parts of town, where people will around the news? And we can only trust these people, who have a direct chain of acquaintance all the way back to the source of the information? That seems extreme, but I dunno.
I think most likely we won't implement extreme measures like that, to ensure we're still getting genuine information. I think most likely we'll just slip into completely generated false news from every source, no longer have any idea what's really going on, but be convinced this AI thing was overblown, and have no idea we're being controlled.
I don't think it will be quite that bad. Society worked before photography was invented and now we have cryptographic ways to make sure you're really talking to the person you think you're talking to.