It already exists for pictures. I've tried it first hand. Not from text as such, but from many many possible choices like ethnicity, position, amount of clothing, background, size...

You could it all depends on what data you're training your model with. But those models are available.

That's how some website will allow you to generate nudes images of celebrities or even people you know...