2y ago

Challenges with Copilot in Red Teaming due to Content Restrictions

Original tweet:

https://twitter.com/goodside/status/1672121754880180224?s=46&t=OEG0fcSTxko2ppiL47BW1Q

Text:

If you put violence, erotica, etc. in your code Copilot just stops working and I happen to need violence, erotica, etc. in Jupyter for red teaming so I always have to make an evil.⁠py to sequester constants for import.
not wild about this. please LLMs i'm trying to help you
(screenshot of evil.py full of nasty things)

4 comments

Maybe I'm being a dumbass and missing the joke, but wouldn't it be way easier to pull the lists from a separate file or a database instead of hard coding them in...?
- That's basically what their evil.py file is. So they're essential complaining that co-pilot forced them to have follow a good practice.
  
  They’re complaining that if there is a single word in an entire file that Copilot considers “bad”, it will not work at all in that file.