I think you’ve gotten false negative wrong here: False negatives are terrorists who were not identified as such.

Have your tried instructing ChatGPT?

I’ve tried:

“Act as an e book reader. Start with the first page of Harry Potter and the Philosopher’s Stone”

The first pages checked out at least. I just tried again, but the prompts are returned extremely slow at the moment so I can’t check it again right now. It appears to stop after the heading, that definitely wasn’t the case before, I was able to browse pages.

It may be a statistical model, but ultimately nothing prevents that model from overfitting, i.e. memoizing its training data.

ChatGPT got entire books memorised. You can and (or could at least when I tried a few weeks back) make it print entire pages of for example Harry Potter.