@simon The problem is so much of the construction of the model is that frequency of occurrence = trust. That and ChatGPT (in particular) presents itself as intelligence. It's right in the name (AI). If it pretends to be human enough to pass the average user's personal Turing Test and it's sold and positioned as intelligence, there's going to be a problem.
@dbreunig I really wish we could break away from the term AI but I very much doubt that's possible at this point, at least for society in general