What does feel realistic is training these models to be MUCH better at providing useful indications as to their confidence levels
The impact of these problems could be greatly reduced if we could counteract the incredibly convincing way that these confabulations are presented somehow
I also think there's a lot of room for improvement here in terms of the way the UI is presented, independent of the models themselves
@simon The problem is so much of the construction of the model is that frequency of occurrence = trust. That and ChatGPT (in particular) presents itself as intelligence. It's right in the name (AI). If it pretends to be human enough to pass the average user's personal Turing Test and it's sold and positioned as intelligence, there's going to be a problem.
@dbreunig I really wish we could break away from the term AI but I very much doubt that's possible at this point, at least for society in general
