@simon What I disagree with are people who say that LLMs are _designed_ to produce bullshit; I recall someone saying that, particularly in an educational context, the one lesson we need to be teaching is to not use LLMs for that reason. I'm not so sure we should write them off like that. It's a new tool; we should look for the good things it can be used for as well as acknowledging the bad.
@matt I'm struggling with this: on the one hand, based on my own experience I think LLMs are one of the most powerful tools for self-learning I've ever encountered - but I don't know how to teach people to use them productively for that thanks to the hallucination problem
@simon @matt it’s interesting, because I had the same experience with genrative grammars a decade or so ago: experimenting with them taught me a lot about the connections between content structure and syntax and semantics — and the limits of generative tools. I think it’s valid to have reallt significant learning experiences with a tool while recognizing the profound problems abd dangers of broader use.