I keep thinking of the problem of LLM companies scraping private websites to the degree that hosting costs make them to expensive to continue.
At what point do we just kind of, move all the human stuff to a kind of dark-web situation?
@vampiress Right now orgs seem to be heading towards paywalls that agents (and likely humans) will need to use to access any content. CDNs like Cloudflare are leading the way. It's unfortunate.
@mauve Yeah I've been seeing cloudflare blocks in front of more and more sites.
@vampiress It's super annoying if you use a privacy preserving browser or something without JavaScript. There's also the proof of work based things that are less sketchy and make it more expensive for bots to scrape carelessly.