@jon @CatherineFlick would you install a proxy server in front of your website to block AI crawlers?
@mattl @CatherineFlick assuming it was under my control and I had some visibility into what/who I was blocking at a more granular level than “AI”, sure.
@jon @CatherineFlick It would be an standard haproxy configuration with a few plain text files. One just has a list of user agents, one has a list of IP addresses. They accept comments, so they could be documented.