paging @misty, fyi we're on the list
@dsalo OK, as expected they're ignoring robots.txt. I'll have to see if there are other ways people have worked out to block those crawlers…
@dsalo OK, as expected they're ignoring robots.txt. I'll have to see if there are other ways people have worked out to block those crawlers…