Meta changes AI scraping policy but won’t add language respecting robots.txt.
What would help—as University of Wisconsin law professor Benjamin Sobel told Nieman Lab—would be if Meta added specific language to the policy where the company agrees to respect scraping instructions in robots.txt files. Since complying with robots.txt is voluntary, Meta could possibly rely on the legally enforceable TOS omitting mentions of robots.txt to scrape sites that attempt to block scraping via robots.txt, experts suggested.
When it comes to robots.txt, “you can still express the preference, and unless it’s a legally enforceable preference, it can still be ignored all the same,” Sobel said.
Criticism goes beyond Nieman Lab’s reporting, as news groups globally urge regulators to intervene and block Meta’s controversial terms from kicking in.
A chief executive for the United Kingdom News Media Association, Theo Bamber, accused Meta of a “shameless land grab” relying on the “worst kind of arrogant tech platform bullying.” Bamber urged UK regulators to “stand up for British creators and the business community” by “preventing Meta from setting this dreadful precedent.”
Meanwhile, the European Publishers Council has already asked the European Commission to intervene. “Publishers must be able to decide whether and how their journalism is used, and negotiate fair payment,” the group’s executive director, Angela Mills Wad, said. “Burying such far-reaching claims in platform terms is no substitute for consent.”…
That's the opening of the original reporting — continue reading at Ars Technica for the rest.