Websites Increasingly Tell Apple and AI Companies to Stop Scraping

MacStories
By John VoorheesAug 29, 2024, 2:10 pm423 pts
Wired reported today that many large websites are blocking Applebot-Extended, Apple’s artificial intelligence (AI) web crawler. Wired determined this by examining the sites’ public robots.txt file, which Apple says it respects, but some AI companies don’t. According to its research: WIRED can confirm that…

Read Article Share
Share Article
- email
- x.com
- facebook
- pocket
- reddit
- tumblr
- linkedin
- pinterest

Trending Today on MacHash

★ Alan Dye Was in Tim Cook’s Blind Spot 268

tvOS 26.2 receives second release candidate build only a day after the first 266

Screen Protectors Without AR Coating Cancel Out iPhone 17's Anti-Reflective Display 262

tvOS 26.2 gets new RC for Apple TV 4K ahead of launch 232

Apple General Counsel Kate Adams and Environment Chief Lisa Jackson Retiring in 2026 230

Messi and Müller renew rivalry in MLS Cup final on Apple TV this Saturday 228

SpongeBob and PowerWash Simulator headline today’s six additions to Apple Arcade 214

How to buy a used Mac and not get ripped off 206

About MacHash

MacHash is your real-time Apple news aggregator, delivering the latest headlines on Apple, Mac, iPhone, iPad, and iOS from top sources across the web.

As a powerful content discovery platform, MacHash continuously curates breaking news, product announcements, software updates, reviews, and industry insights related to Apple Inc. and its ecosystem.

MacHash helps you stay informed on everything from macOS and iOS developments to Apple Watch, AirPods, and the latest in tech and app innovation.

Access MacHash from your desktop or mobile device to explore, follow, and share the most trusted Apple news all in one place.