Ways You Can Protect Your Website from AI Web Crawlers

MacStories
By John VoorheesJun 17, 2024, 11:22 am451 pts
Over the past several days, we’ve made some changes at MacStories to address the ingestion of our work by web crawlers operated by artificial intelligence companies. We’ve learned a lot, so we thought we’d share what we’ve done in case anyone else would like to do something similar. If you read MacStories…

Read Article Share
Share Article
- email
- x.com
- facebook
- pocket
- reddit
- tumblr
- linkedin
- pinterest

Trending Today on MacHash

★ Alan Dye Was in Tim Cook’s Blind Spot 280

tvOS 26.2 receives second release candidate build only a day after the first 278

tvOS 26.2 gets new RC for Apple TV 4K ahead of launch 234

Apple General Counsel Kate Adams and Environment Chief Lisa Jackson Retiring in 2026 231

Messi and Müller renew rivalry in MLS Cup final on Apple TV this Saturday 228

SpongeBob and PowerWash Simulator headline today’s six additions to Apple Arcade 226

How to buy a used Mac and not get ripped off 216

Severance season 3 just got a big release timing update 202

About MacHash

MacHash is your real-time Apple news aggregator, delivering the latest headlines on Apple, Mac, iPhone, iPad, and iOS from top sources across the web.

As a powerful content discovery platform, MacHash continuously curates breaking news, product announcements, software updates, reviews, and industry insights related to Apple Inc. and its ecosystem.

MacHash helps you stay informed on everything from macOS and iOS developments to Apple Watch, AirPods, and the latest in tech and app innovation.

Access MacHash from your desktop or mobile device to explore, follow, and share the most trusted Apple news all in one place.