Best Products
Launches
Launch archive
Most-loved launches by the community
Launch Guide
Checklists and pro tips for launching
News
Newsletter
The best of Product Hunt, every day
Stories
Tech news, interviews, and tips from makers
Changelog
New Product Hunt features and releases
Forums
Forums
Ask questions, find support, and connect
Kitty Points Leaderboard
The highest scoring community members
Streaks
The most active community members
Events
Meet others online and in-person
Advertise
Subscribe
Sign in
Clear text
recent
p/murror
by
Mona Truong
•
2mo ago
The Cloudflare box you ticked in 2024 starts blocking Googlebot on 15 September
... three. We went through that this week. The AI bot toggle was one of the things we turned off, and it was the right call regardless. But it was not our cause. Our cause was that unmatched
dotted
paths, /whatever.png, were falling through a route matcher into a locale handler and throwing a 500. Googlebot was being let in and then handed errors, and the symptom in Search Console was indistinguishable from being blocked. So the practical version of "write ... ... site with Googlebot's user agent, and do it against your ugliest URLs rather than the homepage. The homepage is the page everyone tests and the page that is always fine. Mine broke only on paths containing a
dot
23
19
Subscribe
Sign in