Google StoreBot crawler, a bot designed to collect product data for Google Search, has been abusing its powers by submitting spammy fake orders through online forms. To save businesses from this unwanted activity, we have implemented a targeted blocking solution using CleanTalk Anti-Spam.
Understanding Google StoreBot crawler
Google StoreBot crawler is a search engine-based automated crawling program, used for gathering and analyzing product information. While it is mainly designed to improve product listings within Google Search, it is now being exploited to send fake orders. For detailed information on the Google StoreBot crawler, see Google's official documentation: https://support.google.com/merchants/answer/13294660
Why Block the Google StoreBot crawler?
Blocking the Google StoreBot crawler will prevent spammy, and fake orders, improve your website's performance, and protect your business from potential fraud. Note that blocking the bot may temporarily impact how your products are indexed in Google Search, although this can be partly mitigated by having well-structured and accurate product data.
Our Solution: A Targeted Block
To solve this problem, we have applied a custom solution with the personal blocklist by CleanTalk Anti-Spam. In such a way, we targeted the exact user-agent of the Google StoreBot crawler and since then have managed to block fake order creation by this bot.
How to Stop Google StoreBot Crawler from Sending Fake Orders
To enable user-agent blocking in CleanTalk, navigate to WordPress Admin > Settings > Anti-Spam by CleanTalk. From there, go to the Advanced Settings tab. Locate the "Anti-Crawler" option and set it to "On". Once you've made this change, click "Save Changes" to apply the new settings. This will activate the user-agent blocking feature, helping to prevent spam from bots like Google StoreBot.
1. Choose the type of filter you need to block the Google Store-Crawler — User-Agent.
2. Pick the Google StoreBot crawler from the drop-down list.
Benefits of blocking Google StoreBot crawler:
- Less spam: Significantly cuts back on spammy fake orders.
- Better website performance: Cuts load on your servers.
- Improved security: Protects your business from potential fraud.
The Outcome
By setting up a targeted block on the Google StoreBot crawler, we've been able to save our clients from spammy fake orders. It's a very simple solution that protects online forms and improves the user experience.
It would also be interesting
- The Real Person Badge | CleanTalk Anti-SpamThe Real Person Badge A benchmark system for WordPress that separates real users from bots. The...
- How the CleanTalk Anti-Spam API Works. API Main HelpAPI Main Help Method "check_newuser" Method "check_message" Send_feedback Built-In...
- How CleanTalk Anti-Spam Works. Manuals, Questions and Answers.CleanTalk Help Manuals, Questions and Answers Anti-Spam Service Premium Notice is still shown...