CLOUDFLARE CONFIGURATION

Allow TecsaroBot
to crawl your site

Your website's Cloudflare protection is blocking TecsaroBot from reading your content. Follow these steps to whitelist it — takes less than 2 minutes.

🤖

Bot User-Agent string

TecsaroBot/1.0 (+https://ai.tecsaro.com/bot)
01

Login to Cloudflare

ACCOUNT

Go to dash.cloudflare.com and sign in to your account.

02

Select your domain

DOMAIN

From the dashboard, click on the website domain you want to allow TecsaroBot to crawl.

03

Open WAF Custom Rules

SECURITY

Navigate to Security → WAF → Custom Rules in the left sidebar.

04

Create a new rule

WAF RULE

Click "Create Rule" and set up the following configuration exactly as shown.

WAF RULE CONFIGURATION
FieldOperatorValueAction
User AgentcontainsTecsaroBotAllow
05

Deploy the rule

DEPLOY

Set the Action to "Allow", give it a name like "Allow TecsaroBot", then click Deploy.

06

Update your robots.txt

ROBOTS.TXT

Also add TecsaroBot to your robots.txt file so it knows it's welcome.

/robots.txt
User-agent: TecsaroBot
Allow: /

Common questions

Is it safe to allow TecsaroBot?

Yes. TecsaroBot is a read-only crawler owned by Tecsaro. It only reads publicly available pages and never submits forms, modifies content, or performs any write operations.

What if I want to block TecsaroBot later?

Simply go back to Cloudflare → Security → WAF → Custom Rules and delete or disable the rule you created. The bot will be blocked immediately.

Will this affect my other security rules?

No. This rule only applies to requests with 'TecsaroBot' in the User-Agent. All other traffic continues to be processed normally by your existing rules.

I don't use Cloudflare — do I need to do anything?

No action needed! If your site doesn't use Cloudflare, TecsaroBot can already crawl your website without any configuration.

Done with the setup?

Go back to ai.tecsaro.com and retry the scan — it should work now.

Retry scan →