Skip to main content
Customizable Crawler
Sebastiaan Jooste avatar
Written by Sebastiaan Jooste
Updated this week

Create a custom crawler name for your account.

Alli AI now lets you customize the bot name used in your crawler’s user agent string. This means you can personalize how your bot appears to websites, making it easier to manage site interactions while keeping things on-brand. Whether you want a name that reflects your agency or just something more recognizable, this feature gives you more control and flexibility in your SEO and automation efforts. This feature is available exclusively for our Agency and Enterprise subscribers.

Here are the steps to customize your crawler.

Go to Team Settings

Scroll to the bottom of the page to Crawler Settings.

Type the preferred crawler name and click Update Team.

That's It!

Now you can use your custom crawler name in a robots.txt file as a user agent string.

Did this answer your question?