Skip to main content

Configure the Branded Crawler User-Agent

Alli AI also allows the crawler's user-agent name to be customized so that crawls can identify themselves using the agency's branding.

Written by Sebastiaan Jooste

Step 1: Open Crawler Settings

Navigate to:

Dashboard → Settings → Crawler

The Team Crawler Settings page will open.


Step 2: Enter the Custom Bot Name

Locate:

Custom bot name to use in the Crawler's user agent string

Enter the desired crawler name and version.

Example:

MyAgency/1.0

A recommended format is:

AgencyName/1.0

Avoid unnecessary spaces or special characters.


Step 3: Save the Crawler Setting

Click Save Changes.

The Alli AI crawler will now use the custom name in its user-agent string where applicable.

Did this answer your question?