Skip to main content

Implement a URL Whitelist

Written by Sebastiaan Jooste
Updated over 2 weeks ago

The URL Whitelist feature can be implemented during the site onboarding process or on the Site Settings page.

  1. Site onboarding

  • When adding a new site to your dashboard, switch on "Crawl pages from the list."

  • Choose the URL whitelist file to upload. Only a CSV file format will be accepted.

2. Site Settings Implementation

  • Go to your site Settings tab.

  • Switch on "Crawl pages from the list."

  • Choose the URL whitelist file to upload. Only a CSV file format will be accepted.

  • Click Save Changes

  • You will be redirected to the URL Whitelist processing page, where you can view the status of the uploading process.

  • Once the process is completed, go to the Pages tab.

  • Click "Force Re-Crawl" to update your new pages.

  • All the excluded pages will be visible in the "Excluded" tab

That's it! Now, Alli AI will only crawl and optimize pages on your URL Whitelist.

Did this answer your question?