All Collections
Getting Started
Implement a URL Whitelist
Implement a URL Whitelist
Sebastiaan Jooste avatar
Written by Sebastiaan Jooste
Updated over a week ago

The URL Whitelist feature can be implemented during the site onboarding process or on the Site Settings page.

  1. Site onboarding

  • When adding a new site to your dashboard, switch on "Only crawl pages from the list."

  • Choose the URL whitelist file to upload. Only a CSV file format will be accepted.

2. Site Settings Implementation

  • Go to your site Settings tab.

  • Switch on "Only crawl pages from the list."

  • Choose the URL whitelist file to upload. Only a CSV file format will be accepted.

  • Click Update Site

  • You will be redirected to the URL Whitelist processing page, where you can view the status of the uploading process.

  • Once the process is completed, go to the Pages tab.

  • Click "Force Re-Crawl" to update your new pages.

  • All the excluded pages will be visible in the "Ecluded" tab

  • That's it! Now, Alli AI will only crawl and optimize pages on your URL Whitelist.

Did this answer your question?