Scheduling Web Crawlers
Written by Subrat on July 28, 2013
In this video we will show you how to schedule your web crawlers to run automatically.
– On your project page, click on the Scheduling tab.
– Here you can schedule the start date and time for the web crawler to run.
– Choose how often the web crawler will run. Depending on your user level, you can run it daily, weekly or monthly.
– You then need to chose a date until when the crawler stays active.
In some cases, you may also want to run the web crawlers on demand.
You can do this by clicking on the “Run Now” button. Your crawler will then start running in a few minutes.
This feature may not be available to all users. Please contact support to enable this feature.
An updated version of this article is available here.