Search Appliance SBE

 

Thunderstone Search Appliance Manual

Refresh All

Refresh All still starts with the Base URLs and explores from there. But instead of creating a new database and fully downloading and processing each URL, it leaves the already-indexed data in place, and check each of the URLs to see if the content has changed. New URLs are added to the database, and URLs that are no longer present on the server are removed from the database.

If a URL's content hasn't changed, the Search Appliance doesn't reprocess the file. If the server supports If-Modified-Since (or it's doing a file:// walk), the content won't even be transferred. This lets the walk be much more efficient.


Copyright © Thunderstone Software     Last updated: Apr 18 2024