Web Link Periodic Sync with Thunai
The Periodic Sync feature allows Thunai to automatically crawl a website at scheduled intervals. Any updates or changes detected on the site are automatically synced into Thunai Brain, ensuring agents always have the latest information.
How to Set Up Web Link Periodic Sync
- Log in to your Thunai Portal.
- Navigate to Brain.
- Click the Add button.
- In the popup, select Periodic Sync.
- Choose Web Link as the source.
Enter the website URL you want Thunai to crawl.
Select the Depth of Crawl:
- Level 1 → Crawls only the main page.
- Level 2 → Crawls the main page + directly linked pages.
- Level 3 → Crawls the main page + multiple linked levels for deeper content coverage.
- Save your settings.
- Schedule a time for the periodic sync to run automatically.
Once configured, Thunai will crawl the selected website at your chosen intervals and update the Thunai Brain with the latest content.