Add your website URL or specific page links to train your chatbot on your existing web content.
Training your chatbot on your website content is the most common way to get started with AI Chatbot. You can either crawl an entire website or add specific page URLs.
Use the Website option to automatically crawl and discover pages from your website.
In your chatbot dashboard, click Training & Content in the sidebar.
Click on Sources.
Click Add Sources
Click the + Add Sources button.
From the source type dropdown, select Website.
Enter your website URL in the Website URL field.
Click the Crawl Website button. AI Chatbot will scan your website and discover available pages. This may take a minute or two depending on the size of your website.
After crawling, you’ll see a list of discovered pages with their URLs and content sizes.
Browse the list of pages found on your website.
Click the Add Selected button to add the chosen pages as training sources.
Focus on pages with valuable content like product pages, FAQs, help articles, and documentation. Skip pages with minimal content like login pages or utility pages.
Instead of manually selecting pages, you can set up automatic syncing that crawls your website daily and keeps your training data up to date.
Before crawling, check the Auto-sync website pages daily checkbox below the URL input field.
Open Advanced Options to add URL exclusion patterns. Any URLs matching these patterns will be skipped during crawling. For example, you can exclude /admin/* or /login.
Click the Create Auto-Syncing Website button. AI Chatbot will crawl your website, discover all pages, and set up daily automatic syncing.
Once set up, AI Chatbot checks your website daily for changes:
Auto-sync for websites requires the Pro Plus plan or higher.
Use the Links option to add specific page URLs directly, without crawling an entire website.
Go to Training & Content
In your chatbot dashboard, click Training & Content in the sidebar.
Select Sources
Click on Sources.
Click Add Sources
Click the + Add Sources button.
From the source type dropdown, select Links.
Enter the page URLs you want to train on in the Link URLs field. Separate each link by a new line.
Fetch Links
Click the Fetch Links button to retrieve the content from each URL.
After fetching, you’ll see each URL with its content size.
Review fetched links
Check the list of URLs and their content sizes.
Select links
Use the checkboxes to select which links you want to train on.
Click the Add Selected button to add the chosen links as training sources.
Each source shows:
To update your trained content when your website changes:
Use the checkboxes to select the sources you want to update.
Click the Retrain button to re-fetch and retrain on the latest content.
Enable Auto Sync on important sources to automatically keep them updated.
