Website indexer
Crawl a website's public pages and bring the content into a collection.
The Indexer crawls public URLs and brings the pages' text into the Collection. It is the connector that doesn't depend on a credential: if the page opens in the browser without logging in, it can reach it.
Internally the platform identifies it as web_scraper.
When to use it
It is meant for content that is already published and is the source of truth: public documentation, a help center, product pages, policies on a corporate website.
It isn't meant for content behind a login, or for pages that build their text with JavaScript after loading.
Configure
The form asks for the list of URLs to crawl and the type of extraction applied to the content found.
When you leave the connector's description empty, it gets the default value Indexador. Replace it with something that says which site it is, because the connector list shows that text.
Scheduling
Like the other connectors, it accepts a schedule. The frequency sets how often the URLs are crawled again.
Pages that rarely change don't justify a daily sync: each run reprocesses the content and uses indexing time.
The Indexer doesn't get past paywalls or sessions. A URL that requires login returns the login page, and that text is what ends up indexed in the Collection.