Templates / Enrichment
Crawl
Crawl starts at each row’s URL, follows links on the same site, and adds every page it finds as a new row. Use it to discover a specific kind of page on a site — a keyword filter (like "pricing") only follows links whose URL or link text match — or leave the filter empty to crawl the whole site.
What it isEnrichment
An enrichment column. It reads a column you already have and writes a new one beside it.
InputWhat you give it
A column that already holds the value this reads.
OutputWhat comes back
| URL | Title | Depth | Words | Status |
|---|---|---|---|---|
| example.com/ | Home | 0 | 412 | success |
| example.com/pricing | Pricing | 1 | 738 | success |
| example.com/blog/why-we-built-this | Why we built this | 2 | 1,940 | success |
| example.com/legal/terms.pdf | — | 2 | — | skipped — excluded pattern |
Illustrative. one row in, many rows out. Depth is what multiplies; max pages is what caps the damage.
How it worksFour things you decide
- Pick the starting URLOne row in, many rows out — each discovered page becomes its own row in this table.
- Bound itMax pages and max depth are the two dials that matter. Depth 2 from a homepage usually covers the main navigation without wandering into pagination.
- Choose what to keepMarkdown is the useful default. Page links are worth keeping if you plan to filter the crawl afterwards.
- Narrow it with a keyword filterOptional. Keyword filter keeps only links whose URL or link text match (e.g. "pricing, blog"); Exclude patterns drops the rest (e.g. "login, logout"). Leave both empty to crawl everything.
FAQQuestions people actually ask
How do I stop it exploding?
Lower max depth before max pages. Depth is what multiplies; pages only caps the damage.
What does "Auto-run on new rows" do?
Runs this column by itself whenever new rows arrive — no clicking Run. It only picks up new arrivals; rows already in the table when you turn it on are left alone. It only fires while the app is open — closing it pauses everything until you reopen.
What does "Add run condition" do?
Skips rows where a condition on another column isn't met — e.g. only run if Email is empty. Skipped rows cost no actions, on both manual and auto runs.