Templates / Lead Gen
List scraper
Paste a page that lists things — a directory, a marketplace, search results — and every item on it becomes a row. No AI, no selectors to write. The Detail scraper then opens each row's own page and adds what it finds there.
What it isSource
Sources put rows into a table. This one reads them off any page that shows a list, so the list you need no longer has to come from Maps, Google or Apollo.
InputWhat you give it
The address of one page that lists many items. Manycrawl finds the list on it by itself.
OutputWhat comes back
- Every value the cards show — name, link, location, rating, price, tags
- Every page: next links, page numbers, “Load more” buttons and infinite scroll
- Details from each row’s own page, with the Detail scraper
| Name | Rank | Site | URL |
|---|---|---|---|
| Claude Code reads AGENTS.md only when telemetry is on | 1 | szypowi.cz | blog.szypowi.cz/p/claude-code-reads-agents.md… |
| I Don't Want the Details | 2 | michaelheap.com | michaelheap.com/i-dont-want-the-details/ |
| The GitHub wiki is an anti-pattern | 3 | michaelheap.com | michaelheap.com/github-wiki-is-an-antipattern/ |
Real output. The Hacker News front page, read 23 September 2026 with no setup: 30 stories found, every column filled on every row. The page has no prices or pictures, so no empty Price or Image column was added.
How it worksFour things you decide
- Paste the pageClick Find lists. Manycrawl reads the page, finds the repeating list on it and offers every column the cards hold, with a picture of one card.
- Check it on the pageShow on page opens the page in Manycrawl's browser with each column outlined in its own colour, numbered to match the table. Click an outline to leave that column out or put it back.
- Choose how far to readIt follows next links, page numbers, “Load more” buttons and infinite scroll. Set a row limit, or let it read to the end.
- Go deeper per rowAdd a Detail scraper column and it opens each row's own page — a profile, a listing — and adds what it finds there as new columns in the same table.
Behind a loginWhen the list is for members only
Tick behind a login and click Log in. The site opens in Manycrawl's browser; you sign in yourself, the way you would in any browser. From then on the List and Detail scrapers read with that login. Manycrawl never asks for or stores your password, and the login stays on your computer — it is never put into a table, a template or cloud sync.
If the login expires, the read stops on the first page and tells you to log in again, rather than filling the table with empty rows.
Limits — read this before you run it
Desktop app only. No AI is used, so it reads what the page shows: a list drawn only after you type into a search box needs that search in the address. Pages behind a login are paced more gently, 5 seconds between pages. A few sites keep their login inside the page itself rather than in cookies; those cannot be read behind a login yet. Each new row costs 1 action; reading the page again adds only items that are new.
FAQQuestions people actually ask
Does it use AI?
No. It finds the list by the page's own structure and measures every candidate column across the items, so the same page gives the same table every time and a run costs nothing beyond its actions.
What if it picks the wrong columns?
Use Show on page to see exactly what each column read, and click an outline to drop the ones you do not want. If you drive Manycrawl from an AI agent, it can look at the page and write a better recipe with the inspect_list and test_list_recipe tools, then build the table from that — after which it runs with no AI at all.
What is the difference between the List scraper and the Detail scraper?
The List scraper reads one page that lists many items and makes a row per item. The Detail scraper is a column: it opens each row's own page and adds the details found there. Together they turn a directory into a table with the profile data behind every entry.
Can it read a list I have to be signed in to see?
Yes. Tick behind a login, sign in once in Manycrawl's browser, and reads use that login. Your password is never stored, and the login stays on your computer.