List scraper: turn any listing page into a table
Paste the address of a page that lists things, like a directory, a marketplace or a set of search results, and the List scraper makes a table with one row per item. It uses no AI, so a run gives the same result every time. Each new row costs one action.
Build a table from a page
- On Home, under Sources, click See all sources and choose the List scraper card (“Every item on a directory or listing page, one row each”).
- Paste the page into Page with the list, for example a category page on a directory, and click Find lists. Reading the page takes a few seconds.
- Under Which list?, pick the list you want. Each choice shows how many items it has and a few names so you can tell them apart. Lists the site publishes in a machine-readable way are marked as recommended, because they keep working when the site is redesigned.
- Under Columns, tick the columns you want. Show on page opens the page in Manycrawl’s browser with every column outlined and numbered, so you can see what each one picked up. Click an outline to leave that column out or add it back.
- Check Preview. It says how many rows it shows from this page and how many duplicate listings it removed.
- Choose how many pages to read. Manycrawl looks for numbered pages, a “next” link, a “Next” button, or a list that loads as you scroll. If it cannot tell, open page 2 on the site and paste its address into Address of page 2 (optional). Then set Pages to read (1 to 1000) and the Delay between pages, which is 2 seconds by default.
- Optionally name the table and set a Row limit. Leave it empty for no limit. Click Create & run.
If the page has no list that Manycrawl can find, it says so: “No repeating list was found on this page. Try a page that shows many items at once — a directory, a category or search results.”
Lists behind a login
Some lists are only visible when you are signed in. Tick This list is behind a login and click Log in…. The site opens in Manycrawl’s own browser. Log in there the way you normally would, then click I’m logged in.
Manycrawl never sees your password. The login stays on this computer and is not saved in tables, templates or the cloud. The delay between pages goes up to at least 5 seconds when this box is ticked, to be gentle with the site. If the login expires, the run stops and tells you to log in again instead of filling the table with empty rows. This works in the desktop app.
Stop, continue and fill gaps
- Stop keeps every row collected so far. You can continue from the page where it stopped.
- If you add columns later, ⋯ → Fill empty cells re-reads the pages already read and fills empty cells. It never overwrites, adds no rows and costs no actions.
- To collect more from each item’s own page, use the Detail scraper.