Manycrawl

Help centre › Build a list

Detail scraper: collect more from each row's own page

A listing page often shows only a name and a link. The Detail scraper opens each row’s own page, such as a profile or a product page, and adds what it finds there as new columns in the same table. It uses no AI.

Add details to a table

  1. Open a table made with the List scraper. Choose Add details in the toolbar, or ⋯ → Detail scraper.
  2. Under Page to open for each row, choose the column that holds each row’s address.
  3. Click Find details. Manycrawl reads a sample page and shows what it found.
  4. If those pages need you to be signed in, tick The rows’ pages are behind a login and use Log in…, the same way as in the List scraper.
  5. Click Add columns & run.

The new columns appear in the table and fill in row by row. The log says how many columns were added.

If a row stays empty

  • If the site keeps showing its login page, the run stops with a message to log in again. Open ⋯ → Detail scraper → Log in…, then run the rows that are not done yet.
  • A page that does not contain the detail you picked gives an empty cell. That is normal for items where the site does not publish it.