#6270 (An action to scrape a whole tree of pages from Internet)

by Luc Saffre · in Developers · assigned to Sharif Mehedi

1 Jahr ago von Luc Saffre about #6270 (An action to scrape a whole tree of pages from Internet) : NB: don't try to make multiple publisher.Page objects per html page. Find the link rel next and prev in the pages head. Group all pages by their publisher_tree.
1 Jahr, 2 Monate ago von Luc Saffre about #6270 (An action to scrape a whole tree of pages from Internet) : A first page will be a root page (self.root_page = self), for every h1 in the content, create a child page.
1 Jahr, 2 Monate ago von Luc Saffre about #6270 (An action to scrape a whole tree of pages from Internet) : Created new Ticket #6270 (An action to scrape a whole tree of pages from Internet).