scrapy link extractors in regular spiders
def parse(self, response): for link in self.link_extractor.extract_links(response): yield Request(link.url, callback=self.parse)
Source: docs.scrapy.org
def parse(self, response): for link in self.link_extractor.extract_links(response): yield Request(link.url, callback=self.parse)