geotribu_scraper.spiders.articles_crawler module

class geotribu_scraper.spiders.articles_crawler.ArticlesSpider(*args, **kwargs)[source]

Bases : Spider

Specific spider for articles.

name: Optional[str] = 'geotribu_articles'
parse(response)[source]

Parse URLs.

Paramètres

response (Response) – HTTP response returned by URL requested

parse_article(response)[source]

Specific parsing logic for Geotribu articles

Paramètres

response (Response) – HTTP response returned by URL requested

settings = <scrapy.settings.Settings object>
start_urls = ['http://localhost/geotribu_reborn/articles-blogs']