Skip to content Skip to sidebar Skip to footer

Log_count/error While Scraping Site With Scrapy

I am getting the following log_count/ERROR while scraping a site with Scrapy. I can see that it has made 43 requests and got 43 responses. Everything looks fine. Then what the erro

Solution 1:

That output shows that 21 error was logged; you can also see all of those were AttributeErrors.

If you look at the rest of the log output, you will see the errors themselves:

Traceback (most recent call last):
  (...)
    'end_date': end_date_final.group(0),
AttributeError: 'NoneType'object has no attribute 'group'

From this, you can see that your regex for end_date_final doesn't always find a match.

Post a Comment for "Log_count/error While Scraping Site With Scrapy"