mirror of https://github.com/zulip/zulip.git
4d9f161e0f
I have suppressed errors for github.com by adding an function to exclude domains as well as urls; this is necessary because GitHub has marked this tool's User-Agent as a blocker crawler. I have also suppressed reoccurring url errors that do definitely exist. Fixes #17928. |
||
---|---|---|
.. | ||
documentation_crawler | ||
__init__.py | ||
scrapy.cfg |