zulip/tools/documentation_crawler/documentation_crawler
Adam Birds 4d9f161e0f tools: Suppress errors for github.com links.
I have suppressed errors for github.com by adding an function to
exclude domains as well as urls; this is necessary because GitHub has
marked this tool's User-Agent as a blocker crawler.

I have also suppressed reoccurring url errors that do definitely exist.

Fixes #17928.
2021-04-09 12:25:23 -07:00
..
commands python: Sort imports with isort. 2020-06-11 16:45:32 -07:00
spiders tools: Suppress errors for github.com links. 2021-04-09 12:25:23 -07:00
__init__.py
settings.py python: Normalize quotes with Black. 2021-02-12 13:11:19 -08:00