zulip/tools/documentation_crawler/scrapy.cfg

[settings]
default = documentation_crawler.settings

[deploy]
project = documentation_crawler
docs-test: Add scrapy crawler to check documentation not having broken links. - Add scrapy project with rewrited 'crawl' command and spider to check documentation. Command was rewrited due to return exit status by the exception existing, it returns exit code 0 if exception happens inside spider in standard behavour. - Add scrapy requirements to for dev environment. It was added to twisted requirements list. Fixes #1492 2016-10-21 08:59:25 +02:00			`[settings]`
			`default = documentation_crawler.settings`

			`[deploy]`
			`project = documentation_crawler`