GitHub - TeamHG-Memex/domainSpider: Simple web crawler that sticks to a set list of domains. Work in progress.

Name		Name	Last commit message	Last commit date
Latest commit History 64 Commits
.github		.github
.bish-index		.bish-index
.bish.sqlite		.bish.sqlite
.gitignore		.gitignore
domainSpider.py		domainSpider.py
rules.json		rules.json
spiderDatabase.py		spiderDatabase.py
submitTranslation.py		submitTranslation.py