Skip to content
This repository was archived by the owner on Sep 16, 2020. It is now read-only.
Ben Gubler edited this page Sep 30, 2017 · 2 revisions

Crawlbug

Welcome to the Crawlbug Wiki! Here you can learn to use this tool to crawl the web and add page info to firebase.

Although I mainly made the Crawlbug project for one of my other projects (I'm working on developing a search engine) feel free to contact me, comment, or just create a pull request if you'd like to contribute.

Clone this wiki locally