Caellian/Crawler
1
Code Issues Projects Releases Packages Wiki Activity Actions
No description
2 commits 1 branch 0 tags 18 MiB
  • Python 100%
Find a file
Exact
Tin Švagelj 30eb96caef Update README.md
2017-06-05 00:40:31 +02:00
crawler.py Initial release. 2017-06-04 23:31:19 +02:00
LICENSE.md Initial release. 2017-06-04 23:31:19 +02:00
phantomjs-license.BSD Initial release. 2017-06-04 23:31:19 +02:00
phantomjs.exe Initial release. 2017-06-04 23:31:19 +02:00
README.md Update README.md 2017-06-05 00:40:31 +02:00
requirements.txt Initial release. 2017-06-04 23:31:19 +02:00

README.md

Crawler

Tiny python program that crawls results for input search from DuckDuckGo, Bing and Yahoo and then finds input regex in result websites. This could only ever be used for something good... ;)

Dependencies

  • beautifulsoup4
  • selenium

To install all requirements using pip, execute:

pip install -r requirements.txt

PhantomJS is also required, but provided within this distibution. If you have any trouble, delete PhantomJS files and install it manually.

License

Licensed under MIT License.