Skip to content

WebScraper is a simple application for data scraping.

Notifications You must be signed in to change notification settings

nikitap492/WebScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Build Status codecov.io CodeFactor

WebScraper

Simple application for data scraping.

How to try this project?

You must have gradle and jdk 8. In project directory create jar by command gradle build. When jar will be created in build/libs. Run it java -jar scraper.jar uri words options .

Or just docker. Run docker run --rm nikitap/webscraper uri words options

URI this is web site url or path to file with URLs, words are searchable words separated by delimeter "," and options enables different type of analyze:

  • -c for counting chars on web pages
  • -w for counting words on web pages
  • -e for scrapping sentences for searchable words

About

WebScraper is a simple application for data scraping.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published