Simple WebCrawler script that will list the items of all the post that are on my site
This is a simple example of a webcrawler that will list the messages of my site (www.trebnie.nl).
Prerequisite
BeautifulSoup4:
sudo pip3 install BeautifulSoup4
You can run it within Python3
WebScraping-top-moviemeter.py: listing movies
WebScraping-trebnie-messages.py: example to get messages from my site
exec(open('WebScraping_trebnie.py').read())
After running this script the variable 'ds' available.
'ds' contains the collected messages.
Run outside Python3:
python3 WebScraping_trebnie.py