crawler_puppeteer

Crawler for web scraping developed with NodeJS + Puppeteer

How to run?

• Install node v8.+ (puppeteer needs the most recent node to work properly).
• Clone this repository and run 'npm install'.
• Run the crawler using 'node scrape.js' and watch the console messages.
• The data will be at disposal in the 'newsletters.json' file.
• OBS: The file 'example.json' contains some data fetched in '24 March 2018'

License

The MIT License (MIT)

Copyright (c) 2018 Bruno Leandro de Lima