This project is crawler made to fetch data from the Walmart Mexico website site from a list of barcodes selected by the user.
This version is optimized to work with deodorants, perfurms and shampoos. Other products were not tested in this crawler.
- Ruby
- Watir Gem
- Nokogiri Gem
- Terminal Table Gem
Here is the video explanation of this project.
To get this project up and running locally, you must already have ruby and necessary gems installed on your computer.
Step 1
Navigate through the local folder where you want to clone the repository and write
https://github.com/lirad/walmart-barcode-crawler.git. It will clone the repo to your local folder.
or with https
git clone https://github.com/lirad/walmart-barcode-crawler.git.
Step 2
Run cd walmart-barcode-crawler
Step 3
Run bundle install to get the necesary gems.
Step 4
Go to the folder input and update the bar_code.csv with the desired bar codes. The crawler is optimized to work with perfurms, deodorants and shampoos.
Step 5
Run bin/main
Step 6
See the list of products outputed or navigate to output to get a CSV file.
To the test the codes you must run rspec from the project folder
👤 Diego Lira
If you've read this far, you must like the project! Give us a ⭐️!
- Our thanks to Microverse and all our peers and colleagues there.
This project has no license