Skip to content

Build an eCommerce price tracker using Next.js and Bright Data's webunlocker. This tutorial covers web scraping, cron jobs, and email notifications, helping users track product prices and availability. Perfect for beginners, it features a user-friendly interface with carousel, search, and alerts.

Notifications You must be signed in to change notification settings

omarmnfy/Pricewise-Web-Scraper

Repository files navigation

Pricewise: eCommerce Price Tracker

Web Datascraping

Source: GCORE

Introduction

Welcome to the eCommerce price tracking project: Pricewise, a powerful tool built using Next.js and Bright Data's webunlocker. This project aims to assist users in making informed purchasing decisions by monitoring product prices and availability on popular platforms like Amazon. By utilizing web scraping, users can be notified of price drops or out-of-stock alerts, allowing them to optimize their shopping experience.

Web scraping is the process of automatically extracting data from websites. It enables us to gather information at scale, which would be impractical to do manually. In this project, we use web scraping to collect product details, such as pricing and stock status, which are then presented to users through a visually appealing interface.

This project is particularly important for consumers who want to stay ahead of price changes and for businesses looking to keep an eye on competitor pricing. By automating the data collection process, users save time and gain valuable insights to make strategic decisions.

Tech Stack

tailwind typescript javascript css3 nodejs mongodb git

Features

Header with Carousel: Features a visually attractive header with a carousel that highlights the site's key features and benefits.

Product Scraping: Includes a search bar where users can enter Amazon product links to initiate scraping.

Scraped Projects: Displays information about products that have been scraped, providing insights into items being tracked.

Scraped Product Details: Displays the product's image, title, pricing, and other relevant information gathered from the original website.

Track Option: Offers a modal where users can input their email addresses and opt-in to track specific products.

Email Notifications: Automatically sends alert emails to notify users of various events, such as when a product is back in stock or reaches the lowest price.

Automated Cron Jobs: Leverages cron jobs to automate regular scraping activities, ensuring the data remains current.

Prerequisites

Git

Node.js

npm (Node Package Manager)

Project Dependencies Installation using npm:

npm install

Environment Setup

Create a new file named .env in the root of your project and add the following content:

#SCRAPER
BRIGHT_DATA_USERNAME=
BRIGHT_DATA_PASSWORD=

#DB
MONGODB_URI=

#OUTLOOK
EMAIL_USER=
EMAIL_PASS=

Replace the placeholder values with your actual credentials. You can obtain these credentials by signing up on these specific websites from BrightDataMongoDB, and Node Mailer.

Running the Project

npm run dev

Open http://localhost:3000 in your browser to view the project.

About

Build an eCommerce price tracker using Next.js and Bright Data's webunlocker. This tutorial covers web scraping, cron jobs, and email notifications, helping users track product prices and availability. Perfect for beginners, it features a user-friendly interface with carousel, search, and alerts.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published