Skip to content

Gin based scraper which scraper the DOM which is received from extension, scrapes only the necessary data and dumps it to MongoDb

License

Notifications You must be signed in to change notification settings

Saicasm/scrapper-service

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data-Service

The application is used to serve APIs requests for the frontend application

Installation

Use the makefile to install the dependencies.

make init_dependency

Use bash make copy_env to make a local copy of the env

Startup

Use the below command to run the application on port 8080 bash make run

Configuration

  • The service runs on port 8080
  • The health endpoint runs on http://localhost:8080/api/ingest/health

License

MIT

About

Gin based scraper which scraper the DOM which is received from extension, scrapes only the necessary data and dumps it to MongoDb

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published