streamlined2 / WebCrawler Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Web crawler application that collects domain statistical information and saves it to database

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
webCrawler		webCrawler
README.md		README.md

Repository files navigation

webCrawler

Simple web crawler to collect domain statistical information and save it to DB

Application deployed to Heroku service https://very-simple-web-crawler.herokuapp.com/crawler
DB setup script webCrawler/setup.sql

Java 17
JEE front controller servlet
MVC pattern
service, DAO layers
JPA transaction programmatic management
JPA/Lombok annotations for entity classes

Embedded Jetty server
PostgreSQL 13.4
Freemarker templates
Java HttpClient to fetch resources
Jsoup to analyze HTML

About

Web crawler application that collects domain statistical information and saves it to database

lombok postgresql httpclient servlet mvc-pattern freemarker service-layer heroku-deployment front-controller-pattern jetty-server dao-layer jpa-hibernate jsoup-library java-17 heroku-maven-plugin

Report repository

Releases

No releases published

Packages

No packages published

Languages