GitHub - ssharmapavitra/webcrawler: Web Crawler is a Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in a specified directory

ssharmapavitra / webcrawler Public

Notifications You must be signed in to change notification settings
Fork 0
Star 2

Web Crawler is a Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in a specified directory

2 stars 0 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 67 Commits
FileHandler		FileHandler
HttpRequests		HttpRequests
dataStructure		dataStructure
hyperLinkExtractor		hyperLinkExtractor
plan		plan
.gitattributes		.gitattributes
.gitignore		.gitignore
Crawler.cpp		Crawler.cpp
main.cpp		main.cpp