Skip to content

cont3nted/ItsyBitsySpyder

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 

Repository files navigation

Itsy Bitsy Spyder

	 _____ _            ______ _ _             _____                 _           
	|_   _| |           | ___ (_) |           /  ___|               | |          
	  | | | |_ ___ _   _| |_/ /_| |_ ___ _   _\ `--. _ __  _   _  __| | ___ _ __ 
	  | | | __/ __| | | | ___ \ | __/ __| | | |`--. \ '_ \| | | |/ _` |/ _ \ '__|
	 _| |_| |_\__ \ |_| | |_/ / | |_\__ \ |_| /\__/ / |_) | |_| | (_| |  __/ |   
	 \___/ \__|___/\__, \____/|_|\__|___/\__, \____/| .__/ \__, |\__,_|\___|_|   
			__/ |                 __/ |     | |     __/ |                
		       |___/                 |___/      |_|    |___/             
									  @Cont3nted :D  

A Basic Python Program using python scrapy library to scrap websites.

I have included my notes in notes.md on what I have learn throughout making this.

Prerequisite


Python

Scrapy version 2.0.0

git clone https://github.com/cont3nted/ItsyBitsySpyder.git

pip install Scrapy

How to use it


After cloning and pip installing the scrapy library,

just run main.py and key in the URL you want to scrap

and the extracted data will be put into the extracted_data folder.