Python Web Scraper

This Python code scrapes data from any table contained in a website using BeautifulSoup and Pandas.

Requirements

• Python3
• BeautifulSoup
• Pandas
• requests
• dotenv
• smptlib
• ssl

Installation

• To install the required libraries, run the following command ina terminal in your application:

  pip install beautifulsoup4 pandas requests python-dotenv

Usage

• run the scraped_data.pyfile. It will scrape data from the website indicate at URL.
• If there are a number of tables on the webpage you wish to scrape, indicate the desire tables number using indexing starting from 0 in the bracket located at dframe.
• once the scrape is done it will rename it with the current date and time the scrape occured and send an email to a designated email address.