Jobbing-GUI Extension, also known as Jobbing-GUI Version E, is a Python application meant to keep a track on jobs from a specific set of companies. The list of companies that were used for this project can be found on this Google Spreadsheet. If you are unable to click on the link, you can copy and paste the following into a new tab: https://docs.google.com/spreadsheets/d/1057brcM4eALpCzIQWLOM3C6mvXfoAGp8n8XnYJFzbTc/.
The inspiration for this project came from my search for jobs. There already exist tools like LinkedIn and Indeed that display a lot of jobs, however, these tools notify you of job openings from thousands of companies, many of which you may choose not to work with.
Please pip install the following packages. Note that the version of Python used is 3.8.
pip install pysqlite3 PyPDF2 pydf selenium bs4 flask flask_restful flask_sqlalchemy pandas sklearn
For installing PyTorch, you will need to go to the PyTorch Website to figure out the command. For instance, if installing using pip on cpu, run:
pip install torch==1.7.0+cpu torchvision==0.8.1+cpu torchaudio===0.7.0 -f https://download.pytorch.org/whl/torch_stable.html
You will need to install the chromedriver for your specific Chrome version. Please go to: https://chromedriver.chromium.org/. If you install the latest chromedriver, please be sure to make sure that your Chrome is updated to the most recent version.
You may need to install sqlite3 if you have not already.
In navigating this project, keep in mind the following:
- run
python3 main.py
to populate the cities.db - run
python3 web.py
to run the flask server - run
python3 scrape_struct.py
to populate ml_jobs.db (which is used by web.py) - you will require a credentials.json file to run scrape_struct.py. This is to connect with the Google Sheets API and will be provided upon request.
- All html files are templates which are used with web.py
- run
python3 NLP_Practice\job_classifier.py
to train the BERT model - run
python3 'NLP_Practice\naiveBayes jobs.py'
to train the Naive Bayes model - run
python3 GiantDB\giant.py
to populate giant.db for use with training the models listed above - In the case you get the error where "saved_weights.pt" file cannot be found, you will need to run
cd NLP_Practice && python3 job_classifier.py && cd ..
to train the Bert model. Due to the model weights taking just under 0.5 GB of storage space, this file cannot be uploaded. - You may notice some errors with can't find file or related errors as some organization took place after so as to declutter the main folder. Contact me if you have any questions with finding any file.
For accessing the GitHub Project & Issues associated with this project, please see the original code repository at https://github.com/ccs-1l-f20/Gopu2001-Job-Reaper-The-Original