This repository contains three Python scripts: gptOnAWS.py, app.py, and simpleApp.py.
This script is a simple program that can be run on an Ubuntu server. It uses the gpt4all-j package to generate text from a pre-trained model.
The model was obtained from here: https://gpt4all.io/models/ggml-gpt4all-j.bin
This is an unfinished app that is meant to host an API. It can be used as a starting point for building a custom API that leverages gpt4all-j.
This script is a simple program that can be run on a MacBook Pro with Apple Silicon. It was previously dependent on files in the libraries but they are no longer needed because gpt4all-j has been updated to include them.
To install the necessary dependencies on Ubuntu, run the following commands:
sudo apt update
sudo apt install -y python3-pip
sudo apt install python3.10-venv
python3 -m venv env
source env/bin/activate
pip3 install gpt4all-j
python3 gptOnAWS.py
OR
to run app.py on a server:
pip install gunicorn
gunicorn -b 0.0.0.0:8000 app:app