Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
Follow the instructions in the notebook to install and run the procedure.
If you are trying this locally, follow these instructions first:
conda create -n "copilot" python=3.11
conda activate copilot
git clone https://github.com/eljandoubi/Copilot.git
cd Copilot
pip install -r requirements.txt
jupyter notebook