Shrink your models
This is Anarchy's effort to help wean you off of closed-source models.
If you're doing one thing lots of times, why use a giant expensive and slow general purpose model when a fine-tuned small model could suffice?
Where do you get the training data?
Why not from running a big model on user data?
What if you don't have enough user data?
Synthesize some with the big model.
Distillery does this. Replace openai.complete
or whatever with distillery.complete
and it will
help you automatically switch over to a custom fine-tuned model.
Python >=3.10 Supported. Older versions of Python are on a best-effort basis.
Use bash > python3 --version
to check what version you are on.
To upgrade your python, either create a new python env using bash > conda create -n myenv python=3.10
or go to https://www.python.org/downloads/ to download the latest version.
TODO: The quickest way to get started is to run pip install distillery
in your Python environment.
Alternatively you could do this:
> git clone https://github.com/anarchy-ai/distillery.git
> cd distillery
> python -m venv <name>
> source <name>/bin/activate
> python -m pip install -e ."[dev]"
# import our client
from distillery.client import Client
# Select which LLM you want to use, here we have OpenAI
client = Client(big_model = 'chat_gpt')
# Put in your prompt and go!
response = client.complete(system_prompt = '', prompt = 'What is Anarchy?', openai_key = 'ENTER_YOUR_API_KEY')
print(response)
# Anarchy is a political ideology that advocates for the absence of government...
We welcome contributors! To get started is to join our active discord community. Otherwise here are some ways to contribute and get paid:
- We're always looking for serious hackers. Prove that you can build and creatively solve hard problems and reach out!
- The easiest way to secure a job/internship with us is to submit pull requests that address or resolve open issues.
- Then, you can apply directly here https://forms.gle/bUWDKW3cwZ8n6qsU8
We offer bounties for closing specific tickets! Look at the ticket labels to see how much the bounty is. To get started, join the discord and read the guide
-
Matthew Mirman - CEO
- GitHub: @mmirman
- LinkedIn: @matthewmirman
- Twitter: @mmirman
- Website: mirman.com
-
Victor Odede - Undoomer
- GitHub: @VictorOdede
- LinkedIn: @victor-odede
-
Abhigya Sodani - Research Intern
- GitHub: @abhigya-sodani
- LinkedIn: @abhigya-sodani