Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Unify Efficient Fine-Tuning of 100+ LLMs

Python scraper based on AI

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Agents-Flex is an elegant LLM Application Framework like LangChain with Java.

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

This repository contains files from a client project aimed at performing sentiment analysis on an Instagram comments dataset and developing a Streamlit app for model deployment.

Sample LLM-based chatbot service with local and remote models

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

LlamaIndex in TypeScript

An advanced AI-powered solution enhances network diagnostics by leveraging large language models (LLMs). It parses various logs to identify patterns and anomalies, providing actionable insights for diagnosing and resolving network issues efficiently. This simplifies analysis, enabling quicker and more accurate problem detection and resolution.

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 40+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

Shinkai is a two click install AI manager (Ollama compatible for Windows, Mac and Linux). It lets you download/use AI models, RAG, and performs actions for you with tooling (very soon).

Devon: An open-source pair programmer

ChatLlama🦙 is an AI chat bot inspired by ChatGPT running Llama 3 locally on an Ollama Server via Docker

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

すぐに業務活用できるビジネスユースケース集付きの安全な生成AIアプリ実装

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.