Curently, provide telegram-bot wrapper for llama.cpp or trnasformers, also can use a oobabooga/text-generation-webui as LLM backend.
FEATURES:
session for all users are separative (by chat_id)
local session history - conversation won't be lost if server restarts. Separated history between users and chars.
buttons: continue previous message, regenerate last message, remove last messages from history, reset history button, new char loading menu
you can load new characters from text-generation-webui\characters with button
you can load new model during conversation with button
"+" or "#" user message prefix for impersonate: "#Chiharu sister" or "+Castle guard". Or even ask bot generate your own message "+You"
"-" or "!" prefix to replace last bot message
"++" prefix replace bot name during chat (switch conversation to another character)
"--" prefix replace you name during chat
"==" prefix to add message to context
"📷" prefix to make photo via SD api. Write like "📷Chiharu Yamada", not single "📷". Need to run (StableDiffusion) with --api key first.
save/load history in chat by downloading/forwarding to chat .json file
integrated auto-translate (you can set model/user language parameter)
voice generating (silero), en and ru variants
telegram_users.txt - list of permitted users (if empty - permit for all)