1Panel-Appstore/localai

LocalAI

LocalAI is a free and open-source alternative to OpenAI. LocalAI serves as a replacement REST API, compatible with OpenAI (Elevenlabs, Anthropic, etc.) API specifications, for local AI inference. It allows you to run LLMs, generate images, audio (and more) locally or using consumer-grade hardware, supporting various model families. No GPU is required.

Key Features:

• Generate text using GPT (llama.cpp, transformers, vllm, etc.)
• Text-to-audio conversion
• Audio-to-text transcription (with audio transcription via whisper.cpp)
• Image generation
• OpenAI-like tools API
• Embedding generation for vector databases
• Constrained grammar
• Download models directly from Huggingface
• Vision API
• Re-ranking API
• P2P inference
• Voice activity detection (Silero-VAD support)
• Integrated WebUI!