17 lines
816 B
Markdown
17 lines
816 B
Markdown
# LocalAI
|
|
**LocalAI** is a free and open-source alternative to OpenAI. LocalAI serves as a replacement REST API, compatible with OpenAI (Elevenlabs, Anthropic, etc.) API specifications, for local AI inference. It allows you to run LLMs, generate images, audio (and more) locally or using consumer-grade hardware, supporting various model families. No GPU is required.
|
|
|
|
## Key Features:
|
|
- Generate text using GPT (llama.cpp, transformers, vllm, etc.)
|
|
- Text-to-audio conversion
|
|
- Audio-to-text transcription (with audio transcription via whisper.cpp)
|
|
- Image generation
|
|
- OpenAI-like tools API
|
|
- Embedding generation for vector databases
|
|
- Constrained grammar
|
|
- Download models directly from Huggingface
|
|
- Vision API
|
|
- Re-ranking API
|
|
- P2P inference
|
|
- Voice activity detection (Silero-VAD support)
|
|
- Integrated WebUI! |