pluja
/
awesome-privacy
mirror of https://github.com/pluja/awesome-privacy.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

Add Shimmy - Privacy-focused AI inference server 

- Python-free Rust implementation for maximum security
- OpenAI-compatible API for drop-in ChatGPT replacement
- Self-hosted on-premises deployment keeps data private
- Zero cloud dependencies protect user privacy
- GGUF + SafeTensors support for modern LLM serving
This commit is contained in:
Michael A. Kuykendall 2025-10-09 16:47:22 -05:00
parent 495ae38a54
commit d95852777d
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@ -259,6 +259,7 @@ When using cloud-based AI services, the data you input is often collected and st
- [Jan](https://github.com/janhq/jan) - Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
- [LocalAI](https://github.com/go-skynet/LocalAI) - Self-hosted, community-driven simple local OpenAI-compatible API written in go. Can be used as a drop-in replacement for OpenAI, running on CPU with consumer-grade hardware.
- [ollama](https://github.com/jmorganca/ollama) - Get up and running with Llama 2 and other large language models locally.
- [Shimmy](https://github.com/Michael-A-Kuykendall/shimmy) - Python-free Rust inference server with OpenAI-compatible API for private on-premises AI without cloud dependencies.
#### Copilot