AnythingLLM

About

AnythingLLM is a free, open-source AI assistant that runs entirely on your device, with no accounts, API keys, or token limits required. Every document you add becomes part of your agent's knowledge base without any data leaving your computer. Setup is quick: download the app, pick a model or let AnythingLLM recommend one for your hardware, and start chatting with your documents, doing research, and building workflows locally.

The app also includes a Meeting Assistant that transcribes and summarizes meetings on your computer without bots joining your calls or any cloud processing. It produces summaries, action items, and full transcripts. Magic Features add an on-device dictation experience that refines your speech in real time and can understand what you're looking at for more precise answers.

AnythingLLM is MIT licensed and can be self-hosted as a multi-user deployment on your own servers, or used as a desktop app on macOS, Windows, and Linux. A mobile version for Android is also available.