Back to Directory

AnythingLLM

The all-in-one local AI stack for RAG and desktop use.

WebsiteInstall

Overview

AnythingLLM is a full-stack application that transforms documents into intelligent workspaces. It supports RAG (Retrieval Augmented Generation) out of the box and can connect to various local backends like Ollama and LM Studio.

Capabilities & Support

text
vision
audio
image
video

Popular Models

Model NameTypeSizeBest For
AnythingLLM Native
text
-Proprietary fast inference for immediate use.
Ollama Connector
textvision
-Connect to Ollama to use any model from the Ollama library.

Installation Guide

1

Installation

Download the executable from useanything.com and run the installation wizard.

2

Choose Desktop mode

On first launch, choose the Desktop version for local-only operation without needing a Docker setup.

3

Select LLM Provider

You can use the built-in provider or connect to your local Ollama instance in the settings.