Jan
Run Local LLMs with Jan
An open-source ChatGPT alternative that runs 100% offline. Clean UI, local model management, and extensible via plugins.
macoswindowslinux
Install Jan
Download Jan from jan.ai. Available for macOS, Windows, and Linux. Jan is open-source (AGPLv3) and stores all data locally.
Download a Model
Open the Hub tab to browse recommended models. Jan shows download sizes and compatibility notes. You can also import custom GGUF models by dragging them into the app.
Start Chatting
Select a model and start a new conversation. Jan supports system prompts, temperature settings, and multiple conversation threads. All conversations are stored locally on your machine.
Local API Server
Jan includes a built-in API server compatible with the OpenAI format. Enable it in Settings > Advanced to expose an API at http://localhost:1337/v1.