Here is how I moved my entire AI Workflow Offline: Obsidian + LM Studio + Local LLM Plugins
There was one moment that changed everything for me. I had just pasted a confidential client brief into Claude to help me rewrite it. It took three seconds to get a great result. Then I sat there and thought about where that brief just went. A server. Somewhere. Trained on.
That was the day I decided to move my entire AI workflow offline.
The Stack
Obsidian — knowledge base and interface layer.
LM Studio — free desktop app that runs LLMs completely offline. Runs a local server at http://localhost:1234 with the same API format as OpenAI. Any tool connecting to OpenAI can connect to local model instead.
Local LLM Plugins — bridge between Obsidian and LM Studio.
LM Studio Setup
Download from lmstudio.ai. Recommended starting models:
- Mistral 7B — fast, runs on most laptops
- Llama 3 8B — excellent all-round for notes and writing
- Phi-3 Mini — lightweight, great for older machines
- DeepSeek Coder — best for code
Hardware reality: M1/M2/M3 MacBook runs 7B–13B smoothly. 16GB RAM Windows/Linux runs 7B well. 32GB + GPU handles 13B–34B.
Obsidian Plugins
Smart Connections (most important): Creates embeddings of every vault note → semantic search → grounded answers using only your content. Set API base URL to http://localhost:1234/v1.
BMO Chatbot: Full chat interface inside Obsidian connected to local model. Feels like Claude/ChatGPT but fully local.
Copilot: Inline assistant for selected text — summarize, expand, rewrite, improve. Slash commands inside notes.
Mini-RAG Pipeline
RAG (Retrieval-Augmented Generation): AI searches documents and answers grounded in specific content rather than guessing from training data.
Pipeline:
- Smart Connections creates local embeddings of every note
- Question → finds most semantically similar notes
- Passes those notes as context to local LM Studio model
- Model generates answer from actual vault content
- Everything on-device. Nothing leaves.
Three Work Modes
| Mode | Tools | When |
|---|---|---|
| Deep work (fully offline) | LM Studio + Smart Connections | All sensitive knowledge work |
| Research/writing (hybrid) | Obsidian local + Claude via API | Complex reasoning, rewrites |
| Confidential (strict local) | LM Studio only | Client work, financial notes |
Honest Assessment
Frontier cloud models (Claude, GPT-5) still more capable for complex reasoning and creative tasks. Local AI is about privacy, not capability replacement.
“The cloud is powerful. But your most important thinking deserves to stay on your machine.”