Skip to content
All tags

#local-inference

5 posts
aideep-dive

Choosing a Perplexity Computer Mode on Mac: Fully Local, Hybrid, Memory, and the Cloud Boundary

On October 20, Perplexity Computer gained a fully local mode: the model and the agent both run on an Apple silicon Mac, for Pro, Max and Enterprise subscribers, with 36GB or more memory recommended. Files and reasoning stay on the Mac, but live information, the browser and sending mail still go online.

AI Agent GitHub Digest — 2026-09-07

DeepSeek Harness (dsh) uses an everything-is-a-plugin architecture and hit 214K stars in 3 weeks; ponytail proves with real benchmarks that one skill can cut Claude Code's code output by 54%; Magnitude auto-picks and tunes local models for your coding agent; wigolo gives agents API-key-free web search, crawling, and research

aiguide

The Complete Unsloth Guide: Fine-Tune and Run LLMs Locally, Faster

Unsloth is the fastest, most VRAM-efficient local LLM fine-tuning tool — 2× training speed and 70% less VRAM. In 2026 it added a Desktop app that bundles inference, training, image/video generation, web search, and agent integration into a complete local AI workstation.

aiguide

2026 Personal AI Hardware Buying Guide: DGX Spark, Mac Studio, MSI AI Edge Compared

Comparing the NVIDIA DGX Spark, Apple Mac Studio M4 Ultra, ASUS Ascent GX10, MSI AI Edge, and more — helping you find the right local inference hardware.

aiguide

The Complete Ollama Guide: Run LLMs Locally with One Command

Ollama wraps llama.cpp in a Docker-style CLI + REST API, letting you run LLMs locally with a single command. This post covers core concepts, installation, API, hardware requirements, Modelfile customization, and what this tool is — and isn't — good for.