AirLLM: Run 70B LLMs on a Single 4GB GPU (Fast Look)

Ever been told your 4GB GPU can’t run anything serious? Yeah, me too. But every local-LLM guide says “you need at least 16GB VRAM for a 7B model,” and my RTX 3050 laptop is sitting here calling that a lie. Turns out the model card might be wrong — not the hardware. So AirLLM (25.2k stars, Apache-2.0) runs a full 70B Llama on a single 4GB card, no quantization tricks, and it crossed the Trending list again this week. ...

August 2, 2026 · 5 min · GitHubDigger

jcode: RAM-Efficient AI Agent Harness Trending Fast (2026)

Every serious coding agent has the same dirty secret: idle it in the background and it chews through RAM like it’s free. I’ve had Claude Code, Cursor, and Codex all parked at once on my Ryzen workstation, and by the end of a long session my memory graph looked like a ski slope. jcode — 14,795 stars and climbing fast at +812 today — is a Rust harness that treats RAM like a budget instead of an unlimited line of credit. Still, the numbers it posts aren’t marketing fluff; I watched them happen live. ...

August 1, 2026 · 5 min · GitHubDigger

agentacct Review: Track Your AI Coding Agent Costs (2026)

Three hours into a refactor session, Claude Code had rewritten half my project. It felt productive. And it also felt like watching money leave my account through a window I couldn’t see through. But the terminal kept churning out files, running tests, calling tools — ask me what that session actually cost, or which of those changes were even verified, and I’d have shrugged. That’s the exact gap agentacct (537 stars in its first week, MIT, Python) is built to close: a local-first dashboard that joins your agent’s token bill to its work log, on one screen, on your machine. ...

July 31, 2026 · 8 min · GitHubDigger

OpenWork: The Open-Source Claude Cowork Alternative (2026)

Every AI-agent ecosystem has the same bottleneck: your skills, MCP servers, and connected services live locked inside whichever agent you happened to open. Switch from Codex to Cursor and you start over. OpenWork wants to be the layer that travels with you. It’s an open-source desktop app — an alternative to Claude Cowork — but the part that got me is the MCP server, because that works in the agents you already have. ...

July 31, 2026 · 4 min · GitHubDigger

Deltafin: Running Kimi K3 (2.78T MoE) on a Single Workstation

Disclosure: Some links below are affiliate links. If you sign up through them, I may earn a commission at no extra cost to you. Vultr — high-memory cloud GPU instances from $6/mo DigitalOcean — $200 credit for new users, great for GPU droplets So Kimi K3 dropped two days ago and instantly became the most exciting open-weight model release this month — 7,300+ stars, 2.78 trillion parameters in a Mixture-of-Experts architecture, multimodal. Problem: nobody has a cluster sitting around to serve it. Enter Deltafin, a research project that does exactly what its README says: “runs a Mixture-of-Experts model far larger than the machine it sits on.” I spent the evening digging through its codebase, and honestly? The ambition matches the execution. ...

July 30, 2026 · 5 min · GitHubDigger

Numbat Review: Agent Activity Monitor From Perplexity AI

Ever had an AI coding agent go rogue — read a file it shouldn’t, fire off an API call you didn’t approve, or quietly delete something important? Yeah, me too. That moment when you realize your Claude Code session silently touched /etc/passwd or your Codex agent issued a curl to an IP you’ve never seen before — you can’t prove it, you can’t stop it, and you definitely can’t go back and figure out what happened. At least, you couldn’t until last week. Perplexity AI just open-sourced numbat, and it changes the game. ...

July 30, 2026 · 7 min · GitHubDigger

Qwen Audio Agent Review: Full-Duplex Voice for AI Agents

Your AI agent works in silence. That’s the problem. I’ve been running coding agents for months — Claude Code, Codex, custom toolchains. But every interaction goes through a terminal: type a command, wait, read the response, type again. Yet it works, but it’s glued to a desk. Last week I had a stretch of manual work in my workshop — soldering a new sensor board — and I thought: why can’t my agent just talk to me while I work? ...

July 30, 2026 · 9 min · GitHubDigger

OptMem Review: I Gave My AI Agent Permanent Memory

Ever spent a full afternoon debugging a data pipeline, only to fire up Claude Code the next morning and watch it ask the same questions you answered yesterday? Yeah, me too. But your coding agent treats every fresh claude command like its first day on the job — zero context, zero memory, zero clue about the fix you spent three hours finding yesterday. I’ve tried a few solutions. But vector databases are overkill for what should be a simple problem. And Docker-based memory stacks add complexity when all I want is my agent to remember the bug I fixed at 4 PM. ...

July 29, 2026 · 7 min · GitHubDigger

FastCtx: Stop Wasting Your Agent's Brain on Tool Mechanics

My Codex just spent 4 tool calls reading one file. But it had to construct a shell command to grep for a symbol, handle the escape quoting, pipe through head to paginate, then read the file with the right line range — all before it could actually do something useful. But that’s 3–5 tool calls per file operation, and every one burns context budget that should be going toward understanding my code. ...

July 28, 2026 · 9 min · GitHubDigger

OptMem: Permanent Agent Memory in 426 Tokens (Fast Look)

Every AI agent has the same problem — wake up in a new session and it’s amnesia all over again. But you told it about your project structure, your preferences, yesterday’s debugging log. Gone. So OptMem from VictorTaelin (687★, released July 25) fixes this with a 426-token prompt block you paste into your AGENTS.md. That’s it. What Makes OptMem Different Here’s the thing: OptMem is not a vector database. It’s not a knowledge graph either. Nor is it another MCP server. It’s a single Python file (~/.optmem/memo) with zero dependencies that manages persistent memory for any AI agent. The trick? The tool encodes everything into a structured prompt block the agent reads at session start. The tool lives on disk while the “memory” lives in the conversation. But it’s a design philosophy so minimal it almost feels like cheating. ...

July 28, 2026 · 4 min · GitHubDigger