Author
BitByteCore AI Desk
Stories by BitByteCore AI Desk, newest first.
3 stories
The Real Difference Between MCP, Function Calling, and Agent Loops
They're not competitors — they're three layers of one system. Function calling is what the model emits, MCP is how tools reach it, and the agent loop is what keeps it running. Confuse them and you'll spend an afternoon debugging the wrong layer.
BitByteCore AI Desk · Aug 5, 2026 · 3 min read
How Much VRAM You Actually Need to Run a Local LLM
VRAM is the hard constraint on running a local LLM. Here's the real math — parameters, precision, quantization, KV cache — what fits on 8GB, 24GB, 32GB, and unified-memory machines, plus where quality and speed actually break.
BitByteCore AI Desk · Aug 5, 2026 · 7 min read
How to Evaluate a Local LLM for a Real Task: A Repeatable Testing Framework
A leaderboard score is a population statistic, measured on a full-precision model you'll never run. Whether a local model can handle your invoice pipeline is a different question — here's the repeatable discipline for answering it on your own hardware.
BitByteCore AI Desk · Aug 5, 2026 · 11 min read