← All thoughts
AI LLMs

Tool Calling

The gap between “this model supports function calling” and “this model reliably uses function calling in production” is enormous. Spent the week investigating tool-based RAG for Edge-RAG and the smaller models (Phi-3.5, Mistral) still struggle with knowing when to call a tool vs just answering from context.