How LLM Function Calling Actually Works — From Tokens to Tool Orchestration

1Key Takeaways

• Cross-posted here with a canonical link.
• When you ask an LLM "Compare the weather in Tokyo and Berlin," what actually happens?
• The model can't browse the internet — but it can decide to call a weather API.
• This article covers how function calling works, how the LLM returns structured data despite generating tokens one by one, and what happens when the model needs to orchestrate multiple tool calls to answer a single question.