
LLM & Integration19 min
Claude Inline Tools Beta: What Actually Ships (2026)
Claude's inline tools beta adds tools mid-conversation without busting the prompt cache. I traced exactly when each SDK shipped it, wire format included.
in this category
Large language models, ChatGPT, Claude, GPT-4, prompt engineering, and LLM integration patterns
58 posts
Page 1 of 5

LLM & Integration19 min
Claude's inline tools beta adds tools mid-conversation without busting the prompt cache. I traced exactly when each SDK shipped it, wire format included.

LLM & Integration17 min
Claude Opus 5.5 rejects forced tool_choice with a 400. I captured what the AI SDK, LangChain and the raw SDK actually send, and built a preflight check.

LLM & Integration14 min
MCP's July 28, 2026 spec goes stateless and ships Enterprise-Managed Authorization. Here's what changes, what breaks, and new security risks to plan for.

LLM & Integration17 min
Build a semantic cache for LLM calls with Redis 8's native VADD/VSIM vector sets in Node.js and TypeScript — cache hits on paraphrases, not just exact text.
LLM & Integration12 min
Cosine similarity vs dot product for embeddings, with runnable TypeScript. Learn when to normalize, why they match for unit vectors, and which to pick.
LLM & Integration16 min
Token-aware text chunking for RAG in TypeScript: recursive splitting with @langchain/textsplitters and js-tiktoken, plus chunk size and overlap tuning.
LLM & Integration17 min
Count OpenAI tokens in TypeScript with gpt-tokenizer - no WASM, no API key. Count chat messages accurately and trim history to fit the model context window.
LLM & Integration15 min
Unit-test Vercel AI SDK v6 code in TypeScript with MockLanguageModelV3 - no API key, no cost. Mock generateText, tool calls, and streaming in Vitest.
LLM & Integration15 min
When the US government pulled Claude Fable 5 offline, single-provider apps broke. Build a multi-provider LLM fallback chain that survives a model recall.
LLM & Integration10 min
Build smarter apps with the OpenAI API: chat completions, vision, embeddings, function calling, and assistants. Patterns, runnable code, and real cost tips.
LLM & Integration10 min
Vibe coding: Andrej Karpathy's AI-assisted dev approach — describe what you want in plain English, let the model write the code. When it works vs. not.
LLM & Integration10 min
AI study tools 2026: ChatGPT, Gemini, Perplexity, Claude, Notion AI, Wolfram Alpha, Otter.ai, NotebookLM. Which tool wins for research, notes, and review.