> ## Documentation Index > Fetch the complete documentation index at: https://trigger.dev/docs/llms.txt > Use this file to discover all available pages before exploring further. # Fast starts > Two ways to cut first-turn TTFC: Preload eagerly triggers the run before the first message; Head Start runs step 1 in your warm server while the agent boots in parallel. The AI Agents and Prompts surface ships as part of the **v4.5 release candidate**. Install with `@trigger.dev/sdk@rc` (or pin `4.5.0-rc.0` or later) to use these features — they aren't yet on the latest stable, and APIs may still change before the 4.5.0 GA. See [supported AI SDK versions](/ai-chat/reference#compatibility) and the [AI chat changelog](/ai-chat/changelog) for details. The first turn of a brand-new conversation pays for the chat.agent run's cold start: dequeue, process boot, `onPreload` / `onChatStart` hooks, and only then the LLM call. Two features address this from different angles. ## Picking an approach | | [Preload](#preload) | [Head Start](#head-start) | | ---------------------------------- | -------------------------------------------------- | ----------------------------------------------------------------------------- | | **What it does** | Eagerly triggers the run before the first message | Runs step 1's LLM call in your warm process while the agent boots in parallel | | **First-turn TTFC win** | Hides agent boot if the user *does* send a message | \~50% reduction (LLM TTFB floor); boot fully overlaps with TTFB | | **When to fire** | Page load / input focus — your call | First message arrival — automatic | | **Cost when user never sends** | Idle compute until the preload window times out | Zero (no run was triggered) | | **Requires a warm server process** | No — works for browser-only surfaces | Yes — your route handler runs step 1 | | **Requires LLM keys client-side?** | No | No — keys stay in your warm server | | **Bundle constraints** | None | Route handler must import schema-only tools (no heavy executes) | **Pick one, not both.** Running both for the same chat is wasted work — Head Start gates on a real first message, so adding Preload on top eats the idle-compute cost Head Start was avoiding. **Use Preload** when the chat surface is browser-only, when you don't have a warm Node/Bun/Edge process serving the page, or when you can confidently predict the user *will* send a message (the run never goes idle). **Use Head Start** when the chat lives behind a warm server (Next.js App Router, Hono, SvelteKit, Workers, etc.) and you want first-turn TTFC down at the LLM TTFB floor without any speculative run. *** ## Preload Preload eagerly triggers a run for a chat before the first message is sent. Initialization (DB setup, context loading) happens while the user is still typing, reducing first-response latency. ### Frontend Call `transport.preload(chatId)` to start a run early: ```tsx theme={"theme":"css-variables"} import { useEffect } from "react"; import { useTriggerChatTransport } from "@trigger.dev/sdk/chat/react"; import { useChat } from "@ai-sdk/react"; export function Chat({ chatId }) { const transport = useTriggerChatTransport({ task: "my-chat", accessToken: ({ chatId }) => mintChatAccessToken(chatId), startSession: ({ chatId, clientData }) => startChatSession({ chatId, clientData }), clientData: { userId: currentUser.id }, }); // Preload on mount: run starts before the user types anything. // Trigger config (idleTimeoutInSeconds, machine, tags) lives in the // server action that wraps `chat.createStartSessionAction`. useEffect(() => { transport.preload(chatId); }, [chatId]); const { messages, sendMessage } = useChat({ id: chatId, transport }); // ... } ``` Preload is a no-op if a session already exists for this chatId. Your `accessToken` callback receives `{ chatId }` and is invoked the same way on preload as on any other refresh — no special branching by purpose. See [TriggerChatTransport options](/ai-chat/reference#triggerchattransport-options). ### Backend The `onPreload` hook fires immediately. The run then waits for the first message. When the user sends a message, `onChatStart` fires with `preloaded: true` so you can skip work that already ran: ```ts theme={"theme":"css-variables"} export const myChat = chat.agent({ id: "my-chat", onPreload: async ({ chatId, clientData }) => { // Eagerly initialize: runs before the first message userContext.init(await loadUser(clientData.userId)); await db.chat.create({ data: { id: chatId } }); }, onChatStart: async ({ preloaded }) => { if (preloaded) return; // Already initialized in onPreload // ... fallback initialization for non-preloaded runs }, run: async ({ messages, signal }) => { return streamText({ model: anthropic("claude-sonnet-4-5"), messages, abortSignal: signal }); }, }); ``` With `chat.createSession()` or raw tasks, check `payload.trigger === "preload"` and wait for the first message: ```ts theme={"theme":"css-variables"} if (payload.trigger === "preload") { // Initialize early... const result = await chat.messages.waitWithIdleTimeout({ idleTimeoutInSeconds: 60, timeout: "1h", }); if (!result.ok) return; currentPayload = result.output; } ``` *** ## Head Start Head Start runs step 1's LLM call in your warm server process while the chat.agent run boots in parallel. The user sees one continuous turn: text first from your server, then a clean handover to the agent for tool execution and any further steps. `chat.headStart` returns a standard [Web Fetch API](https://developer.mozilla.org/en-US/docs/Web/API/Fetch_API) handler — `(req: Request) => Promise` — so it slots into any runtime that speaks Web Fetch. **Verified runtimes:** Node 18+, Bun, Deno, Cloudflare Workers, Vercel (Node and Edge), Netlify (Functions and Edge). The handler uses only `fetch` and Web `ReadableStream` / `TransformStream` (no `node:*` imports), and the S2 streaming dependency picks the right transport for each runtime automatically (HTTP/2 on Node/Deno, HTTP/1.1 on Bun/Workers/browsers). **Compatible frameworks (native Web Fetch):** Next.js App Router, Hono, SvelteKit, Remix, React Router v7, TanStack Start, Astro, Nitro/Nuxt, Elysia. Mount the handler directly. **Node-only frameworks (Express, Fastify, Koa):** the handler still works, but the framework gives you a Node `IncomingMessage` instead of a Web `Request`. Use a small adapter — examples in [Mounting in your framework](#mounting-in-your-framework) below. When the first turn is pure text (no tool calls), the agent run boots and exits without ever calling an LLM. You only pay for what the conversation actually needed. ### Measured TTFC 3 runs each, prompt `"say hi in five words"`, same model both sides (Anthropic Claude Sonnet 4): | | Without Head Start | With Head Start | Δ | | ------------ | ------------------ | --------------- | -------- | | TTFT (avg) | 2801 ms | **1218 ms** | **−57%** | | TTFT (range) | 2351–3101 ms | 1201–1252 ms | | | Total turn | 4180 ms | 2345 ms | −44% | With Head Start, time-to-first-text is essentially the LLM TTFB floor (50ms spread). Without it, agent boot + hooks stack before the LLM call, adding 750ms of variance. ### How it works ```mermaid theme={"theme":"css-variables"} sequenceDiagram autonumber participant B as Browser participant H as Route handler
(your warm server) participant T as chat.agent run
(Trigger.dev) B->>H: POST first message
(headStart URL) par Step 1 + agent boot in parallel H->>H: streamText step 1
(your model, schema-only tools) H-->>B: SSE: step 1 chunks and H->>T: createSession + trigger run T->>T: boot → wait on session.in end alt finishReason: tool-calls H->>T: handover signal
(partial assistant message) T->>T: execute tools, run step 2 LLM T-->>H: chunks via session.out H-->>B: SSE: step 2 chunks T-->>H: trigger:turn-complete else finishReason: stop (pure text) H->>T: handover-skip signal T->>T: exit (no LLM call) end H-->>B: SSE close Note over B,T: Subsequent turns bypass the handler:
browser writes directly to session.in ``` The transport sees `headStart: "/api/chat"` is set and there's no session yet for this chat. It POSTs the wire payload (messages, chatId, metadata) to your route handler. A single `apiClient.createSession` round-trip both creates the chat session and triggers an agent run with `trigger: "handover-prepare"`. The agent run boots into a wait state on `session.in`. `streamText` runs in your warm process with `stopWhen: stepCountIs(1)`. The output is streamed to the browser as SSE while the agent run boots in parallel. Boot time (\~488ms) overlaps with LLM TTFB (\~389ms), fully hidden. On step 1's `tool-calls` finish, your handler signals the agent and the SDK splices the agent's step-2+ stream into the same SSE response. On pure-text finish, your handler signals `handover-skip` and the agent run exits clean — no LLM call from the trigger side. After turn 1, the transport hydrates the session PAT from response headers and writes turn 2 onward directly to `session.in`. Same direct-trigger path as a regular `chat.agent` setup. ### Setup **Bundle isolation is the load-bearing constraint.** Head Start only saves time because your route-handler bundle stays lightweight. Anything you import in that handler — and anything those modules import transitively — lands in the bundle. If your tool catalog with heavy `execute` fns (E2B, Puppeteer, native bindings, the trigger SDK runtime, Turndown, image processing, `node:child_process`) ends up in the bundle, you've put cold-start back into a different process. This is an **import-chain** problem, not a runtime one. A "we'll strip the executes at runtime" helper would not fix it — bundlers resolve imports at build time. The only correct shape is to keep schemas in their own module that imports `ai` and `zod` only. Schemas in one module (light deps), executes in another (heavy deps). The agent task pulls in both; the route handler pulls in schemas only. ```ts lib/chat-tools/schemas.ts theme={"theme":"css-variables"} // ⚠️ This file MUST NOT import anything heavier than `ai` and `zod`. // Any import here lands in the route-handler bundle. import { tool } from "ai"; import { z } from "zod"; export const fetchPage = tool({ description: "Fetch a URL and return text", inputSchema: z.object({ url: z.string().url() }), // No execute — agent task adds it elsewhere. }); export const headStartTools = { fetchPage }; ``` ```ts trigger/chat-tools.ts theme={"theme":"css-variables"} // Heavy deps live here. Only the trigger task imports this module. import { tool } from "ai"; import TurndownService from "turndown"; import { fetchPage as fetchPageSchema } from "@/lib/chat-tools/schemas"; const turndown = new TurndownService(); export const fetchPage = tool({ ...fetchPageSchema, execute: async ({ url }) => { const res = await fetch(url); return { body: turndown.turndown(await res.text()) }; }, }); export const chatTools = { fetchPage }; ``` The agent uses the full tool set — these are the executes that run when step 2+ needs them. ```ts trigger/chat.ts theme={"theme":"css-variables"} import { chat } from "@trigger.dev/sdk/ai"; import { streamText, stepCountIs } from "ai"; import { anthropic } from "@ai-sdk/anthropic"; import { chatTools } from "./chat-tools"; export const myChat = chat.agent({ id: "my-chat", run: async ({ messages, signal }) => streamText({ ...chat.toStreamTextOptions({ tools: chatTools }), model: anthropic("claude-sonnet-4-6"), messages, stopWhen: stepCountIs(10), abortSignal: signal, }), }); ``` Call `chat.headStart({ agentId, run })`. It returns a standard Web Fetch handler: `(req: Request) => Promise`. Inside the `run` callback you call `streamText` yourself and spread `chat.toStreamTextOptions({ tools })` to inherit the SDK-owned wiring (messages, schema-only tools, `stopWhen: stepCountIs(1)`, abort signal). Add your own `model` and `system` on top. ```ts lib/chat-handler.ts theme={"theme":"css-variables"} import { chat } from "@trigger.dev/sdk/chat-server"; import { streamText } from "ai"; import { anthropic } from "@ai-sdk/anthropic"; import { headStartTools } from "@/lib/chat-tools/schemas"; export const chatHandler = chat.headStart({ agentId: "my-chat", run: async ({ chat: helper }) => streamText({ ...helper.toStreamTextOptions({ tools: headStartTools }), model: anthropic("claude-sonnet-4-6"), system: "You are a helpful assistant.", stopWhen: stepCountIs(15), }), }); ``` Use the **same model** on both sides (route handler and `chat.agent`) to avoid a tone or style shift between step 1 and step 2+. Your LLM provider keys stay server-side in your warm process — Trigger.dev never holds them in this design. Mount the handler in whatever framework you use — see [Mounting in your framework](#mounting-in-your-framework) below. Add `headStart: "/api/chat"` to `useTriggerChatTransport`. Subsequent turns bypass this URL automatically — `accessToken` and (optionally) `startSession` still run for the direct-trigger path on turn 2 onward. ```tsx components/chat.tsx theme={"theme":"css-variables"} const transport = useTriggerChatTransport({ task: "my-chat", accessToken: ({ chatId }) => mintChatAccessToken(chatId), startSession: ({ chatId, clientData }) => startChatSession({ chatId, clientData }), headStart: "/api/chat", }); ``` ### Mounting in your framework `chat.headStart` returns a Web Fetch handler — `(req: Request) => Promise`. Frameworks that natively pass Web `Request` objects mount it as-is. Node-only frameworks (Express, Fastify, Koa) need a small adapter. #### Web Fetch frameworks (recommended) ```ts Next.js (App Router) theme={"theme":"css-variables"} // app/api/chat/route.ts import { chatHandler } from "@/lib/chat-handler"; export const POST = chatHandler; // Default function timeout on Vercel is 10s. Bump if your turns // run long (multi-step tool use, slow models): // export const maxDuration = 60; ``` ```ts Hono theme={"theme":"css-variables"} // src/index.ts import { Hono } from "hono"; import { chatHandler } from "./chat-handler"; const app = new Hono(); app.post("/api/chat", (c) => chatHandler(c.req.raw)); export default app; ``` ```ts SvelteKit theme={"theme":"css-variables"} // src/routes/api/chat/+server.ts import type { RequestHandler } from "./$types"; import { chatHandler } from "$lib/chat-handler"; export const POST: RequestHandler = ({ request }) => chatHandler(request); ``` ```ts Remix / React Router v7 theme={"theme":"css-variables"} // app/routes/api.chat.ts import type { ActionFunctionArgs } from "@remix-run/node"; import { chatHandler } from "~/lib/chat-handler"; export async function action({ request }: ActionFunctionArgs) { return chatHandler(request); } ``` ```ts TanStack Start theme={"theme":"css-variables"} // app/routes/api/chat.ts import { createAPIFileRoute } from "@tanstack/start/api"; import { chatHandler } from "~/lib/chat-handler"; export const Route = createAPIFileRoute("/api/chat")({ POST: ({ request }) => chatHandler(request), }); ``` ```ts Astro theme={"theme":"css-variables"} // src/pages/api/chat.ts import type { APIRoute } from "astro"; import { chatHandler } from "../../lib/chat-handler"; export const POST: APIRoute = ({ request }) => chatHandler(request); ``` ```ts Nitro / Nuxt theme={"theme":"css-variables"} // server/api/chat.post.ts import { chatHandler } from "~/lib/chat-handler"; export default defineEventHandler((event) => chatHandler(toWebRequest(event))); ``` ```ts Elysia theme={"theme":"css-variables"} // src/index.ts import { Elysia } from "elysia"; import { chatHandler } from "./chat-handler"; new Elysia() .post("/api/chat", ({ request }) => chatHandler(request)) .listen(3000); ``` #### Edge / standalone runtimes ```ts Cloudflare Workers theme={"theme":"css-variables"} // src/index.ts import { chatHandler } from "./chat-handler"; export default { async fetch(req: Request): Promise { const url = new URL(req.url); if (req.method === "POST" && url.pathname === "/api/chat") { return chatHandler(req); } return new Response("Not found", { status: 404 }); }, }; ``` ```ts Bun (native server) theme={"theme":"css-variables"} // server.ts import { chatHandler } from "./chat-handler"; Bun.serve({ port: 3000, async fetch(req) { const url = new URL(req.url); if (req.method === "POST" && url.pathname === "/api/chat") { return chatHandler(req); } return new Response("Not found", { status: 404 }); }, }); ``` ```ts Deno (Deno.serve) theme={"theme":"css-variables"} // server.ts import { chatHandler } from "./chat-handler.ts"; Deno.serve({ port: 3000 }, async (req) => { const url = new URL(req.url); if (req.method === "POST" && url.pathname === "/api/chat") { return chatHandler(req); } return new Response("Not found", { status: 404 }); }); ``` #### Node-only frameworks Express, Fastify, and Koa pass Node `IncomingMessage` / `ServerResponse` objects rather than Web `Request` / `Response`. The SDK ships `chat.toNodeListener` that wraps any Web Fetch handler as a Node `(req, res)` listener — body bytes are read upfront, headers translated, the response body streamed chunk-by-chunk, and client disconnect is propagated to the handler via `AbortSignal`. ```ts Express theme={"theme":"css-variables"} import express from "express"; import { chat } from "@trigger.dev/sdk/chat-server"; import { chatHandler } from "./chat-handler"; const app = express(); app.post("/api/chat", chat.toNodeListener(chatHandler)); app.listen(3000); ``` ```ts Fastify theme={"theme":"css-variables"} import Fastify from "fastify"; import { chat } from "@trigger.dev/sdk/chat-server"; import { chatHandler } from "./chat-handler"; const fastify = Fastify(); const listener = chat.toNodeListener(chatHandler); fastify.post("/api/chat", (req, reply) => { // Hand the raw Node request/response to the adapter and tell // Fastify we'll handle the response ourselves (no auto-reply). reply.hijack(); return listener(req.raw, reply.raw); }); fastify.listen({ port: 3000 }); ``` ```ts Koa theme={"theme":"css-variables"} import Koa from "koa"; import Router from "@koa/router"; import { chat } from "@trigger.dev/sdk/chat-server"; import { chatHandler } from "./chat-handler"; const app = new Koa(); const router = new Router(); const listener = chat.toNodeListener(chatHandler); router.post("/api/chat", async (ctx) => { ctx.respond = false; // Tell Koa not to send the response itself. await listener(ctx.req, ctx.res); }); app.use(router.routes()).listen(3000); ``` ```ts Raw node:http theme={"theme":"css-variables"} import http from "node:http"; import { chat } from "@trigger.dev/sdk/chat-server"; import { chatHandler } from "./chat-handler"; const listener = chat.toNodeListener(chatHandler); http .createServer((req, res) => { if (req.method === "POST" && req.url === "/api/chat") { return listener(req, res); } res.statusCode = 404; res.end(); }) .listen(3000); ``` Don't run `express.json()` (or any body-parsing middleware) before the head-start route — it consumes the request body before `chat.toNodeListener` can read the raw bytes. Either skip the parser for this route, or scope it to other routes. #### Streaming response timeouts The handler keeps the SSE response open until the agent run signals turn-complete (or skip, on a pure-text turn). Make sure your framework / serverless function timeout accommodates that: * **Pure-text first turns**: \~LLM TTFB (1–3 s typically). * **Tool-calling first turns**: LLM step 1 + agent boot + tool execution + step 2 LLM call. Usually 5–15 s; longer for multi-step tool use. * **Vercel**: default function timeout is 10 s on Hobby, 60 s on Pro. Set `export const maxDuration = N;` on the route segment. * **Cloudflare Workers**: default 30 s CPU time (paid plans up to 5 min). Streaming wall time is generally not the bottleneck. * **AWS Lambda behind API Gateway**: 29 s API Gateway hard limit; Lambda Function URL allows up to 15 min. ### What gets routed where | | First turn (handover) | Subsequent turns | | ---------------------------------- | --------------------------------------------------------- | ---------------------------- | | Browser sends message via | POST to `headStart` URL | Direct write to `session.in` | | Step 1 LLM call runs in | Your warm process | Trigger.dev agent run | | Tool execution runs in | Trigger.dev agent run | Trigger.dev agent run | | Step 2+ LLM call runs in | Trigger.dev agent run | Trigger.dev agent run | | `onChatStart` / `onTurnStart` fire | After handover signal arrives | Normally | | `onTurnComplete` fires | After turn finishes (handover) or skipped (handover-skip) | Normally | ### The `chat.headStart` API ```ts theme={"theme":"css-variables"} chat.headStart({ agentId: string, // The chat.agent({ id }) you're handing off to run: (args: HeadStartRunArgs) => Promise>, idleTimeoutInSeconds?: number, // How long the agent waits for the handover signal. Default: 60 }): (req: Request) => Promise ``` The `run` callback receives: * `messages: UIMessage[]` — user messages parsed from the request body. * `signal: AbortSignal` — fires when the request closes or the SDK times out the handover. * `chat: HeadStartChatHelper` — exposes `chat.toStreamTextOptions({ tools })` and a `chat.session` escape hatch for power users. `chat.toStreamTextOptions({ tools })` returns options to spread into `streamText`. The SDK owns these keys — overriding them will break the protocol: | Key | What the SDK sets | Why | | ------------- | ------------------------------------ | ------------------------------------ | | `messages` | `convertToModelMessages(uiMessages)` | First-turn user history | | `tools` | What you pass | Schema-only tools for step 1 | | `stopWhen` | `stepCountIs(1)` | Step 1 only — agent picks up step 2+ | | `abortSignal` | Combined request + idle timeout | Safe cleanup on disconnect | You bring `model`, `system`, `providerOptions`, `prepareStep`, anything else `streamText` accepts. #### The transport option ```ts theme={"theme":"css-variables"} useTriggerChatTransport({ // ... task, accessToken, startSession, ... headStart?: string, // URL of your chat.headStart route handler }); ``` Optional. When set, the FIRST message of a brand-new chat (no existing session state) routes through this URL. Subsequent turns bypass it and use the direct-trigger path. This is **not** a stock `useChat` `endpoint` — it's not the canonical request URL for every turn, just the first-turn shortcut. ### Limitations * **First turn only.** Step 2+ and turn 2+ run on the trigger side. There's no per-turn "head start every turn" mode — the win comes from amortizing agent boot across the LLM call once. * **Single step on the warm-server side.** The handler runs `stopWhen: stepCountIs(1)`. Multi-step handover (handler does step 1 + step 2 + ...) is out of scope. * **Your server needs an LLM provider key.** The first-turn LLM call runs in your warm process, so that environment needs whatever keys the model requires. The agent's executes still run on the Trigger.dev side with whatever environment variables they need there. * **Browser-only chat surfaces don't apply.** Without a warm server process, there's nowhere to run step 1 ahead of the agent run. Use [Preload](#preload) or eat the cold-start tax. * **Streaming-capable runtime required.** Your framework / runtime has to support streaming HTTP responses (Web Fetch `Response` body or equivalent). Most modern hosts do — Next.js, Hono, SvelteKit, Workers, Bun, Deno, Vercel, etc. Some legacy platforms that buffer full responses won't deliver chunks until the turn is over, which negates the TTFC benefit (correctness still holds). * **Non-`useChat` chat surfaces** (Slack bots, Discord bots, custom protocols) don't fit the `chat.headStart` shape — the API expects the AI SDK transport's wire payload on input. For those, trigger the chat.agent directly from your bot handler. ## Reference * [`chat.headStart` factory and types](/ai-chat/reference) — full signatures for `HeadStartRunArgs`, `HeadStartChatHelper`, `HeadStartSession`, `HeadStartHandlerOptions`. * [`headStart` transport option](/ai-chat/reference#triggerchattransport-options) — alongside `accessToken`, `startSession`, etc. * [`onPreload` hook](/ai-chat/lifecycle-hooks#onpreload) — the backend hook that fires when a run is preloaded.