Hi everyone! I'm James, one of the founders of Trigger.dev.
Quick context if you haven't come across us: Trigger.dev is a platform for developers to build and run AI agents and workflows in TypeScript. Open source, Apache 2.0, no timeouts, and you can see every run in the dashboard.
Today I'm excited to launch chat.agent, a backend for AI chat apps.
Why we built it
Chat agents are usually built on a request/response endpoint, which is a bad fit. You get a timeout you have to work around and no memory between turns. So you write everything to Postgres, add Redis so the stream survives a refresh, and push the slow work onto a queue that you then have to coordinate. That's a lot of plumbing before your agent does anything interesting.
chat.agent gives every conversation its own machine instead. It lives for the whole conversation, sleeps when nobody's typing, and wakes up where it left off.
What that gets you:No timeouts. In our production data 1 in 20 turns runs longer than 36 minutes, and that's fine.Refresh mid-response and the stream picks up where your browser stopped reading. Close the tab, come back days later, it's still there.Memory between turns is just variables. The sub-agent you spawned four questions ago is still there tomorrow.Waiting is free. Pause for a human approval overnight and you're not billed for the wait.Tracing and per-turn cost and token metrics, with nothing to set up.Works with the AI SDK you already use. streamText on the server, useChat on the client, and the API route between them goes away.It's been running in production since June, including at Arena.ai, and has handled millions of sessions and 84 years of compute so far.
I'd love to hear how you're handling this today, and if you've built durable chat by hand? I'll be in the comments all day.
Thanks!
Full technical writeup if you want the details:
https://trigger.dev/changelog/chat-agent
And the repo, Apache 2.0 and self-hostable:
https://github.com/triggerdotdev/trigger.dev
PH 用户
We’ve been a Trigger customer since their early days. A+ team. Congrats on the launch guys!
PH 用户
announced earlier this week, the @Trigger.dev team is riding the tailwinds today on @Product Hunt. S/O for this new launch, OSS ftw!
Quick context if you haven't come across us: Trigger.dev is a platform for developers to build and run AI agents and workflows in TypeScript. Open source, Apache 2.0, no timeouts, and you can see every run in the dashboard.
Today I'm excited to launch chat.agent, a backend for AI chat apps.
Why we built it
Chat agents are usually built on a request/response endpoint, which is a bad fit. You get a timeout you have to work around and no memory between turns. So you write everything to Postgres, add Redis so the stream survives a refresh, and push the slow work onto a queue that you then have to coordinate. That's a lot of plumbing before your agent does anything interesting.
chat.agent gives every conversation its own machine instead. It lives for the whole conversation, sleeps when nobody's typing, and wakes up where it left off.
What that gets you:No timeouts. In our production data 1 in 20 turns runs longer than 36 minutes, and that's fine.Refresh mid-response and the stream picks up where your browser stopped reading. Close the tab, come back days later, it's still there.Memory between turns is just variables. The sub-agent you spawned four questions ago is still there tomorrow.Waiting is free. Pause for a human approval overnight and you're not billed for the wait.Tracing and per-turn cost and token metrics, with nothing to set up.Works with the AI SDK you already use. streamText on the server, useChat on the client, and the API route between them goes away.It's been running in production since June, including at Arena.ai, and has handled millions of sessions and 84 years of compute so far.
I'd love to hear how you're handling this today, and if you've built durable chat by hand? I'll be in the comments all day.
Thanks!
Full technical writeup if you want the details:
https://trigger.dev/changelog/chat-agent
And the repo, Apache 2.0 and self-hostable:
https://github.com/triggerdotdev/trigger.dev