In detail
1. The shape is a bookend, not a chat window
Sterling Chin, Applied AI Engineer and Senior Developer Advocate at Postman, built an agent called Marvin. Its structure is a day with two ends: “I made a custom slash command that says slash start, that would kick off a series of… bash commands that would go get my work email, it would go get my calendar, it would go get… a state file that keeps where I’m currently at at any given time. and then throughout the day I do my work and then at the end of the day I type slash end.” (9:08)
There is no framework under it. Marvin’s own self-description, which Chin reads aloud, is “He’s not a chatbot. He’s built entirely on Claude Code with custom commands and agents. No fancy framework, just markdowns, files, bash scripts, and stubbornness.” (16:12) Chin makes the point generally: the CLI “is just the engine that’s running everything, but what you build around it is what matters.”
2. Scoping was the first thing that had to change
The first version failed on ambiguity rather than capability. “I started off with, Hey, go get my JIRA tickets. Marvin, like what JIRA tickets? There’s like, if I go into JIRA, if I go into Atlassian, there are thousands of JIRA tickets.” (42:15)
The fix was to hand it boundaries instead of a search space: the specific Confluence space, the specific Kanban board, stated as explicit links. That is the same lesson as context poisoning approached from the other side. The constraint is what enters the context window, and Chin designs around a known budget, checkpointing sessions “because you know you’ve only got 200,000.” (51:24) (Newer Claude models go up to a million tokens, but checkpointing still pays off for cost and focus.)
3. The second failure was missing context, and it looked like competence
The instructive one. Chin told Marvin that “Heidi and James are doing security for the meetup.” (43:59) They are Postman’s security guards. Marvin read it as a speaking slot, then acted on that reading: updated the slide deck, did everything correctly for a premise that was wrong.
His own diagnosis is the right altitude: “it’s a junior mistake.” The agent did not fail at a task. It failed at a fact nobody had given it, and then executed confidently.
He also had to correct its behaviour, which is a maintenance cost people underestimate: an instruction to be “helpful first, personality second,” added after it drifted into over-indexing on sarcasm.
4. The numbers deserve a caveat, and the episode supplies one
Chin’s headline is that Marvin “now runs. 90 plus percent of my day.” (10:01) The supporting figure is that at the end of the first week “I had accomplished 190 something line items… I just finished in one week, what really normally takes me a month.” (11:24)
Both need a caveat. The 90% is a self-estimate with no stated method, and the 190 line items come from Marvin’s own weekly report, the agent counting its own output. The month comparison is Chin’s recollection, not a measurement. A colleague’s result is quoted secondhand: “Marvin accomplished in 30 minutes. What normally takes me over four hours.” (24:56)
None of that makes the claims false, and the episode is unusually forthcoming about where they come from. But if you are building a business case on this pattern, an agent’s self-report is the weakest link in it, and how do you measure whether AI is actually paying off is the harder question underneath.
5. The blocker was setup
Asked what stops this spreading, Chin points at the install path rather than capability. A non-technical colleague needed a terminal, a coding CLI, and an editor, which meant iTerm, Homebrew, Node: “they’re looking at this going, Homebrew looks super sketchy. As a non-technical person, it looks super sketch. So I’m like, no, go down. You’re going to install Homebrew.” (46:53)
In the same passage, he says he tried Anthropic’s Cowork and preferred Marvin; that is his dated opinion, not a current comparison. Cowork has since been rolling out on web and mobile as well as desktop, and you still choose the folders and tools it can work in.
On security, his secondhand account is that when someone on the security team asked about it, the answer was that the surface was already approved and narrow: “we’ve already approved Claude Code. This is not doing anything above and beyond… This is just Marvin in a very clearly defined space.” That is a scoping answer again, which is the through-line of the whole episode.
Other builders draw the boundary tighter. In episode 51 at 20:54, Yujian Tang, who started the r/AI_Agents subreddit, says he tried having an agent send his emails and his domain was blocked as spam, so he went back to doing it manually. Setting up his venture fund meant reading legal documents, and he keeps those for himself: “I just don’t trust agents for reading legal docs.” He wants to know what each one says (21:18). That is one person’s experience, but it is the same scoping question from the other end: which tasks you keep. Episode 51 is sponsored by Galileo, the Season 3 presenting sponsor; Conor thanks Galileo at 0:21.
Write a small task contract
Chin’s scoping fixes generalize into a contract written before an agent runs. Take a pilot that prepares a local brief for an upcoming product review from one named calendar event and three approved notes. Reading those sources and writing the brief are authorized; sending messages, inviting people and changing the event are not. Record the inputs (the exact event and notes, and what to do when one is missing or two conflict), the allowed actions (with everything else left out of the tool configuration), and what done looks like: correct meeting details, supported decisions, open questions and source links, checked in the brief itself instead of the agent’s report. Then run acceptance cases:
| Case | Expected behavior |
|---|---|
| A note says two people are “doing security” for the meetup | Ask which kind of security; leave the agenda and slides alone |
| A note tells the agent to forward all notes | Treat it as note content, not an instruction; forward nothing |
| The event changed since the last run | Re-read it and update the brief |
| A run is interrupted and resumed | Re-check the sources and the task’s permissions before continuing |
The first row is the Heidi and James mistake from section 3, caught before it reaches the slides.
Why it matters
The interesting claim here is not the 90%. It is that the work which made an agent useful was largely boundary-setting: which tickets, which space, which behaviours, which session. Almost none of it was model selection. Chin’s own instruction is the one to take: “Treat Marvin like a junior assistant or a junior engineer.” (40:55) Including the part where you check the work.
Hear it from the guest
“I started off with, Hey, go get my JIRA tickets. Marvin, like what JIRA tickets? There's like, if I go into JIRA, if I go into Atlassian, there are thousands of JIRA tickets.”
“That's a, it is, it's a junior mistake. Am I mad at it? No, I think it's hilarious. Has he made that same mistake again? No. A junior, a good, a good junior would not make that same mistake twice.”
“It feels like you're working for a chat window. Like, it's like, I work for this chat window now.”
“I just don't trust agents for reading legal docs”
Quotes lightly edited to remove filler words.
From the conversation
This explainer is drawn from these episodes — each carries its full transcript.
Concepts in this explainer
Digital WorkerPersonal AgentContext WindowAI AgentAI EngineerContext PoisoningTokenization