Working with a machine: from a request to an agent
How to set a machine a task, hand it real work, limit what it may touch and check the result, even if you have never programmed.
A course for people who have tried chatbots and want work from them, not text that resembles work. You will learn to set a task, give context and examples, decide what can be handed over, limit what an agent may do and check what it did. The course “AI: from symbols to agents” explains what is inside a model; this one is about the craft, and it takes no programming.
So far there is only this table of contents. Lessons appear one at a time, and we promise no dates. Feed of new lessons (Atom)
18 lessons, 4 parts
Part 1 A good request
A request to a machine works like a brief to a person: the more exact the task, the less the model fills in for you.
- coming soon
A brief, not a question
Who it is for, what should come out and how you will know it is right: without these, the model decides for you.
- coming soon
What the machine does not know about you
A model sees only what you gave it: which documents and circumstances to attach, and which only get in the way.
- coming soon
Show it, do not describe it
One good sample and one bad often explain a format better than a paragraph of instructions, though a model may copy their accidental traits too.
- coming soon
Standing instructions
Project settings and a rules file: what is worth writing down once, and why an overlong rulebook stops working.
- coming soon
What to do with a bad answer
Refine it, start over or change the approach: how to tell that a conversation has hit a dead end and is only piling up mistakes.
Part 2 What to hand over
The main decision comes before the first prompt: whether this work should go to a machine at all, and in what pieces.
- coming soon
The jagged frontier
Where a model clearly helps, where it quietly lets you down, and how to find that jagged line in your own work.
- coming soon
Hand over what you can check
A working rule: a task fits if judging the result costs less than doing it yourself, and you know what an unnoticed mistake would cost.
- coming soon
Cutting a big job into pieces
How to divide work into steps with intermediate results, so that a mistake surfaces at step two, not in the finished report.
Part 3 A machine that acts
An agent does not answer, it acts: it gets permissions, and those are your responsibility.
- coming soon
Briefing an agent
What to add to an ordinary request when the worker will take a hundred steps without you: a definition of done, the limits, and when to stop and ask.
- coming soon
What permissions to give
Reading, writing, sending, paying: how to grant an agent the minimum, keep a copy, and decide in advance what it will not touch.
- coming soon
Someone else’s orders in your inbox
An email or a web page can give orders to your assistant: what prompt injection looks like from the user’s side, and what to do about it.
- coming soon
Three kinds of access that do not mix
Private data, untrusted content and a way to send things out: the mix Simon Willison named the lethal trifecta, and what to remove if you have built it.
Part 4 Checking and supervising
Work is done when you have seen it yourself, not when the machine says so.
- coming soon
A report is not proof
A model will confidently write “all done” about work it did not do, so ask for what you can see yourself: a file, a link, a result on a known case.
- coming soon
How to review work you did not do
Spot checks, test cases and a second model as a reviewer: how to spend your attention when you cannot read everything.
- coming soon
A written workflow: noetic-harness
NoeticEcho’s open project holds agents to written workflows and refuses a step with no evidence: what to carry over even if you write no code.
- coming soon
One person, many agents: control-room
What changes when there are several workers: conflicts over the same files, and your attention as the narrowest point, seen in an open project.
- coming soon
What an agent should remember
Notes, rules files and libraries such as Reminisce: what to write down for next time, and how a stale note turns into a mistake.
- coming soon
A look ahead: from tasks to oversight
If agents keep working longer without a person watching, which skills gain value, and how to tell what is real from what is only promised.