The Attention Queue: The Missing Layer in Every AI Agent Setup
Why Human-in-the-Loop Needs a Better Interface Than a Kanban Board
There’s a version of the AI agent future that looks like this: you describe what you want, agents go do it, and you come back to finished work. Fully autonomous, fully hands-off. It’s a compelling vision, and it’s the one that gets the most airtime in product demos and conference talks.
Then there’s the version most developers are actually living in 2026: you describe what you want, agents start doing it, and then you spend the rest of the day monitoring terminals, reading transcripts, approving outputs, catching mistakes, and re-explaining context to sessions that lost the thread. It’s not fully autonomous. It’s not fully hands-off. It’s a new kind of management job that nobody signed up for and nobody has good tools for.
The problem isn’t that agents need more autonomy. The problem is that humans have no good way to manage their attention across many agents running simultaneously. That’s the gap this article is about.
The Attention Problem Is Not the Autonomy Problem
When developers complain that their AI agents “need too much hand-holding,” the instinctive response from the AI tooling world is to make agents more capable, more autonomous, better at handling edge cases without asking for help. And that work matters — agent capability has improved dramatically and will keep improving.
But capability improvements don’t solve the attention problem. An agent that’s 20% more autonomous still generates decisions that need human review. It just generates fewer of them. If those decisions are still arriving through the same fragmented, noisy, low-signal channels — a ping in a terminal, a message in a chat thread, a status change in a project board — then the human is still context-switching constantly, still losing flow, still spending cognitive overhead on routing and triage rather than on the decisions themselves.
The attention problem is an interface problem. And it hasn’t been solved yet.
Why Existing Tools Fail at Managing Agent Attention
Most developers running multiple AI agents today are managing their attention through tools that were never designed for this use case. Here’s why each of the common approaches falls short.
Terminal Output and Chat Transcripts
The most common interface for AI agent work is still the terminal or the chat window. You watch the output scroll by, you read the transcript, you intervene when something looks wrong. This works fine for a single agent on a single task. It breaks down completely when you have four agents running simultaneously, because you can’t watch four transcripts at once. You end up sampling — glancing at each terminal in rotation — and missing things in between glances.
Transcripts are also retrospective. By the time you read what an agent did, it’s already done it. If it went in the wrong direction, you’re not catching a mistake in progress — you’re doing damage assessment after the fact.
Kanban Boards and Status Columns
Some teams try to manage agent work through project management tools: a Jira board, a Linear project, a Notion database with status columns. The agent updates a ticket when it starts a task, moves it to “in review” when it’s done, and you work through the review column.
This is better than raw transcripts, but it has a fundamental mismatch: kanban boards are designed for human work, where tasks move through stages over hours or days and the bottleneck is execution capacity. Agent work moves faster and the bottleneck is decision capacity. An agent can generate ten outputs that need review in the time it takes you to review one. The board fills up faster than you can drain it, and the “in review” column becomes a backlog rather than a queue.
Kanban boards also don’t carry context. A ticket that says “auth refactor — ready for review” doesn’t tell you what the agent decided, what alternatives it considered, what it’s uncertain about, or what will happen if you approve versus reject. You have to go read the transcript to get that context, which brings you back to the transcript problem.
Notification Pings and Email Alerts
Some agent setups send notifications when they need input — a Slack message, an email, a push notification. This solves the “missing things between glances” problem but creates a worse one: notification fragmentation. Every ping is a context switch. If you’re getting notifications from four agents across a workday, you’re context-switching dozens of times, and each switch has a recovery cost measured in minutes.
Notifications also don’t prioritize. A ping that says “agent needs input” doesn’t tell you whether this is a trivial confirmation or a consequential architectural decision. You have to open the notification to find out, which means you’re triaging every single one rather than being able to ignore the low-stakes ones.
What a Good Attention Queue Actually Looks Like
An attention queue is not a notification system. It’s not a kanban board. It’s a purpose-built interface for managing human attention across multiple concurrent agent workflows. Here’s what it needs to do.
One Prioritized List Across All Projects
The queue is a single, unified view of every decision that currently needs a human — across all agents, all projects, all tasks. Not one queue per project, not one queue per agent. One queue, period.
This matters because attention is a single resource. You don’t have separate attention for your code project and your content project and your research project. You have one pool of focus, and the queue should reflect that. A single prioritized list lets you work through decisions in order of importance rather than in order of which project you happen to have open.
Context Attached to Every Decision
Each item in the queue should carry enough context to make the decision without leaving the queue. What did the agent do? What is it proposing to do next? What are the alternatives it considered? What will happen downstream if you approve versus reject?
This is the difference between a queue and a notification. A notification tells you something needs attention. A queue item gives you what you need to act on it immediately, without a round-trip to the transcript.
Decisions Ranked by Consequence, Not by Arrival Time
Not all agent decisions are equal. “Should I use tabs or spaces in this new file?” is not the same decision as “Should I refactor the entire data model to support multi-tenancy?” A good attention queue surfaces high-consequence decisions first, regardless of when they arrived.
This requires the system to have some model of what makes a decision consequential — scope of impact, reversibility, novelty relative to past decisions. It’s a harder problem than FIFO ordering, but it’s the problem that actually needs to be solved.
A Record That Learns
Every decision you make in the queue should be recorded with its context and outcome. Over time, this record becomes a decision memory: a log of what you’ve approved, what you’ve rejected, and why. That memory has two uses.
First, it lets the system auto-apply your past decisions to similar future situations. If you’ve approved the same type of refactor fifteen times, the system doesn’t need to ask you the sixteenth time. It applies your established preference and moves on.
Second, it gives you visibility into your own patterns. Are you approving everything? That might mean your agents are well-calibrated, or it might mean you’re rubber-stamping without really reviewing. Are you rejecting a lot from one particular agent or task type? That’s a signal worth investigating.
Earned Autonomy: What It Looks Like in Practice
The concept of “earned autonomy” is the right mental model for how human-agent collaboration should evolve over time. Agents don’t start with full autonomy and get restricted when they make mistakes. They start with limited autonomy and earn more as they demonstrate reliable judgment in specific domains.
In week one of working with a new agent setup, you review everything. You’re building a mental model of what the agents do well, where they tend to go wrong, and what your preferences are. This is high overhead, but it’s necessary investment.
By week six, you’ve accumulated enough decision history that the system knows your preferences in detail. Routine decisions — the ones that match patterns you’ve approved many times before — get auto-applied. Your queue shrinks dramatically. You’re only seeing the genuinely novel decisions: the ones that don’t match any established pattern, the ones with unusually high consequence, the ones where the agent itself flagged uncertainty.
This is what earned autonomy looks like in practice: not a binary switch from “supervised” to “autonomous,” but a gradual, evidence-based expansion of the decision space that agents handle independently. The queue is the mechanism that makes this possible. Without a queue that records decisions and learns from them, you can’t earn autonomy — you can only grant it blindly and hope for the best.
The Daily Habit That Changes Everything
The developers who’ve internalized the attention queue model describe a similar shift in their daily workflow. Instead of monitoring agents throughout the day — checking terminals, reading transcripts, wondering what’s stuck — they work in focused blocks and process the queue at defined intervals. Morning, after lunch, end of day. Three queue sessions instead of forty context switches.
This is only possible if the queue is trustworthy: if you know that anything requiring your attention will be in the queue, and anything not in the queue is either running fine or has been handled by established decision memory. That trust takes time to build, but once it’s there, it fundamentally changes the relationship between human and agent. You’re not supervising. You’re directing.
The Interface Layer That’s Been Missing
The attention queue isn’t a feature. It’s a category primitive — a new kind of interface that the multi-agent era requires and that hasn’t existed until recently. Session-level tools like Claude Code and Codex are excellent at what they do. But they operate at the session layer. The attention queue operates at the work layer: across sessions, across agents, across projects, across time.
Medley (medley.sh) is built around this idea. Its attention queue is a single prioritized list of decisions across all your active projects, with context attached to each item and decision memory that learns from every approval and rejection. The goal is to get you to a place where you’re processing the queue a few times a day rather than monitoring agents all day — where your agents are earning autonomy week by week, and your attention is going to the decisions that actually need it.
If you’re running multiple agents and finding that the management overhead is eating the productivity gains, the answer probably isn’t better agents. It’s a better interface for your attention.