Product & AI
An AI backlog still needs a reason to exist
A practical way to prioritize AI opportunities through user problems, evidence, review effort, and the cost of being wrong.
By Josh Child6 min read
In this perspective
A backlog can collect AI ideas faster than a team can evaluate them. Summarize this screen. Add an assistant. Generate a report. Recommend the next action. Each suggestion can sound reasonable on its own, especially when a quick prototype makes it feel close to finished.
The difficult work begins when those ideas compete with one another and with improvements that do not involve AI. A product owner needs a consistent way to compare them. Otherwise, novelty becomes an unofficial priority rule, and the backlog starts reflecting what is easiest to demonstrate.
My preference is to make the reasoning visible before making the list longer. An AI opportunity should describe a user problem, a proposed change, the evidence behind it, and the work required to make the result dependable. That gives the team something more useful to discuss than enthusiasm.
Translate the request into a task
An item called “AI reporting” leaves too much unstated. Which report? For whom? What decision does it support? How is that decision made today? What information is difficult to assemble or understand?
Imagine a manager who reviews a weekly queue of unresolved requests. One possibility is to generate a narrative summary. Another is to make ownership and overdue work clearer in the queue itself. A third is to improve the underlying intake process so requests arrive with fewer missing details. These choices address related difficulties through different mechanisms.
I would describe the task before evaluating the feature: the manager needs to identify requests that require action and understand why they are unresolved. Now the team can compare approaches against a shared purpose. AI has to earn its place in that comparison.
This also helps with scope. A feature that explains the current queue is different from one that decides which requests should be closed. The second introduces a new level of authority, review, and consequence.
Use evidence with a visible confidence level
Evidence does not have to begin as a large research study. It might be an observed workflow, recurring support questions, or interviews with the people doing the task. The important part is keeping its strength and limits visible.
At Spera, I translated outside research and user interviews into product requirements and workflows, then helped prioritize the backlog and plan releases. That work required connecting what we learned with practical choices about a platform spanning projects, time, invoicing, and payments.
If I were evaluating AI opportunities in a comparable product, I would distinguish an observed difficulty from an attractive assumption. “Users re-enter project information when preparing invoices” is a problem the team could investigate. “Users want an AI finance assistant” is a proposed solution that still needs evidence.
I would attach a short confidence note to each opportunity: what we know, how we know it, and what could change the decision. This makes an uncertain idea easier to explore without pretending it is ready for implementation.
Include the effort the user inherits
An AI feature can move effort rather than remove it. A draft may be quick to generate and slow to verify. A recommendation may require someone to check several records before trusting it. A summary may omit the one exception that matters.
For prioritization, I want to understand the whole task. How much work happens before the model receives its input? How much review is required? What happens when the result needs correction? Does the user retain enough context to make that correction confidently?
Consider a hypothetical project-status summary. If someone must read every source item to discover whether the summary is accurate, the feature may offer less benefit than its generation speed suggests. It could still improve communication, but that is a different claim from saving review time.
I would ask the team to show the proposed review process in the prototype. A feature's expected benefit should include that process instead of assuming a perfect output that nobody needs to inspect.
Compare consequences as well as frequency
Common tasks are attractive candidates because improvements can affect repeated work. Frequency alone is not enough, though. A small mistake repeated frequently can create a large burden. An occasional error can matter greatly when it changes a consequential decision.
I find it useful to discuss the cost of being wrong in plain language. Can the user notice the error? Can they undo the result? Who else might act on it? What would recovery involve?
These questions help separate a suggestion from an action. Offering a possible label is different from automatically routing a request. Drafting a message is different from sending it. A narrow feature with an explicit review step may be a stronger first release than a broader automation.
NIST's AI Risk Management Framework treats trustworthiness as a consideration across AI design, use, and evaluation. For my purposes, that means risk belongs in the priority conversation while scope is still flexible.
Give learning work a place in the backlog
Sometimes the highest-value next step is an experiment. A team may need to learn whether source information is usable, whether reviewers agree on an acceptable result, or whether the proposed assistance fits an actual workday.
I would represent that work explicitly. A short investigation could compare an AI summary with an improved structured view. A limited prototype could test whether users understand the difference between a suggestion and a confirmed fact. An engineering investigation could identify integration constraints before the team commits to a feature.
Each investigation needs a decision it will support. Otherwise, research and prototypes can accumulate without changing the backlog. I want to know what finding would justify implementation, what would narrow the scope, and what would lead us to stop.
That makes learning a practical investment. The deliverable is a more informed choice, which can save the team from maintaining an unnecessary feature.
Keep the ordering explainable
A useful prioritization conversation should leave a record that another person can understand. I do not need a complicated scoring model for every decision. I do need enough reasoning to explain why one problem comes before another.
For an AI opportunity, I would capture the affected user and task, the evidence of difficulty, the expected improvement, the uncertainty, the review and recovery burden, and the smallest useful next step. Estimates should come from the people who understand the work. Assumptions should remain labeled as assumptions.
The backlog can then change as evidence changes. A prototype might reveal that the proposed benefit is smaller than expected. A workflow improvement might remove the need for AI. A new constraint might make a previously attractive idea too costly to support. Those are legitimate reasons to reorder the work.
Product ownership becomes easier to trust when the reasoning is visible. The team can challenge an assumption, contribute missing information, or propose a simpler route to the same result. That is the kind of backlog I want: a working explanation of what deserves attention next and why.