Skip to content
josh_
All insights

UX & research

Use AI to organize research without losing the evidence

AI-assisted synthesis is useful when observations, interpretations, and product decisions remain connected to their sources.

By Josh Child6 min read

User researchAIEvidence
In this perspective

A research summary can sound convincing because it is clear. The findings are neatly grouped, the language is concise, and the recommendations feel ready for a planning meeting. But clarity of presentation does not tell us whether the summary represents what participants actually said or did.

That concern becomes more important when AI helps organize the material. It can propose themes and turn messy notes into readable prose. The product team still needs to inspect how those themes connect to evidence and where interpretation has entered the process.

I would use AI as an aid to reviewing research, with a deliberate path back to the source. If a finding cannot be traced, challenged, or qualified, it is too easy for a useful draft to become an unsupported product decision.

Keep observations separate from explanations

An observation describes something that happened. An interpretation proposes what it means. A product decision chooses what to do in response. Those are related, but they should remain distinguishable.

Imagine a participant pauses before completing a form and opens a help panel. The observation does not establish that the entire form is confusing. The person may be checking one unfamiliar term, looking for reassurance, or following a habit. A summary that immediately labels the form unusable has moved beyond the evidence.

GOV.UK's guidance on analysing research sessions distinguishes observed behavior from findings and actions. I find that separation useful when thinking about AI-assisted synthesis. It gives the team a way to inspect each step rather than receiving a recommendation with its reasoning hidden.

Begin with a useful source structure

Before asking AI to summarize research, I would organize the material so individual observations can be identified. Session references, timestamps where appropriate, and clear distinctions between quotations and researcher notes make later review easier.

The input should also preserve context. A comment from someone exploring a product for the first time has a different meaning from a comment by a frequent user completing a familiar task. Removing that context can turn a specific concern into a broad claim about everyone.

My work at Spera involved translating outside research and my own user interviews into requirements and workflows. The product connected several areas of an independent professional's business. That kind of connected scope makes context important: a request about invoicing may be caused by something earlier in project setup, rather than a missing invoice feature.

If I were applying AI to that research workflow today, I would preserve the connection between the observed difficulty and the task that produced it. The goal would be to make the evidence easier to inspect, not merely easier to read.

Ask for candidate themes, not final truth

A useful prompt can ask the system to propose groupings, identify supporting observations, and list material that does not fit. That framing treats the output as something to review.

I would avoid asking it to identify the main problem without giving a clear method or context. The system may produce a coherent answer even when the source supports several interpretations. A polished hierarchy can hide how much judgment was required to create it.

For a hypothetical set of workflow interviews, I might ask for observations grouped by the point where work stalled. I would want each group to include source references and a short explanation of the grouping. I would also ask for contradictory observations. A person who completed the task easily may reveal a condition that changes the proposed finding.

Check the theme against the original material

The review should include more than confirming that the linked observation contains similar words. I would ask whether the theme preserves the person's meaning, the scope of the task, and any qualifications that matter.

Suppose a summary says participants wanted automation. The original notes may show that they wanted fewer repeated entries, but also wanted control over the final action. Those needs might be served by a simpler data connection, a reusable template, or a confirmation step. The broad theme could prematurely narrow the solution to AI.

This is where product and research judgment matters. A theme is useful when it helps explain behavior and guides a better question or decision. It should not become a category that everything is forced to fit. The team needs permission to rename, split, or discard a grouping that sounded reasonable at first.

Preserve the unusual observation

Common patterns deserve attention, but frequency is not the only reason a finding matters. A rare problem may block a critical task, affect a particular group, or reveal a risk that the ordinary path never reaches.

AI-generated summaries can make a collection feel tidier by emphasizing repeated language. I would deliberately inspect material outside the major themes. Does an unusual observation describe a different workflow? Is there a meaningful accessibility issue? Did a participant find a workaround that explains how the current system is being used?

The point is not to treat every comment as a requirement. It is to make the decision about significance consciously. A low-frequency observation may justify another research question rather than an immediate feature. Keeping it visible allows that judgment to happen.

Protect the research context

Research material can contain information that should not be sent into every tool. Before using AI, I would confirm what data is appropriate for the selected system, what permissions apply, and whether the task can be completed with less identifying detail.

This is an operational decision for the team and organization. It should not be left to an individual improvising during synthesis. A clear process helps contributors use assistance without guessing which material can be included.

I would also keep the output's scope clear when sharing findings. If a summary covers a small set of sessions around one task, it should say so. It should not imply a population-wide conclusion. Confidence comes from an honest account of the evidence, including its limits.

Turn findings into testable product decisions

Once the team agrees on a finding, I would connect it to a decision and a way to learn from that decision. If users struggle to understand a status, the next step may be a clearer label and a prototype test. If information is missing at a handoff, the next step may be to review the underlying workflow with the responsible people.

The finding should remain connected to its source as the work enters the backlog. That makes future trade-offs easier to discuss. A team can distinguish a request based on observed behavior from a hypothesis that still needs investigation.

AI can help make research material more manageable. The useful outcome is a team that can see the evidence, understand the interpretation, and make a responsible next decision. A clean summary is valuable when it supports that process. It should never become the reason the team stops asking how it knows.

Keep exploring