Self-directed research project · No client engagement

Rethinking AI Chat UX:
A Research-Led Framework

This is self-directed research, not client work - a project I ran on my own time to answer a question the market hadn't settled yet: why do AI chat interfaces, despite rapid model progress, still feel like they're fighting their own users? What follows is a structural diagnosis of three recurring interaction failures, and a framework for designing past them.

FormatIndependent desk research + interaction framework
Date2025–2026
CategoryAI & Conversational UX

The Governing Conclusion

Chat interfaces broke a promise they never should have made

AI chat products adopted a single interaction metaphor - free-text conversation - for a job that is only partly conversational. That mismatch produces three systemic anti-patterns: forcing parametric tasks through prose, letting context silently decay with no visibility into it, and hiding model uncertainty behind a confident-sounding black box. None of these are model problems. They're interface problems, and they're solvable with a hybrid, progressively-disclosed interface model rather than a bigger model.

Situation. Interest in AI-adjacent interface work grew sharply over the past year, but the underlying interaction pattern most products ship with - a minimal input box plus a linear message history - hasn't kept pace with what people are actually trying to do with it. The same chat box is asked to handle a quick factual question, a multi-step research task, and a precise creative-generation job, with no differentiation between them.

Task. I set out to name the recurring failure points precisely enough that they could be designed against - not "AI chat feels clunky sometimes," but specific, HCI-principle-level anti-patterns with a specific interface response to each one. I worked from a synthesis of published UX critiques, HCI literature on affordance and system visibility, and my own use of these tools, rather than from a client brief or a research panel of participants.


The Work

Three anti-patterns, named precisely enough to design against

Each of the three sits at the intersection of a technical model limitation and a specific HCI principle the interface fails to uphold. Naming the principle is what turns a vague complaint into a design brief.

1

The prompt barrier

Violates control, freedom and efficiency. It also fails pure conversationalism.

Tasks that are inherently parametric - output length, tone, creativity, technical density - get forced through text. The user ends up typing "make it shorter" three times instead of moving a slider once. Natural language is excellent for expressing intent; it's a poor tool for specifying parameters.

Interface response: hybrid controls - sliders, dynamic contextual toolbars, and intent-based shortcuts that sit alongside the chat input rather than replacing it.

2

Context decay

Violates visibility of system status and context/memory decay.

As a conversation grows, the model's usable context window fills up and coherence degrades - but the interface gives no visual signal of this happening. Users find out their context has silently dropped only after the output goes wrong.

Interface response: visible context-boundary indicators, conversation threading, summarization, and quick-jump retrieval so decay becomes a manageable, visible workflow problem rather than an invisible technical one.

3

Trust erosion

Violates Trust Through Transparency and Error Prevention by eroding trust.

Outputs carry no provenance, confidence signal, or source attribution, so every claim needs independent verification - which quietly cancels out the speed the tool was supposed to provide. This is the "black box output" problem, and it's the main driver of the trust deficit users report.

Interface response: confidence indicators, source citations, and explicit uncertainty acknowledgment shown adjacent to the output, not buried in a settings panel.

The hybrid interface framework

If natural language is the wrong tool for specifying parameters, the fix isn't a better prompt - it's giving the parameters their own controls, sitting next to the conversation rather than replacing it.

Sliders - length, tone, creativity, technical density, set once instead of re-typed.

Dynamic toolbar - context-aware actions that appear based on the output already on screen.

Intent shortcuts - saved macros for sequences a user repeats often.

Progressive disclosure, so the interface fits the user rather than the reverse

A hybrid interface only works if it doesn't overwhelm a first-time user or throttle an expert. Progressive disclosure calibrates the interface's visible complexity to how the person is actually using it.

Beginner

Guided entry

Starter templates, capability examples, and onboarding shown on the blank screen - the anxiety point new users hit first.

Intermediate

Contextual reveal

Hybrid controls surface gradually as the user's task complexity grows, without a hard mode switch.

Expert

Minimal, fast, full control

Keyboard-driven, minimal chrome, full parameter access - the interface gets out of the way entirely.


If This Went Into Delivery

How I'd sequence the build, if I were leading it

The phasing logic below is the one genuine planning artifact from this research - not because a team exists to execute it, but because the sequencing itself reflects a real product-management instinct: fix the cheapest, highest-visibility friction first, and hold the architectural rework for once that's validated.

Weeks 1–8

Immediate high-impact fixes

Entry affordance, search/tagging, confidence indicators, model tags, quick actions - each shippable independently, no re-architecture needed.

Weeks 9–16

Hybrid interface architecture

Sliders, dynamic toolbar, intent shortcuts, and progressive disclosure - held until Phase 1 proves users adopt the lighter fixes first.

Weeks 17–20

Measurement and optimization

Instrumentation for the metrics below, then a research pass on what shipped wrong. Deliberately last - you can't measure what doesn't exist yet.

On team and resourcing: the source research this framework grew from sketched specific headcounts per phase. I'm not carrying those into this write-up - no team was staffed or led on this project. Where role types are implied above (frontend, ML, research), read them as "the kind of skill each phase would need," not as a claim about people I managed.


What This Unlocks

Projected, not achieved - here's what I'd want to measure

Nothing below is a result. There's no shipped product and no usability test behind these numbers. What follows is the set of things I'd instrument if this framework were built, drawn directly from the anti-patterns above - stated as hypotheses worth testing, not proof of anything.

Time to first successful prompt for new usersProjected metric - the direct test of whether entry affordance actually reduces blank-screen anxiety.

Prompt iteration count per taskProjected metric - if hybrid controls work, users should need fewer re-typed attempts to get the output they want.

Conversation retrieval success rateProjected metric - the direct test of whether context-decay mitigations actually help people find what they said earlier.

User-reported confidence in output accuracyProjected metric - whether transparency features actually restore trust, or just add visual noise.


Reflection

What this project is, and what it isn't

This is desk research and framework design - sharp, I think, and genuinely mine - but it is not delivery. There's no client who commissioned it, no team who built alongside me, and no user who sat down and used the thing. If an interviewer asks how I think about AI-feature UX, this is the honest answer to "show me you've thought about it structurally." It is not the answer to "show me you've shipped it."

What I'd argue with a critic about: whether progressive disclosure actually resolves the tension between beginner guidance and expert speed, or just relocates it. I don't think a three-tier system is the final answer - it's the best interface-level answer I found without a team to test it against real users.


Design Application

If this interface had to act, not just answer

Two things to be clear about before reading further. First: the feature below doesn't exist and isn't planned - nothing here has shipped or been scoped. Second: applying an autonomy framework to a hypothetical feature is a thought exercise, not a field test of the feature or the framework. Treat what follows as "here's how I'd reason about it," not "here's what happened."

Everything above is about an interface that answers - it forces parametric tasks through prose, lets context decay invisibly, hides uncertainty. None of that involves an agent acting in a live system. But one element already sits at that edge: intent shortcuts, the saved macros a user defines for a sequence they repeat often. Right now they're proposed as a suggestion the user still has to trigger. The interesting design question is what happens if that shortcut is allowed to run on its own.

This is a Sequential pattern, not a Magentic one - the user fixed the sequence in advance, so the path never has to be discovered at runtime. The concrete design rule: a new shortcut requires a confirm tap every single run. It only earns the right to run unconfirmed after enough consecutive confirmed runs prove the sequence out - a specific, testable threshold, not a vague "once the user seems comfortable."

That graduation mechanic - and the vocabulary of Sequential versus Magentic patterns - comes from Graduated Autonomy, a separate methodology I've developed for agents that act rather than answer. It has its own evidence architecture and its own open questions, documented on that project's page. I'm borrowing its mechanic here, not claiming this chat interface has been built or tested against it.


Sources

Independent research, cited

Synthesized from published UX critique and HCI literature on conversational AI interfaces, including analysis on chat interface affordance failures, prompt engineering as a UX burden, conversational thread management, and hybrid GUI/chat design patterns.

Curious how I'd apply this to a real product?

This framework is the thinking. I'd welcome the chance to talk through how it'd adapt to an actual copilot, RAG, or human-in-the-loop feature you're building.

Get in touch →