AI Chatbot
Led UX research and strategy for improving enterprise chatbot experiences across multiple business units at CIBC. The goal was to evaluate current chatbot performance, identify gaps, and define a scalable, user-centred approach for future chatbot implementations.
Project Requirements
Define a scalable, user-centred chatbot strategy for CIBC by evaluating existing solutions, identifying experience gaps, and designing a future-state framework that improves usability, reduces customer friction, and increases self-service efficiency.
As part of the research process, I facilitated cross-functional SBU workshops to uncover key chatbot use cases, existing solutions, and pain points across the organization. I conducted interviews with LOB partners and chatbot product owners to understand current limitations and identify opportunities for improvement, alongside user interviews to capture real-world challenges and usage behaviors. I synthesized complex architecture and integration diagrams to map how chatbot systems interacted with existing platforms. Additionally, I conducted market and competitor research to benchmark UX best practices and evaluate leading solutions. These insights were then translated into actionable design recommendations aimed at improving usability, flexibility, and overall chatbot effectiveness.
Problem Statement
My Role
Led UX research and synthesis across multiple chatbot initiatives
Conducted stakeholder and user interviews to uncover pain points
Translated insights into UX frameworks and design recommendations
Collaborated with product, engineering, and business teams
Contributed to defining the future-state chatbot experience
Worked cross-functionally with:
Product owners across multiple lines of business
Engineering teams to understand system constraints
Business stakeholders to align on KPIs and priorities
Facilitated alignment across siloed teams to create a unified chatbot strategy.
CIBC had multiple chatbot implementations across different lines of business, but they were fragmented, inconsistent, and underperforming.
Users struggled with:
Low response accuracy
Rigid conversation flows
Lack of seamless escalation to human agents
Poor discoverability and engagement
This resulted in low trust, increased frustration, and higher dependency on customer support channels.
Research Approach
To understand the current landscape, I conducted a combination of qualitative and strategic research:
Facilitated SBU workshops to uncover use cases and pain points
Interviewed chatbot product owners across lines of business
Conducted user interviews with internal chatbot users
Analyzed current chatbot architectures and vendor capabilities
Performed competitive benchmarking and UX best practice analysis
Primary Research / Common Frustrations
The chatbot has no personality – it answers dully and inflexibly like a machine. That’s neither the best customer experience nor the best impression for your brand.
Chatbot doesn’t understand the questions or has very limited access to answers (data). This makes for a terrible bot experience for users. Make sure to set up your bot in a way that it can answer questions.
The dialogue only follows rigid patterns, but cannot do anything with differently asked questions or comments, and is then stuck in an endless loop. Find happy flows that will smoothly allow your bot to ask for more information in different ways.
Key Insights
Our research revealed that the most effective chatbot experiences are those that prioritize simplicity, clarity, and intuitive navigation. Users expect interactions to feel dynamic and engaging, rather than static or overly scripted. A critical factor in success is the chatbot’s ability to understand natural language variations and accurately interpret user intent, rather than relying on rigid keyword-based responses. Additionally, context-aware interactions significantly improve relevance and user satisfaction, while guided elements such as prompts and clickable options help reduce friction and support smoother decision-making. Overall, chatbot experiences that balance flexibility with structure tend to deliver the highest engagement and usability.
Chatbots fail to understand user intent, leading to repeated errors
User Frustrations
Systems often reset before resolution, they feel robotic and lack personality
Lack of human handoff creates frustration during complex queries
Users get stuck in looped conversations with no resolution
Trade-offs & Constraints
Balancing advanced AI capabilities with existing tech stack limitations
Aligning multiple stakeholders with competing priorities
Designing scalable solutions across fragmented systems
UX Strategy & Recommendations
Designed scalable conversational flow frameworks
Proposed integration of AI capabilities such as semantic search and sentiment analysis
Defined chatbot interaction patterns for improved usability
Recommended contextual entry points within high-friction user journeys
Developed a future-state vision for enterprise chatbot experiences
Impact
Identified key gaps across existing implementations
Influenced future roadmap and investment decisions
Improved alignment across business and technology teams
Design Principles
Design for flexibility, not rigid flows
Enable seamless human handoff for complex queries
Prioritize clarity and guided interactions
Introduce conversational tone and personality
Leverage context and user intent to personalize responses
I created a series of supporting visuals to clearly communicate the chatbot experience and underlying ecosystem. This included a conversation flow diagram mapping the user journey from intent recognition to bot response, fallback handling, and seamless human handoff.
I also designed a before-and-after comparison to highlight the shift from rigid, loop-based interactions to a more flexible, guided experience.
Additionally, our team developed an enterprise chatbot ecosystem framework illustrating how different layers of channels, AI capabilities, data infrastructure, and human support work together to deliver a cohesive and scalable solution. These visuals helped translate complex concepts into clear, digestible insights for stakeholders.
AI - Capabilities that are Required
Sentiment analysis
Determining the sentiment behind a phrase
Summarization
Expressing the most important facts of a text
Semantic search
Applying user intent the meaning to find the right content
Question answering
Answer questions posed in a natural language
Speech recognition
AI machine is able to process speech audio
Machine translation
The translation of one language to another by a machine
Opportunities for AI capabilities
Reflection
This project highlighted the importance of designing chatbots as part of a broader ecosystem rather than standalone tools. If I were to take this further, I would focus on validating solutions through usability testing and measuring real user impact post-implementation.