AI Social Robot SCAD · UXDG 415 Anger De-escalation Physical Product

Lumi

An AI robot that monitors anger patterns, interrupts escalation in real time, and builds empathy through light, sound, and voice.

Lumi robot, three views showing green default state, blue LED band while listening, and yellow/red LED band during anger detection

A robot that turns down the heat

Lumi is a social robot that helps users visually monitor their pattern of anger, cool them down during ongoing arguments, and facilitate greater self-awareness in their personal relationships.

Using NLP, facial expression recognition, and SLAM technology, Lumi detects arousal levels and emotion changes during arguments, responding with a precise, two stage intervention designed to stop escalation and open the door to reflection.

10 Week Project
15 Users Tested
2 Test Sprints

My Role

Prototype Lead · Content Writer · Visual Designer for slide decks · Lead User Testing Researcher

Technologies

NLP (Natural Language Processing) · Facial Expression Recognition · SLAM (Simultaneous Localization and Mapping) · Amazon Alexa Voice SDK

Roles and Responsibilities: Prototype Lead and Content Writer, visual designer for slide decks, lead user testing researcher

Roles and responsibilities across the project team

Anger without a way out

Anger is a core human emotion that people constantly struggle to keep at bay. Younger adults, ages 16 to 24 are especially prone to losing control, with less impulse regulation and fewer emotional tools.

Problems with anger lead to overly aggressive behavior that negatively affects lives and the people around them. Users are unable to express feelings without getting emotional, struggle to recognize their own triggers, and lack specific methods to stop escalating anger before it causes damage.

How Might We

Help users manage and de­escalate anger in real time, improve their interactions with the people they live with, and support reflection on their emotional patterns using an AI-powered robot?

HMW breakdown: support users to improve their relationship with people living together using an AI robot — sub-questions covering stopping escalation, monitoring anger patterns, cooling down in the moment, and designing coping methods

How Might We breakdown — four design sub-questions shaping the brief

The Problem Space: low task completion, long sessions, high error rate, low user satisfaction, low engagement, accessibility challenges, inconsistent visuals

Identified challenges in the problem space. Early usability research uncovered a 60% task completion rate

The Solution: task completion rose from 60% to 90%, session time dropped 40% (5 to 3 min), error rate reduced 50%, user satisfaction scores rose from 3.2 to 4.3 out of 5

Redesign outcomes. Task completion rose from 60% to 90% and session time dropped by 40%

Target Audience

Ages 16 to 24. Younger adults have a harder time managing anger and impulse control, making them the population that could benefit most from Lumi's presence in their homes.

Proto Personas

Megan
19 · Atlanta, GA · College student, lives with boyfriend

Goal: have conversations without them turning into arguments.

Frustration: arguments escalate before she realizes they have started, leaving her feeling guilty and misunderstood. She wants a way to catch the moment before things go too far.

Max
22 · Los Angeles, CA · Lives with family

Goal: be more understanding and not get angry so easily.

Frustration: he knows his triggers but cannot stop himself in the moment. Family arguments leave him feeling ashamed after the fact, and he has no way to track whether he is actually improving over time.

Proto Persona 1 — Megan, 19, Atlanta GA. Behaviors: long-winded rants, hard time admitting fault. Pain points: frequent fighting strains relationship, can't communicate frustration without getting emotional. Goals: find middle ground during arguments, stop the building anger.
Proto Persona 2 — Max, 22, Los Angeles CA. Behaviors: gets very angry with close people, short fuse, uncontrollable rage. Pain points: harbors resentment toward brother, unsure how to control anger. Goals: better control anger around family, seek outlet for redirecting rage.

Megan and Max — detailed proto persona profiles grounding the target audience

Defining the direction

Extensive secondary research shaped the target range, product type, and AI integration approach, narrowing a broad emotional problem into a feasible, testable design direction.

Project approach: 10-week Gantt chart spanning project proposal, midterm, two user testing sprints, project closeout, and final delivery

10-week project timeline, two user testing sprints anchored the process

Narrowing Down the Concept: target audience identified, product type and situations defined, general AI integration approach determined

Secondary research narrowed the concept toward a home-based AI social robot

Role of AI Technology: analyzing emotional value via auditory sensors, camera, NLP, SLAM, and facial expression recognition to define anger level and intervene through sound and voice assistance

Role of AI technology — NLP, SLAM, and facial expression recognition working in concert

Hypothesis: anger control problems can be minimized in ages 16 to 24 through conflict resolution methods; AI robot prevents further escalation and provides coping methods; we will know it worked when arguments are successfully resolved

Design hypothesis, the foundation for both user testing sprints

Assumption: a social robot will provide enough presence to successfully derail an argument from escalating
Risk: AI technology might not be sophisticated enough to solve all levels of conflict

Core assumption and primary risk entering the design phase

Limitations: not knowing when an argument is resolved; users may not be distracted by stimuli; methods could exacerbate someone already angry

Known limitations acknowledged before concept development began

Goals

Three design goals emerged from the research phase and guided every subsequent decision.

Our Goals: Stop the escalation of the anger, Build an empathetic relationship with the robot, Understand the patterns of anger within themselves and others

Stop · Build · Understand, in sequence

Designing the system

Lumi's concept is a two stage system: first interrupt the escalation, then facilitate emotional reflection through Cognitive Reframing.

Proposed Solution: Lumi is a social robot detecting anger level and responding via color-changing LED lights, unexpected sounds, and CBT-based AI voice assistant

Proposed solution, a two stage physical robot using sound, light, and voice

Lumi Interaction Model: triangle diagram showing Lumi at the top, mediating between User and Partner during an argument at the base

Interaction model. Lumi positions itself as a neutral mediator between both parties

How Lumi works

Research into existing products and future trends in AI led the team toward three core technologies: NLP for semantic and tonal cues, facial expression recognition for visual emotion signals, and SLAM technology (inspired by Roomba) to navigate the home and approach users quickly.

How Would Lumi Work: NLP for semantic cues, SLAM technology for navigation, and facial expression changes to detect anger
AI Input/Output diagram: Input (arousal level, facial expression, non-verbal cues, semantic verbal, location) processed by AI (NLP, SLAM, facial expression recognition), Output (stop further escalating the anger)

Sensor inputs flow through the AI layer to produce targeted responses

Low-Fi Prototype

Low-fi prototype sketch: annotated diagram showing camera on spinning head, speaker, LED light strip, and wheels for mobility in all directions

Low-fidelity prototype — core hardware components annotated on an early sketch

Use Cases

Two use cases were designed to address the full range of anger intensities. At low anger, subtlety is paramount, an unobtrusive cue that doesn't break the conversation. At high anger, the intervention must be immediate and impossible to ignore.

Use Cases: low anger, subtle sound to unobtrusively alert. High anger, unexpected response for immediate halt in escalation.
Use Case 1: Low Level of Anger, low anger detected, subtle sound, unobtrusively alert the person without stopping the conversation. Use Case 2: High Level of Anger, high anger detected, unexpected response, immediate halt in escalation.

Use Case 1 (low anger) and Use Case 2 (high anger), matched responses by intensity

Core Features

Core Features: Speaker (source of calming sound), SLAM (maps the house), Camera (360° head spin, detects facial expressions), Microphone (detects and locates users), LED Light (warns with colors by anger level), Mobility (quickly approaches users)

Six integrated hardware and software capabilities

Physical Design

Lumi's form is futuristic yet friendly, inspired by BB8 and designed to be simple and non-threatening. Brand values: Friendly, Warm, Empathy. The LED light band is the primary emotional display, changing color in real time to signal the current anger level.

Green, Default state, no anger detected
Blue, Detecting voice
Yellow, Low anger detected
Red, High anger detected

Lumi's Persona

To ensure consistent character across all interactions, the team built a brand persona for Lumi: approachable, empathetic, and friendly, with a calm and warm tone of voice.

Lumi's Persona: age 25, female AI assistant. Brand identity: Approachable, Empathy, Friendly. Personality: calm, kind, welcoming, empathetic, trustworthy, warm, cheerful, understanding. Tone of voice: friendly, casual, calm and warm.

Lumi's brand persona — the character behind the product

Two-Stage Concept Direction

Stage 1: Stop escalating the anger, alert using jingle sound and light at low anger; unexpected sound sources at high anger. Stage 2: Coping Method via Cognitive Reframing, alternative cognitive thinking to restructure perception positively; three response methods: mirroring, restatement, and effective response.

Stage 1 interrupts; Stage 2 reframes

Lumi's Journey with the User: sound, lights, and motion mitigate building anger; cognitive reframing techniques practiced in therapy; the longer Lumi spends with a person, the better the pattern recognition

Long-term relationship, Lumi's pattern recognition improves the more time it spends with a user

Scripting empathy

After mapping common argument scenarios, three voice scripts were created to cover the emotional states a user might be in when approaching Lumi, and to train Amazon Alexa's intent recognition on realistic conversation data.

Lumi Voice Flow diagram: full branching conversation map showing paths for users with negative feelings wanting to talk, users who are unsure, and users who don't want to talk right now

Full voice flow, branching paths cover all three emotional entry states

Voice Script 1: User has a negative feeling and wants to talk to Lumi. Lumi guides Jack through Cognitive Reframing after a fight with his brother about a gaming console.

Script 1, User has a negative feeling and wants to talk

Voice Script 2: User is confused about their feelings. Lumi gently walks Susan through exploring why she feels unsure after her friend was an hour late.
Voice Script 3: User has a negative feeling but doesn't want to talk. Lumi respects the boundary: 'No problem, take your time. Let me know when you are ready to talk.'

Script 2 (confused feelings) and Script 3 (not ready to talk), boundary respect built into the design

Lumi in action

Two storyboards place Lumi in realistic domestic scenarios, grounding the concept in the daily lives of the proto personas and communicating the two stage response model.

Storyboard 1: Response to Low Anger, Megan comes home and her boyfriend starts arguing with her. Lumi listens from the living room, moves to the kitchen, and emits a jingle sound and LED light. Both parties become conscious of their anger and calm down.

Storyboard 1, Lumi's low anger intervention: subtle jingle and LED signal

Storyboard 2: Response to High Anger, Max and his brother are yelling about a gaming console. Lumi rushes over and plays an unexpected humorous audio clip, a funny voice filter or a nostalgic sound, chosen to break the emotional spiral through surprise rather than confrontation. Sean hands over the console and apologizes.

Storyboard 2, Lumi's high anger intervention: unexpected humor breaks the tension immediately

Two sprints, real insight

Two rounds of user testing across 15 participants validated sound effectiveness and refined the voice design. Each sprint combined quantitative surveys with contextual inquiry sessions.

Evaluation Questions

Sprint 1 Evaluation Questions — Concept Based: does the unexpected sound cool users down, what kind of sound gets attention, how users perceive the sound during an argument, different responses for different anger stages, consistency vs. variety
Sprint 1 Evaluation Questions — Design Based: does the size and design of the robot effectively calm users, is the robot's movement and speed enough to catch attention during a heated argument

Sprint 1 evaluation questions — concept-based and design-based tracks

MVP Testing Plan

MVP Testing Plan: 6-step process — recall the angry moment, write about the past conflict, Wizard of Oz simulation (understand sound effect and movement), quantitative survey, explore shape and size of the robot, contextual inquiry and evaluate

MVP testing plan — six-step Wizard of Oz simulation run across 8 participants

User Testing Task Flow: Task A (Low Anger) — listen to alarm sounds, animal, jingle, nature sounds, watch robot movement and speed, evaluate each stimulus. Task B (High Anger) — unexpected shocking sounds, user's own voice, funny voice filter, nostalgic music, watch movement, evaluate.

Task flow — two tracks evaluating low-anger and high-anger stimuli independently

Sprint 1, Sound Effectiveness

8 participants · Quantitative survey (20 min) + Contextual inquiry (30 min)

Results: animal sounds were most effective for low anger situations; playing back the user's own voice was most effective at high anger, both surprising and disarming.

User Testing Results: Sprint 1, 8 participants — five dimensions evaluated: Sound, Speed, Lights, Size, Movement

Sprint 1 — five dimensions evaluated across 8 participants

Sound results: Low — animal sounds, nature sounds, short jingle. High — Trump funny speech, record of user's voice, nostalgic music
Sound results bar charts: Low Anger — animal sounds rated highest (3.8/5); High Anger — user's own voice rated highest (4.5/5)

Sound results — animal sounds top for low anger; user's own voice most effective at high anger

LED Light results: Low — stable light preferred; High — rapid flash more eye-catching and effectively distracting
Speed results: Low — standard robot vacuum speed expected; High — users want Lumi to approach them faster

LED and speed findings — rapid flash and faster approach validated for high anger states

Movement results: Low — no movement preferred; High — users want active movement like dancing or head spinning
Size results: half preferred smaller 7-inch size (fits small room, cuter); half preferred bigger 11-inch (more presence, reminds them of a pet)

Movement and size — active motion preferred at high anger; size split evenly between 7″ and 11″

Sprint 2, Voice Design Naturalness

7 participants · Contextual inquiry (30 min)

Lumi's voice scripts were tested via a foam physical prototype and the Amazon Alexa developer environment, simulating realistic interaction scenarios.

Building Out Sample Code: leveraged Amazon Alexa developer tools to integrate voice scripts; conducted user tests with a physical foam prototype of Lumi

Voice interactions built in Amazon's developer environment, tested with a foam prototype

Coding: Amazon Alexa Intents editor and JavaScript code for FeelBadIntent and DisruptiveListenerHandler
Alexa Developer Console: skill testing interface showing live voice simulation with JSON response output

Amazon Alexa Developer Console, voice intents coded and tested in real time

Key Insights

Key Insights: Formalness, users wanted less formal dialog, felt too much like therapy. Reframing, users wanted Lumi to mirror more of their words. Root, more focus on anger triggers. Empathy, needs kinder, more considerate responses.

Four dimensions of voice design feedback from Sprint 2

Formalness

Users wanted a less formal dialog, it felt too clinical, like therapy. Lumi needed a warmer, more casual tone.

Reframing

Users wanted Lumi to mirror more of their words back to them, creating a more personal and connected feel.

Root Cause

More focus on identifying the underlying triggers of anger, rather than addressing only the surface-level response.

Empathy

Responses needed more consideration for what users were actually expressing, kinder, gentler language throughout.

Design Changes

Changes: expanded sound options (low anger: animal sounds and subtle jingle; high anger: copy-cat with funny voice filter, funny celebrity speech, nostalgic music). Size reduced from 10 inches to 8 inches. LED: subtle flash for low anger, rapid flash for high anger, green as default.

Post-testing changes: expanded sound library, refined LED flash behavior, size reduced from 10″ to 8″

Validating a new category of emotional intervention

This semester-long project was completed for UXDG 415, UX Studio 2 at SCAD. It demonstrated that a physical AI robot using sound, light, and voice could effectively interrupt and de­escalate arguments, with strong, positive user response across both testing sprints.

Key Finding

Unexpected audio stimuli outperformed every other interrupt method tested, and users who engaged with the Cognitive Reframing scripts reported feeling genuinely heard rather than managed. The long term pattern recognition model was the feature users most wanted to see built, validating the core premise that emotional support tools need to improve the more they know you.

Key Takeaways

Two sprints of testing across 15 users confirmed that unexpected audio stimuli and Cognitive Behavioral Therapy methods are not just accepted by younger adults but actively preferred over conventional calm-down prompts. The pattern recognition model proved compelling to users who had never considered that a device could learn their specific triggers over time. The biggest design lesson was that emotional tools need to feel like a relationship, not a feature. Users responded to Lumi not as a product interrupting an argument but as a presence that understood them.

Future Directions

Onboarding

A personalized onboarding experience to build a custom relationship between Lumi and each individual user from day one.

Companion App

A mobile app that lets users review anger patterns over time, track emotional growth, and manage Lumi's settings.