Samsung’s Smart Home
Samsung Electronics Smart Home UX Scenario Development
I developed a detailed UX scenario for controlling various Samsung devices within the home, utilizing Samsung's Galaxy phones and Smart TVs. This scenario was specifically tailored for exhibition at the IFA show.
I created various user scenarios to accommodate a range of situations, including Home Control, Home Monitoring, Media Control, and Home Energy Consumption Information.
This UX scenario served as a reference point for developing smart home UX scenarios at Samsung Electronics' UX Center and was prominently featured at the IFA Show 2016.
I defined and designed detailed scenarios for smart homes through research and an idea workshop.
UX PROCESS
Research
User Needs
Cient Needs
Competitor Analysis
Analysis
Comprehensive Analysis of Competitor
Ideate
UX Scenario Exploration Workshop
Build
UX Core Architecture Concept
Wireframing (UI Definition & Workflow)
> Smart Home Phone
> Smart Home TV
Storyboard Planning
01
02
03
04
Competitor Analysis
I conducted a UX analysis on a global manufacturer providing similar smart home functionalities.
The analysis was based on the 7 principles of the user experience honeycomb: usability, usefulness, desirability, reliability, findability, accessibility, and value.
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Usable
Desirable
Useful
Findable
Credible
Accessible
Valuable
Credible
How accurate and purposeful
is the information provided?
Findable
How easily can users find
the informationthey need?
Desirable
Accessible
Findable
Credible
Valuable
Usable
Useful
Valuable
How much does a product or
service contain the value
of the brand or identity?
Useful
Does it provide information and features
suitable for the intended purpose?
Accessible
Can users with disabilities easily
use the product or service?
Desirable
To what extent does a product or service
provide users with a differentiated experience
and provide pleasure in the emotional aspect?
Usable
How easy is it for users
to use a product or service?
UX Scenario Exploration Workshop
In this workshop, I made a concerted effort to generate innovative ideas to make the integrated user experience (UX) in smart homes even more special.
I brainstormed and shared various ideas with participants, aiming to uncover distinctive features in the smart home environment.
Icebreaking and Smart Home Introduction
The event starts with a fun story from the moderator, and participants get to know each other with casual introductions.
They also learn the basics of Samsung Smart Home services and how to use them.
Brainstorming Ideas
Each group of participants generates a variety of brainstorming ideas for discovering distinctive service scenarios. These ideas are expressed through both text and drawing scenarios as the groups explore unique possibilities for their assigned scenarios.
Idea Presentation and Feedback Incorporation
Each team presents their scenarios, receiving feedback from various fields (regular users, developers, service planners, and designers) within their group. The scenarios are then refined based on the feasibility to create an improved version.
Scenario Visualization Through Lego
Enhanced scenarios are visualized and shared using LEGO for a more concrete representation. Participants collaborate to organize and present these refined scenarios for discussion.
Final Scenario Sharing
Sharing the final scenarios, confirming the main scenarios by topic, and concluding the session
[Schedule]
Date: September 6 (Tuesday)
[Materials]
Provided Items: Paper, pens, post-it notes, LEGO (provided at each table)
[Participants]
Group Composition: 10 participants each from regular users, developers, service planners, and designers
Distribution Method : Participants evenly distributed into 5 groups.
Group 5
Group 4
Group 3
Group 2
Group 1
Moderator
Through the workshop, a total of 15 distinctive service scenarios were derived
Device
Device
Quantifying the usage history of smart home devices such as cleaning, laundry, and refrigerator door
openings, storing them as patterns, and analyzing the data
Providing regular care reports and enabling real-time exploration
Offering emergency notifications in case of unusual or non-occurring routines compared
to the usual
A son checks his father's daily routine,
who lives alone in the countryside, using a smartphone
A worried mother in New York, whose youngest son attends school alone, checks her son's daily routine using her smartphone.
The vehicle has arrived in front of the house.
The indoor arrival mode begins to activate in advance.
The smartphone placed on the desk received a call. (Call from Peter)
While watching TV in the living room, an incoming call notification appears on the TV screen, indicating that the current phone is in the room and specifying its location.
When the user answers the phone while moving to
the living room, the TV volume is muted, and the
robot vacuum, which was in operation, pause
Providing visualization data on expected power consumption in the smart home app.
Device
Real-time communication link among devices like smartphones, robot vacuum cleaners, TVs, etc.
Real-time user location tracking through motion sensing on the device
.
Receiving phone call notifications while watching TV and providing indoor location information for the smartphone
Device
Device
Providing information for comparing energy usage by period/device
Offering anticipated utility costs and
detailed power consumption information
Device
Pre-set the 'Returning Home Mode' using the Samsung Smart Home app, allowing advanced customization of each device's operation
Initiating the pre-set 'Returning Home Mode' in the living room as the vehicle's location is detected
Providing detailed settings and control features for the Car to Home/Home to Car services
Device
Providing information for comparing energy usage by period/device
Offering anticipated utility costs and
detailed power consumption information
55”
Samsung 55 inch Smart TV
UX Structure : Home & Service Summary
Ticker (Half View)
In Ticker (Half View), a brief summary of the main content from each service is provided during TV viewing, and no separate depth entry is offered
App (Full View)
Each service can be navigated through the Global Navigation at the top of the screen.
Each service provides multiple card details with the option to enter detailed pages
Configurable
Bridge - Linked Divergence
Building a Smart Home user experience ecosystem by integrating peripheral services around key Smart Home core services.
Adaptive
Contextual Smart Home
Tailoring service content and priorities based on the user's in-home or outdoor location and situation.
Outside Home
Inside Home
Customizable
From Novice to Expert
Adjusting the amount of information and UI configuration to accommodate a user-friendly experience, catering to both beginners who may not be familiar with IT and experienced users.
Information volume
Screen layout
Interaction
Simple Mode
Expert Mode
Providing a customizable UI that can be freely adjusted based on
the user's understanding of the service and their requirements.
Customizing Key Features in Smart Home App:
Standalone Apps and Widgets
5”
Samsung Galaxy S4
App’s UX Structure : Home & Service Summary
Home
Service
Android Home
Smart Home App
Registering as a Favorite Card
Registering Service Cards as Favorites on the Home Screen
(Using the Favorite Button on Each Card)
Registering as an Android Home Widget
Registering Service Cards as Widgets
on the Home Screen (Long Tap and Drag Each Card)
Establishing the UX direction for Samsung SmartHome
Through competitor analysis and workshops, key themes (Configurable/Adaptive/Customizable) for Samsung SmartHome's direction were derived. A comprehensive UX structure has been proposed based on these findings.
UX Direction
Defining Smart TV Input Control Method
Smart TV interaction is defined through the remote control's touchpad, voice recognition, and hand motion recognition, enabling seamless control of smart home functions.
Input Rule
Four-directional focus navigation
The four-directional focus movement is executed by swiping or gently flicking on the touchpad. The speed of the action determines the distance of the focus movement.
Grabbing and moving items.
Pressing the touchpad to grab an item with the pointer, execute an action by continuing to hold down and moving your finger on the touchpad
Trackpad pointing
If the touchpad mode in the application is set to pointing, a pointer is displayed on the screen.
The movement of the finger on the touchpad is recognized as mouse events, and it moves the on-screen pointer according to the direction and speed of the finger's movemen
Horizontal and vertical scrolling of the screen
Continuous scrolling of a list in all directions (up, down, left, right) through the drag gesture.
Through swiping on the touchpad, users can execute two modes of operation: a 4-directional focus movement mode and a trackpad pointing mode.
The action of pressing and releasing the touchpad
Click
(Press & Release)
Maintaining the touchpad in a pressed state for a certain duration (e.g., 2 seconds) or more
Press & Hold
Moving a finger over the touchpad or along the raised horizontal and vertical lines on the edges at a certain distance
Drag
The action of moving a finger on the touchpad while it is in a pressed state
Press & Move
Gently flicking a finger on the touchpad or along the raised horizontal and vertical lines at the edges while maintaining contact.
Flick
Voice recognition
Voice recognition is activated by pressing the voice recognition button on the remote control or by uttering the initiation command through the TV microphone.
Voice control commands that work in every scenario on Samsung Smart TVs
Launching the smart home application
Smart Home
Entertainment Mode
I’m going to bed
Save energy
Coming Home
Start Home
I’m Home
Sleep
Close Guide
Focus Up
Focus Left
Show All
Others
I’m going to bed
Energy Saving Mode
Select
Exit
Sleep
Remote Control Keys
Touch Pad
Voice Control
“Going Out Mode”
Motion Control
Gestures for motion are displayed on the screen as individual icons.
Slap Gesture
Quickly moving your hand from side to side in a slapping motion allows navigation to the previous/next items within the page, simulating flipping through pages.
Grap & Move
Scroll through the page using Grab & Move.
Motion recognition
Various motion gestures can be used to control functions
Controlling based on recognized gestures and motions
Waving a hand gesture activates motion recognition
The built-in camera recognizes
gestures and motions of the hand
Moving Pointer - Move
Page Navigation– Slap
Waving a hand
Activating motion recognition
Move
Moving the pointer
Grab
Executing the selected content
Grab & Move
Scrolling through the page using the Grab & Move gesture
Slap
Navigate to the previous/next items within the page by quickly moving your hand from side to side
CCS Rotation
Moving Backward
Definition of Smart TV input control methods
Focus movement rules are initially based on the rules existing in the TV's native UI. If the native UI lacks focus rules, the following principles are applied
Defining basic operation methods for smart home control using remote control (touchpad), voice control, and motion control.
Definition of rules for focus movement
Moving to items on the same x-axis line
Moving to items on the same y-axis line
Moving to the first item of the sub-item
Page Navigation: When moving to the next item not currently visible on the screen, the entire set of items shifts. Returning does not cause any movement within the visible screen items
Moving to the tab that contains the currently selected sub-item
Pressing the down arrow key again returns to the previous focus
Moving to the item with a larger overlapping ratio when two items overlap
Moving to the item with a larger overlapping ratio when two items overlap
Moving to the upper item when two items have an equal overlapping ratio
Moving to the left item when two items have an equal overlapping ratio
UI Definition & Use Flow
I have defined detailed UI and usage scenarios for the smart home service.
TV > Ticker (Half view)
TV > Ticker (Half view)
TV App > Full view
In Ticker (half view), it provides a screen summarizing the content of Home and each service briefly without offering separate depth.
Smart HomeTV Structure
Navigating to each service through the top global navigation on the screen
Each service has multiple cards
Entering detailed pages from each service card
Smart Home App Structure
Registering Favorite
Register service cards as favorite cards at the bottom of the Smart Home app's
home screen using the favorite button on each card
Registering Android Home Widget
Register service cards as widgets on Android Home by long-tapping and dragging each card
Half view Home (ticker)
Control Detail _ LED
Energy Main > Monthly Energy Usage
Mode Main > Mode Execution/ Cancel
Home
Media Detail > Recent
Adding a new mode
Executing the Control Card on Smart TV
Energy Main_ Energy Usage Rate Card
Quick navigation between Home, Control, Mode, Monitoring, Energy, and Care.
Ticker (half view) provides a summary of the content for Home and each service.
Switching information between main services
TV Ticker (Half View)
Providing a comprehensive energy information card within the home
(energy usage goals, monthly energy consumption details, device-specific energy usage ratios, etc.)
Star bookmark frequently used cards with a star in the home menu for easy control
Mode operation On/Off setting
Mode operation time setting
Mode operation day setting
Entry Menus for Each Service such as Home, Control, Mode, Monitoring, Energy, Care
Providing status updates on all lighting, heating, and standby power cut-off within the home
lighting status
Standby Power Off/On
Temperature Display On/Off
[OK]
[OK]
[OK]
Monthly
Energy
Usage
Smart Home App > Home Menu
Standby power cut-off popup
Smart Home App > Mode Menu
Smart Home App > Energy Menu
Monthly Energy Usage Detail
[ ]
[ ]
[ ] x n
Increasing by 5 kilowatts.
[ ] x n
Decreasing by 5 kilowatts.
Control
Summary
Mode
Summary
Monitoring
Summary
Care
Summary
Home
Energy
Summary
Editable for changing service order and adding/removing.
Quick navigation between Home, Control, Mode, Monitoring, Care, Energy, and Media
Navigating between main services
Home & Service Summary (App)
Key Screens
Home
Control
Summary
Mode
Summary
Monitoring
Summary
Energy
Summary
Media
Summary
Care
Summary
Creating and adding a new mode based on history
Providing OVEN control panel
App Icon Format: Provided as a 1x1 size Service Icon on the home screen.
Registering services as widgets within the Smart Home App.
Selecting the app provides quick access to the main screen of the corresponding service
Providing LED control panel
Applying the cards provided by each service in Smart Home as they are (4x2 size)
Providing Quick Panel for quick control access
Applying the cards provided by each service in Smart Home as they are (4x2 size)
Providing A/C control panel
Registering in the Widgets screen (typically how widgets are installed in the Android OS).
Providing detailed graphs and numerical values for energy consumption per device on a monthly basis.
Setting Energy Goals and comparing infomation on a monthly basis
Providing a briefing list
Add to Mode
Briefing List
Control Card _ A/C
Control Card _ Oven
Quick Panel
Control Card _ Smart LED
Service Launcher
Control Card Widget
Widget
Monitor Card Widget
Energy Usage Rate Detail
Energy Goal Detail
The protagonist leaves home, showcasing the 'Going Out' scenario where the smart home is activated.
Background: During Work
The protagonist is engaged in work tasks at the office.
Background: Working (Dim + Blur)
Upon switching to Landscape mode, the view transitions to the full monitoring screen.
During work, the protagonist misses the child at home who is with the babysitter.
Background: On the Way Home
After preparing to leave work, the protagonist heads home for the evening commute.
Background: Working (Dim + Blur)
The background fades into a blur as the phone appears. Then, the protagonist selects the widget on the home screen and initiates monitoring.
Background: On the Way Home (Dim + Blur)
Upon leaving work, start the washer.
[The Final Proposal Video]
I collaborated with the Motion Design team, providing and receiving feedback to develop the final scenario video, incorporating both the given context and hand sketches
Background: Working (Dim + Blur)
Observing the living room where the child and babysitter are playing, checking both the visuals and audio.
The protagonist departs for the company to commute to work.
Background: Commuting Scene (Dim + Blur). The background fades into a blur as the phone appears, triggering the pre-scheduled 'Going Out Mode.
Background: Commuting Scene (Dim + Blur)
A three-part screen appears from the right, with each segment showing the TV and remote-controlled lighting turning off.
I have planned key video storytelling scenarios for presenting smart homes to customers at the IFA Show.
Exhibition Video Storyboard Planning
Copyright © 2024 Min Suk Kang. All rights reserved.
