Robot-Assisted Social Dining as a White Glove Service
Organizations: Robotics University of Michigan Ann Arbor, Michigan, USA · Leiden University Leiden, Netherlands
Abstract
Robot-assisted feeding enables people with disabilities who require assistance eating to enjoy a meal independently and with dignity. However, existing systems have only been tested in-lab or in-home, leaving in-the-wild social dining contexts (e.g., restaurants) largely unexplored. Designing a robot for such contexts presents unique challenges, such as dynamic and unsupervised dining environments that a robot needs to account for and respond to. Through speculative participatory design with people with disabilities, supported by semi-structured interviews and a custom AI-based visual storyboarding tool, we uncovered ideal scenarios for in-the-wild social dining. Our key insight suggests that such systems should: embody the principles of a white glove service where the robot (1) supports multimodal inputs and unobtrusive outputs; (2) has contextually sensitive social behavior and prioritizes the user; (3) has expanded roles beyond feeding; (4) adapts to other relationships at the dining table. Our work has implications for in-the-wild and group contexts of robot-assisted feeding.
Figures & tables
| ID | Age | Gender | Race | Self-described Disability | Assistance Type | Occupation | Chosen Scenario |
| P1 | 35–44 | Female | White | Quadriplegic | Full Meal | N/A | Family dinner |
| P2 | 65–74 | Female | White | Osteoarthritis; Shoulder Injury | Cutting/Meal Prep | Respiratory Therapist | Brunch w/ friends |
| P3 | 55–64 | Female | White | Spinal Muscular Atrophy | Full Meal | Social Worker; ED at Non-Profit | Business meal |
| P4 | 55–64 | Female | Mixed | Parkinson’s/Partial Paralysis | Full Meal | Remote Therapist | Business meal |
| P5 † | 35–44 | Female | White | Intention Tremors (Hand/Body) | Full Meal | N/A | Brunch w/ friends |
| P6 | 25–34 | Male | White | Multiple Sclerosis | Cutting/Drinking | Accountant | Business meal |
P3 imagines the robot to be mechanical.'' (2) Middle (P6): A bright, colorful robot arm is shown in orange and teal stripes. It has cartoon-like eyes, a playful snake-like shape, and wears a red bowtie. And the caption reads, P6 imagines the robot to be colorful, fun, and with a bowtie.'' (3) Right (P2): A gray robotic arm with a round head features a smiley face. Two indicator lights—one red and one green—are above the eyes. And, the caption reads, ``P2 imagines the robot to have a smiley face with lights.'' Together, the images highlight how some participants envisioned robot appearances differently, ranging from utilitarian and discreet to playful and expressive.Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| P. ID | R U | U R | R O | O R | |||||||||||||||||||
| lights | haptics | beeps | voice | screen | neural | mouth joy. | finger pad | tapping | eye gaze | buttons | head move. | wand | tablet | written | controller | voice | engage kids | intro others | signal staff | part of convo | correct | help | |
| P1 | ✓ | ✓ | – | – | – | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | ✗ | – | ✗ | – | ✗ |
| P2 | ✓ | – | – | ✓ | – | – | – | – | – | – | ✓ | – | – | – | ✓ | – | ✓ | ✗ | ✓ | ✓ | ✗ | – | ✗ |
| P3 | ✓ | ✓ | ✗ | ✗ | ✗ | ✓ | ✓ | ✓ | ✗ | ✓ | – | ✓ | – | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| P4 | ✓ | – | – | ✓ | ✓ | ✓ | ✓ | – | – | – | – | – | ✓ | ✓ | – | ✓ | ✓ | ✗ | ✗ | – | ✗ | ✓ | ✗ |
| P5 | – | – | – | ✓ | ✓ | ✗ | – | – | – | – | – | – | – | ✓ | ✓ | – | ✓ | ✓ | ✓ | – | ✓ | – | ✓ |
| Lbl. | P. ID | Sub-theme | Task | Agree? | Quote |
| A | P3 | R U | haptics | ✓ | "it has…pulsing mode or…vibration mode…make it go off in three pulses" |
| B | P1 | R U | haptics | ✓ | "I could just feel it start working or start…vibrating" |
| C | P4 | R U | voice | ✗ | "If the robot is confused and doesn’t understand the command, the robot could say to the person: ‘please explain’ or ‘I don’t understand’…" |
| D | P5 | R U | voice | ✗ | "I would want the robot to introduce itself with a name and ask me…what my name is" |
| E | P6 | O R | correct errors | ✗ | "[caregiver can] maybe correct the robot…or maybe better interpret the directive to the robot" |
| F | P6 | O R | help others | ✗ | "I would want it to be able to assist everyone around me and myself" |
| Lbl. | P. ID | Sub-theme | Task | Agree? | Quote |
| O | P4 | U R | neural interface | ✗ | "You could have…an AI chip that is interactive, that’s more intuitive…with thoughts" |
| P | P3 | U R | finger pad | ✗ | "Maybe a finger pad that doesn’t take a lot of physical movement" |
| Q | P4 | U R | wand | ✗ | "I envision the robot taking my instructions either verbal commands or type commands or perhaps through a wand" |
| R | P2 | U R | written/typed | ✗ | "[I would] even [pass] a note if [robot] could read and understand…visualize…something that wouldn’t interrupt the meeting" |
| S | P2 | U R | voice | ✗ | "I would ask my robot if he would mind cutting my food, my meat for me" |
| T | P2 | U R | buttons | ✗ | "I would…push button…for help" |
| Lbl. | P. ID | Sub-theme | Quote |
| A | P5 | fade into the background | "[Robot looks] as normal as possible" |
| B | P4 | fade into the background | "[Robot] would be…just a piece of adaptive equipment and…not…participating in the conversation or really…a discussion topic" |
| C | P2 | fade into the background | "I don’t want [the robot] to draw a lot of attention." |
| D | P5 | social etiquette | (When getting food from shareable dish): "The robot should say to Megan why don’t you go ahead and get some, then I’ll help and get some food" |
| E | P3 | support, but not initiate, in shared table practices | "[Robot] would…be small and inconspicuous not taking up a lot of space around me or interfering in the space of my dining companions" |
| F | P5 | personality needs to be versatile and adaptable | "Jackie, Megan and I are in the restaurant, the robot just introduced herself as Claire." |
| Lbl. | P. ID | Sub-theme | Robot Role | Quote |
| A | P4 | During Mealtime | self-serve | "If it is a computer menu like on a tablet and the person is disabled and they don’t feel comfortable with technology, maybe the robot could work the tablet for the person [to order]" |
| B | P2 | During Mealtime | self-serve | When ordering, "I might forget if I can’t see the menu very well so if the robot has a repeat button maybe where [it] could read back what we finalized that would help me" |
| C | P5 | During Mealtime | self-serve | "I tell the robot: will you please help me look at the menu and help me figure out what I want to eat at the restaurant because it’s all vegan here and its gonna be hard for me to decide" |
| D | P5 | During & Outside Mealtime | – | "I [ask] the robot, would you please get my medicine out and help me to put it in my mouth so I don’t drop it on the floor" |
| E | P4 | During Mealtime | sharing & passing | "waiter brings a shared dish but I can’t reach so I wonder if…your [robot arm] is either an extension or it’s folded where you can open it and reach further…I might also need [robot] to pass it around" |
| F | P1 | During Mealtime | sharing & passing | "I ask one of my family members to pass the appetizers to me and then have my robot hand grasp one of the items" |
Assistive Robotics
Assistive robotics develops robots and wearable devices that support mobility, daily activities, rehabilitation, and care.
See all 199 papers