Alexa Controls for Sims 4 Build Mode
(Please make sure you are viewing the video with 1080P quality settings)
Project
This is a prototype I developed in collaboration with a team of engineers, based on a concept where we used Amazon’s Alexa to launch and play The Sims 4. Our focus here explored the possibilities of integrating voice command technology into build mode’s gaming experiences. Only 4.5 days were spent on this exploration.
Problem
Approximately 20% of gamers have disabilities, including mobility challenges, visual or hearing impairments, and cognitive differences. Can Alexa’s voice controls be used in The Sims 4’s Build Mode?
Player Pain Points:
- Heavy reliance on mouse precision – placing and rotating objects
- No alternative control schemes – no built-in one-handed mode or support for adaptive controllers.
- Not text-to-speech support
Product Pain Points:
- Overcomplicated Content organization, especially with dozens of expansions
- Would require heavy tagging
Research
To research using Amazon Alexa to play Sims 4 build mode, I started by checking if there are any existing Alexa skills for gaming. Next, I explored how other games used Alexa for voice controls and see if Sims 4 could adapt to similar features. There weren’t very many suitable skills that existed at the time, so the team considered focusing on creating a custom Alexa skill to control gameplay, like placing objects, changing colors or adjusting items on wallswalls.
Design Process
Since this was a non-functional visual prototype, I used screenshots from The Sims 4 and modified them in Photoshop to represent how the feature would look in action:
- Captured in-game screenshots of Build Mode objects in different placements and sizes.
- Edited images in Photoshop to simulate:
- Object movement (layered images to show shifts).
- Scaling (resized and reshaped objects to represent command results).
- Created overlays to display visual feedback (e.g., numbers appearing over multiples of objects for selection).
To simulate interactivity, I imported the edited images into Adobe XD, linking screens to mimic the flow of voice commands and added audio clips. This allowed the prototype to:
- See visual feedback on how objects change position, size, or rotation.
- Provide feedback on whether the voice command logic felt intuitive.
Results
After developing a prototype that allows disabled players to size, move, and scale objects using voice prompts, the results would likely show improved accessibility, ease of use, and new creative possibilities.
✅ Increased Accessibility for Players with Mobility Disabilities
- Players with limited dexterity, arthritis, or motor impairments can now place and resize objects hands-free, making Build Mode more inclusive.
- Those using adaptive controllers can now reduce reliance on button presses and build faster.
✅ Enhanced Ease of Use & Efficiency
- Players can quickly adjust object sizes and placements using simple commands (e.g., “Make the couch 25% bigger” or “Move the table left 3 tiles”).
- Fine-tuning object positions is more precise than manually dragging with a mouse.
✅ More Immersive & Intuitive Gameplay
- Using voice to build feels natural and intuitive, especially for players familiar with voice assistants like Alexa or Siri.
- Casual builders and console players benefit from a hands-free, relaxed building experience.
✅ Encourages Creativity & Experimentation
- Players can experiment with object scaling more freely, without needing to memorize keybinds or hold down buttons.
- Easier object manipulation leads to more detailed, complex builds without frustration.
If you are having trouble streaming the video, it can be downloaded here.