MrRobot – Ubuntu Mobile app enabled Robotics( Raspberry Pi and arduino involved)

Project MrRobot is an Ubuntu Mobile app enabled Robotics which has the feature of voice, touch and shake control to interact with the Rapiro robot. This project is done within 28 hrs in Ubuntu Shenzhen Hackathon by our team E-minors. All the code is onpensourced and the arduino based Rapiro robot is opensouced as well with their code and 3d construction which means you could 3d print the part and build one yourself!!!

Our instructable lead you through the whole process of :

  1. how to deploy the code from Ubuntu Sdk to mobile
  2. learn how the intergrate with wit.ai voice and text recognizable intelligent API to build a voice controlled ubuntu mobile app.
  3. how to implement a server on raspberry Pi to listen messages from app through web socket.
  4. some tips within the ui designMrRobot - Ubuntu Mobile app enabled Robotics( Raspberry Pi and arduino involved)

BOM

  1. Ubuntu Mobile
  2. Raspberry Pi wifi dongle
  3. Rapiro Robot
  4. music box (if needed)

Software Tools required

  1. Ubuntu QT sdk
  2. Pi with Raspbian
  3. Arduino IDE (if you wanna build the robot yourself)
  4. wit.ai API

github address:MrRobot

Step 1: Project in Brief

the app has using 3 kinds of interactive methods. The first is touch screen which can allow user to directly touch the GUI to control the robot. Secondly, The API of accelerometer can detect serval movement like shake, that can also triggered some acts from Rapiro. On the bottom of the UI you can see a touch button which is the voice control button. Once you touch the button it will start to record the audio and you need to tap it when you finish the recording.

Step 2: Install Ubuntu QT sdk and deploy the code on Ubuntu phone

have a look of the detail news on our github channel.

MrRobot - Ubuntu Mobile app enabled Robotics( Raspberry Pi and arduino involved) schematic

Step 3: Install a Web Server on your Pi

Using wifi dongle to get on local wireless network

Download the codes

running

Setting on boot startup adding a shell command at rc.loca

l

Step 4: Hardware construction

Disassemble the head of the Rapiro and carefully attach the Pi onto the plate of Papiro and plug in the audio wire and the wifi dongle

 

For more detail: MrRobot – Ubuntu Mobile app enabled Robotics( Raspberry Pi and arduino involved)


About The Author

Ibrar Ayyub

I am an experienced technical writer holding a Master's degree in computer science from BZU Multan, Pakistan University. With a background spanning various industries, particularly in home automation and engineering, I have honed my skills in crafting clear and concise content. Proficient in leveraging infographics and diagrams, I strive to simplify complex concepts for readers. My strength lies in thorough research and presenting information in a structured and logical format.

Follow Us:
LinkedinTwitter

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top