Skip to main content

Week 15: Final Blog


Progress Update

Week 13-15:

  • Solved the USB port issue by switching the user to the root
  • Solved the lagging issue by separating the program into a detector and the main program
  • Used UDP communication to connect two programs
    • Sender: Face mask detector
    • Receiver: Main program
  • Calculated the driving control errors 
  • Used Espeak (a text-to-speech generator) as our audio assistant
  • Filmed the demo video
  • Did the project presentation
  • Wrote the final project report

Final Product:

          

Project Demo

(If the video cannot be opened, here is the YouTube link: https://youtu.be/JRxGMKsTSpk)


Conclusion

  • The robot is able to check if the passenger wear a mask or not
  • The robot can move towards the passenger without a mask
  • The robot can notify the passenger to take a mask

Future work
  • Use a closed-loop system for the driving control or let the robot move randomly

  • Use a smaller computer that can “sit” on the Roomba

  • Detector aborted because moving too fast or hit the camera

  • Improve the mask detector

Comments

Popular posts from this blog

Week 9: Project Literature Review & Methodology

L ITERATURE R EVIEW A. The Importance of Mask during COVID-19 In order to slow the spread of COVID-19, limiting physical distancing and using other measurements to decrease the transmission probability are necessary. According to J. Howard et al., if face masks were used by all household members prior to symptoms occurring, it has a 79% effective rate in preventing transmission. Besides, the states with mask mandates to require residents to wear a mask have a lower daily growth rate than those without. As a mask provides a physical barrier that reduces the spread of respiratory droplets and particles into the air, properly wearing a mask can protect the safety of everyone [1]. Figure 1 : The efficiency of mask in blocking the virus B. The Implementation of Mask Detection Robot Currently, mask and temperature detection robots have shown their important role in responding to the COVID-19 pandemic. The U...

Week 11: Robot Hardware Building and the Implementation of Face Mask Detection

  What we finished in these two weeks: Hardware for the robots We have used a tripod to hold the mobile camera. Figure 1&2 demonstrate the graphic design of the robot and how it actually looks like. A 10 ft extension USB cable will be used to connect the camera and the computer We estimated the observation distance between the robot and passengers. Between 1.3 meters to 1.5 meters, the robot is able to observe two passengers at once. Figure 1: The hardware design of face mask detection robot Figure 2: How the robot looks like in reality Implementing the face mask detector We applied the face mask detector designed by  Chandrika Deb , which has a 98% accuracy for Face Mask Detection after training via TensorFlow-gpu==2.5.0 The framework used by the detector:  OpenCV Caffe-based face detector Keras TensorFlow MobileNetV2 A short demo video of us testing the face mask detector can be found below. Video 1: Testing the real-time video stream mask detecting Reference: ...