Skip to main content

Week 7: Introduction

 

Project Introduction

    In December 2019, the first case of COVID-19 was discovered in Wuhan, China. As of March 11, 118M cases were reported worldwide. In order to help slow the spread of coronavirus, CDC recommends people wear masks in public settings. Starting from February 2, 2021, face masks are required in all forms of public transportation traveling, such as bus, train, and plane. To protect the safety of passengers, in this project, we plan to build a service robot that is able to check the mask-wearing in a public transportation scenario. The robot will act as a security patrol robot and identify the passenger without a face mask immediately. 


Photo: JEENAH MOON/BLOOMBERG NEWS

Project Objectives

  • The robot is able to scan passengers
  • The robot is able to detect if passengers wear facemasks or not
  • The robot is able to move towards the passengers without masks
  • The robot is able to check passenger's temperature

The Robot Flowchart


Project Plan

Week 7~8:

  • Literature review on mask check COVID robot
    • State-of-the-art method of mask identification until we get at least two options
    • Check if the method can be deployed on raspberry pi
  • Decide which chassis to use (Roomba)  
  • Proposal presentation & proposal report submission

Week 9~11:

  • Design a 3D model for camera system carrier
  • 3D printing these components and assemble the camera system
  • Finish the hardware of mask check COVID robot

Week 9~13:

Week 14~15:

  • Testing mask identification and robot driving control
  • Finish the final report

Equipment List

  • Chassis: Roomba
  • Others: Raspberry Pi, RGB camera, speaker

Tutorials we may use

  • Python, OpenCV, Keras, Machine Learning
    • https://data-flair.training/blogs/face-mask-detection-with-python/
    • https://github.com/chandrikadeb7/Face-Mask-Detection
    • https://www.mygreatlearning.com/blog/real-time-face-detection/

Comments

Post a Comment

Popular posts from this blog

Week 13: Software Configuration and Testing

For hardware construction: A simple camera holder was built to mount the camera with tripod. For software construction: In these two weeks, we tried to embed the Roomba driving control and python audio into our detector code. Because of the port issue, we were not able to connect the Roomba to our original Linux VW. Therefore, we switched to other computers and platforms. The following are the platforms/computers that we tried and the reason why they were not able to complete our project goals. There are three major functions we are looking at:  1. Can it run the mask detecor.py? 2. Can it install/support PyAudio? 3. Can it access Roomba's USB port and control the robot? Table 1 . System configuration and issues Platform Name What it supports What it does not support Why? VMWare Linux VM Mask detector, PyAudio Roomba driving control USB port could not be opened Raspberry Pi Roomba driving control PyAudio, Mask detector "Arm-linux-gnueabihf-gcc" failed with exit status 1; ...
Post a Comment
Read more

Week 11: Robot Hardware Building and the Implementation of Face Mask Detection

  What we finished in these two weeks: Hardware for the robots We have used a tripod to hold the mobile camera. Figure 1&2 demonstrate the graphic design of the robot and how it actually looks like. A 10 ft extension USB cable will be used to connect the camera and the computer We estimated the observation distance between the robot and passengers. Between 1.3 meters to 1.5 meters, the robot is able to observe two passengers at once. Figure 1: The hardware design of face mask detection robot Figure 2: How the robot looks like in reality Implementing the face mask detector We applied the face mask detector designed by  Chandrika Deb , which has a 98% accuracy for Face Mask Detection after training via TensorFlow-gpu==2.5.0 The framework used by the detector:  OpenCV Caffe-based face detector Keras TensorFlow MobileNetV2 A short demo video of us testing the face mask detector can be found below. Video 1: Testing the real-time video stream mask detecting Reference: ...
Post a Comment
Read more