Portfolio

ROS 2 Perception in 5 Days

Computer Vision Applications in a Simulated Environment

course_image

Overview

ROS 2 Perception in 5 Days is an educational course I developed during my time working with The Construct Robotics Institute. This course embarks on an exciting journey into the realm of perception in robotics using ROS 2. Through a series of structured units and hands-on projects, participants explore various aspects of sensor data processing and perception techniques.

Goal

This course is designed to provide you with a comprehensive understanding of perception techniques in robotics using ROS 2. By the end of this course, you’ll be equipped with the skills to process sensor data, perform image and point cloud processing, implement human-robot interaction techniques, and apply AI-based perception methods in robotics.

Key Features

  • Step-by-step guidance for creating perception pipelines using ROS 2.
  • Projects involving object detection, surface recognition, and pose estimation.
  • Application of open-source tools like OpenCV and PCL.
  • Modular lessons designed for learners of varying experience levels.

Technical Approach

Software

  • Framework: ROS 2 Humble.
  • Simulator: Gazebo.
  • Libraries: OpenCV, PCL

What You Will Learn

  • Learn to integrate and process sensor data in ROS 2.
  • Implement image processing algorithms using OpenCV.
  • Work with point cloud data and use the Point Cloud Library (PCL).
  • Explore human-robot interaction with face detection and recognition.
  • Apply AI perception techniques using deep learning frameworks.
  • Develop a real-world project on intelligent inventory management.

Course Summary

1. Course Intro

  • Overview and course objectives.
  • Demo of perception capabilities.

2. Working With Sensor Data in ROS 2

  • Intro to ROS 2 and Sensor Integration.
  • LaserScan, Image and PointCloud2 Messages.

unit2

3. Image Processing

  • Intro to Image Processing and OpenCV.
  • Blob Tracking and Line Following.

unit3

4. Point Cloud Processing

  • Intro to Point Cloud Processing and PCL.
  • Surface and Object Detection.

unit4

5. Human-Robot Interaction

  • Intro to Human-Robot Interaction.
  • Face Detection, Face Recognition and Human Tracking.

unit5

6. AI Perception Techniques with YOLO

  • Intro to YOLO.
  • YOLO Object Detection, Pose Estimation and Segmentation.

unit6

7. Project: Intelligent Inventory Management

  • Real-world project application
  • Implementation of Inventory Management

unit7

Results and Impact

  • Positive feedback highlighting clarity, organization, and hands-on applicability.
  • Participants successfully implemented perception pipelines for academic and professional projects.

Rating & Testimonials

testimonials

Access Course

Feel free to access the course here.