Perception - Notes¶
Agenda - What's Perception? - Perception Architecture Pipeline - Applications - Tools and Frameworks - Perception Approaches - Datasets - Perception Algorithms - References
What's Perception?¶
Machine perception is the capability of a computer system to interpret data in a manner that is similar to the way humans use their senses to relate to the world around them.
Perception Architecture Pipeline¶

Applications¶
- Robotics
- Humanoid robots
- Mobile & stationary robots
- Autonomous Transportation
- Self-Driving Cars
- Robotaxi
Tools and Frameworks¶
Perception Approaches¶
- Computer Vision - Based
- Machine Learning - Based
- Deep Learning - Based
Datasets¶
Lane Detection - Lane detection
Semantic Segmentation - Segmentation
Perception Algorithms¶
- Fully Convolutional Network for Road Segmentation
- YOLO for 2D Object Detection
- Deep SORT for Object Tracking
- KITTI 3D Data Visualization for Homogenous - Transformations
- Multi Task Attention Network (MTAN) for Multi - Task Learning
- SFA 3D for 3D Object Detection
- UNetXST for Camera to Bird's Eye View
- An Algorithmic Implementation of an Autonomous Driving LiDAR Perception Stack with PCL
References¶
Courses
- Visual Perception Course - Self-Driving Cars Specialization - University Of Toronto - Faculty of Applied Science and Engineering
- Computer Vision and Perception for Self-Driving Cars (Deep Learning Course) - Sakshay
- Perception lecture for the course "Techniques for Self-Driving Cars" taught at the University of Bonn, recorded in Fall 2021.
DARPA Challenge : - AnnieWay autonomous vehicle
Tesla Vision vs Lidar : - Tesla autonomy neural networks How AI neural networks function in Tesla - By Andrej Karpathy - Tesla Vision vs LIDAR - How Tesla Is Using Artificial Intelligence to Create The Autonomous Cars Of The Future - LiDAR vs Computer Vision: Does Waymo Have A Better Strategy Than Tesla? - Joe Scott - Tesla Vision vs UltraSonics Sensors (USS)
Tesla AI Day : - Tesla Autonomy Day - 2019 - Tesla Battery Day - 2020 - during covid - Tesla AI Day - 2021 - Tesla AI Day - 2022
Outros : - Letβs Understand the Vector Space Model in Machine Learning by Modelling Cars - Deep Understanding Tesla FSD Part 2: Vector Space
Research Notes:
- The Complete Self-Driving Car Course Applied Deep-Learning - Udemy - Notes
- Research Notes - cv resources
- CONVOLUTIONAL NEURAL NETWORK (CNN)
Camera Sensor :
- How does a camera work? - Branch Education
- The Science of Camera Sensors - Filmmaker IQ
- Understanding The Digital Image Sensor
- Image Sensor
Computer Vision: - Computer Vision - Machine Perception - Depth Perception - Understanding Depth Perception in Computer Vision - Nasscom
Environment : - Optics - Light - Color Theory - Electromagnetic Radiation
Human perception : - Human Eye - Visual System - Visual Cortex
Signal Processing
Geometry - Stereometry or Solid Geometry - 3D (Objects) Geometry - Geometry Processing - 3D space
University of Toronto:
- CSC2541:Visual Perception for Autonomous Driving - Winter 2016 : http://www.cs.toronto.edu/~urtasun/courses/CSC2541/CSC2541_Winter16.html