Developing on NVIDIA® Jetson™ for AI on the Edge

Low-Level Robot Vision – Sertac Karaman

At a recent MIT/Lincoln Labs 2017 Beaver Works Summer Institute Seminar, Sertac Karaman gave a lecture on low-level robot vision. Looky here:


With the advent of the digital camera, vision sensors have become ubiquitous. Combining vision sensors with GPU computing elements enables a breakthrough in camera based perception for a wide range of applications. In this lecture, we find out how this can be applied to mobile robots. As this information forms a basis for programming the MIT RACECAR, a NVIDIA Jetson based robot, we cover that information here.

In the lecture, Dr. Karaman gives a short history of computer vision and then expounds on how modern low-level robot vision systems work. Topics include:

  • Camera as sensor
  • Color representation
  • Object detection
  • Camera calibration

Much of this lecture is drawn from material covered in actual MIT classes.

There are many more lectures available in this summer series, with a wide range of subject matter. We will be providing pointers to the lectures that directly address the RACECAR, but it’s worth going through the playlist to find other topics which may interest you.

Note that these lectures are given to high school senior students.

Note: In case there are browser issues, the YouTube address is:

Note: Some people find it helpful to set the playback speed for these types of videos to 1.25X on YouTube, the setting is available in the settings menu. This saves a little time while watching, but the fidelity is still good enough to understand the lecture. You can always put it back to normal speed for the tricky bits.


Leave a Reply

Your email address will not be published. Required fields are marked *


Some links here are affiliate links. If you purchase through these links I will receive a small commission at no additional cost to you. As an Amazon Associate, I earn from qualifying purchases.

Books, Ideas & Other Curiosities