Visual Mapping for Robotics/Augmented Reality

Virtual Reality Headset.

Contribute to core technologies that fuel spatial reasoning in future robotics and augmented reality applications. 

Project description

My lab works on Visual SLAM, a way to localize and map the surroundings using a camera. This is used on robots for navigation as well as in mobile systems for augmented reality applications. We are exploring several extensions to Visual SLAM including permanence reasoning, distributed operation and executing on resource-constrained platforms.

Students will learn concepts in Computer Vision, Machine Learning and Concurrency by participating in this project. I will need students with some background in programming, and the ability to spend 10-15 hours a week for multiple semesters.

Project outcome

Students will learn about visual spatial reasoning. Technical topics including modern computer vision (particularly multi-view geometry), machine learning, 2D (color) and 3D (depth) images, and working with large software systems.

The computer vision skills are directly relevant to several driverless car companies, augmented reality applications in companies such as Facebook reality labs, Magic Leap, MS Hololens etc., and other companies with mobile systems such as Google and Amazon.

Project details

Timing, eligibility and other details
Length of commitment Year-long (10-12 months) 
Start time 

Fall (August/September)

Summer (May/June)

In-person, remote, or hybrid?
Level of collaboration  Small group project (2-3 students) 
Benefits  Academic Credit 
Who is eligible  All undergraduate students 

Core partners

Project mentor

Karthik Dantu

Associate Professor

Computer Science and Engineering

106 Davis Hall

Phone: (716) 645-2670


Start the project

  1. Email the project mentor using the contact information above to express your interest and get approval to work on the project. (Here are helpful tips on how to contact a project mentor.)
  2. After you receive approval from the mentor to start this project, click the button to start the digital badge. (Learn more about ELN's digital badge options.) 

Preparation activities

Once you begin the digital badge series, you will have access to all the necessary activities and instructions. Your mentor has indicated they would like you to also complete the specific preparation activities below. Please reference this when you get to Step 2 of the Preparation Phase. 


Computer Science and Engineering