Visual Mapping for Robotics/Augmented Reality

Virtual Reality Headset.

Contribute to core technologies that fuel spatial reasoning in future robotics and augmented reality applications. 

Project description

My lab works on Visual SLAM, a way to localize and map the surroundings using a camera. This is used on robots for navigation as well as in mobile systems for augmented reality applications. We are exploring several extensions to Visual SLAM including permanence reasoning, distributed operation and executing on resource-constrained platforms.

Students will learn concepts in Computer Vision, Machine Learning and Concurrency by participating in this project. I will need students with some background in programming, and the ability to spend 10-15 hours a week for multiple semesters.

Project outcome

Students will learn about visual spatial reasoning. Technical topics including modern computer vision (particularly multi-view geometry), machine learning, 2D (color) and 3D (depth) images, and working with large software systems.

The computer vision skills are directly relevant to several driverless car companies, augmented reality applications in companies such as Facebook reality labs, Magic Leap, MS Hololens etc., and other companies with mobile systems such as Google and Amazon.

Project details

Timing, eligibility and other details
Length of commitment Year-long (10-12 months) 
Start time 

Fall (August/September)

Summer (May/June)

Level of collaboration  Small group project (2-3 students) 
Benefits  Academic Credit 
Who is eligible  All undergraduate students 
Support Funding is available after the completion of the preparation badge. See below.

Core partners

Project mentor

Karthik Dantu

Associate Professor

Computer Science and Engineering

106 Davis Hall

Phone: (716) 645-2670



To engage with this project, you will work through a series of Project-Based Collaboration digital badges to guide your experience. 

To get started, contact the project mentor using the contact information above to discuss availability and after you’ve received approval, you can start the Project Preparation Digital Badge. Here are helpful tips on how to contact a project mentor

Preparation guidance

Once you have registered for the Project Preparation Digital Badge, you will receive further instructions related to the activities you will need to complete. In addition, you will also complete the following preparation activities for this particular project: