Visual Mapping for Robotics/Augmented Reality

Contribute to core technologies that fuel spatial reasoning in future robotics and augmented reality applications.

Project description

My lab works on Visual SLAM, a way to localize and map the surroundings using a camera. This is used on robots for navigation as well as in mobile systems for augmented reality applications. We are exploring several extensions to Visual SLAM including permanence reasoning, distributed operation and executing on resource-constrained platforms.

Students will learn concepts in Computer Vision, Machine Learning and Concurrency by participating in this project. I will need students with some background in programming, and the ability to spend 10-15 hours a week for multiple semesters.

Project outcome

Students will learn about visual spatial reasoning. Technical topics including modern computer vision (particularly multi-view geometry), machine learning, 2D (color) and 3D (depth) images, and working with large software systems.

The computer vision skills are directly relevant to several driverless car companies, augmented reality applications in companies such as Facebook reality labs, Magic Leap, MS Hololens etc., and other companies with mobile systems such as Google and Amazon.

Project details

Timing, eligibility and other details
Length of commitment	Year-long (10-12 months)
Start time	Fall (August/September) Summer (May/June)
In-person, remote, or hybrid?	Remote
Level of collaboration	Small group project (2-3 students)
Benefits	Academic Credit
Who is eligible	All undergraduate students

Core partners

Project mentor

Karthik Dantu

Associate Professor

Computer Science and Engineering

106 Davis Hall

Phone: (716) 645-2670

Email: kdantu@buffalo.edu

Start the project

Email the project mentor using the contact information above to express your interest and get approval to work on the project. (Here are helpful tips on how to contact a project mentor.)
After you receive approval from the mentor to start this project, click the button to start the digital badge. (Learn more about ELN's digital badge options.)

Start the Digital Badge

Preparation activities

Once you begin the digital badge series, you will have access to all the necessary activities and instructions. Your mentor has indicated they would like you to also complete the specific preparation activities below. Please reference this when you get to Step 2 of the Preparation Phase.

Read about structure from motion. Here are a couple of links. Don't worry if this sounds too complicated. It'll give you an idea of what we do generally in Visual SLAM.

Keywords