Visual Mapping for Robotics/Augmented Reality
Contribute to core technologies that fuel spatial reasoning in future robotics and augmented reality applications.
Project description
My lab works on Visual SLAM, a way to localize and map the surroundings using a camera. This is used on robots for navigation as well as in mobile systems for augmented reality applications. We are exploring several extensions to Visual SLAM including permanence reasoning, distributed operation and executing on resource-constrained platforms.
Students will learn concepts in Computer Vision, Machine Learning and Concurrency by participating in this project. I will need students with some background in programming, and the ability to spend 10-15 hours a week for multiple semesters.
Project outcome
Students will learn about visual spatial reasoning. Technical topics including modern computer vision (particularly multi-view geometry), machine learning, 2D (color) and 3D (depth) images, and working with large software systems.
The computer vision skills are directly relevant to several driverless car companies, augmented reality applications in companies such as Facebook reality labs, Magic Leap, MS Hololens etc., and other companies with mobile systems such as Google and Amazon.
Project details
| Length of commitment | Year-long (10-12 months) |
| Start time | Fall (August/September) Summer (May/June) |
| In-person, remote, or hybrid? | Remote |
| Level of collaboration | Small group project (2-3 students) |
| Benefits | Academic Credit |
| Who is eligible | All undergraduate students |
Core partners
Project mentor
Karthik Dantu
Associate Professor
Computer Science and Engineering
Start the project
- Email the project mentor using the contact information above to express your interest and get approval to work on the project. (Here are helpful tips on how to contact a project mentor.)
- After you receive approval from the mentor to start this project, click the button to start the digital badge. (Learn more about ELN's digital badge options.)
Preparation activities
Once you begin the digital badge series, you will have access to all the necessary activities and instructions. Your mentor has indicated they would like you to also complete the specific preparation activities below. Please reference this when you get to Step 2 of the Preparation Phase.
- Read about structure from motion. Here are a couple of links. Don't worry if this sounds too complicated. It'll give you an idea of what we do generally in Visual SLAM.
Keywords
Computer Science and Engineering