>>> MediaRobotics II
DMS 534 BOH Sensing/Machine Vision
Associate Professor Marc Böhlen
(marcbohlen-AT-acm-DOT-org),
TA Chris Caporlingua
(ccaporlingua-AT-gmail-DOT-com),
Reg.#363122
Mon/Wed 1 - 2:50, CFA 246
 



This course addresses data acquisition and processing in the context of digital media arts. Understanding sensors and their limitations is an important prerequisite to building robust and satisfying information processing artifacts. This course will allow students to better understand both the concepts as well as the techniques underlying a variety of sensor typologies and various data acquisition approaches.

While the course covers technical materials, the goal of the course is to uncover new possibilities with which students can investigate digital data and imagery. As opposed to courses that manipulate image data through commerdial applications such as Photoshop, this course works with general purpose programing and mathematical tools that offer opportunities and freedoms prepackaged software solutions deny. Course materials include readings in perception theory, sensor design, fundamentals of machine vision as well as documentation of select art works that engage in various fashions in advanced sensing methods.

Our lab is Ubuntu based and has a wide array of sensor types, an industry grade commercial machine vision library as well as an open source research grade vision library. We also have microprocessor based ccd cameras, ieee1394 compliant digital cameras, analogue video cameras with fast frame grabber cards and use Python under Wingware (both opensource) for this course. With this infrastructure and instructor guidance, students will be able to explore new ways of seeing, hearing and feeling and become familiar with software culture.

Prerequisites: MediaRobotics I or equivalent


Here are video documents of student work from previous MRII courses
2006
Brian Clark: underpants [.mpg], Bogdan Marion: flag [.mpg], Jesse Fabian: portaroad [.mpg]
2008
Steve Hibit: somewhere in France [.mp4], Chris Caprolingua: face [.wmv], Steve Korzelius: jack 1.0 [.wmv]


Here are the lecture notes, source code and tutorials for MRII





SYLLABUS (subject to change)

W1
Introduction
Human and animal perception

W2

Fundamentals of sensing
Lab: python tutorial

W3
Fundamentals of sensing
Lab: opengl tutorial

W4
acoustic sensors
Lab: opencv tutorial

W5
temperature and acceleration sensors
Lab: pil tutorial

W6
sound and tactile sensors
Lab: cameras, lenses, ccd cells

W7
proximity and motion sensors
Lab: webcam access via python

W8
image as data; cameras, lenses
Lab: examples and exercises

W9

mathematical operations on image data
Lab: examples and exercises

W10
image filtering
Lab: examples and exercises

W11

image segmentation
Lab: examples and exercises

W12

feature extraction
Lab: artists working with machine vision

W13 - W16

Project development