Detecting Deepfake Audio

Image of A.I. with Voice.

In this project, students will implement and test a number of state-of-the-art synthetic audio tools (including open-source ML/AI models) to explore the realm of possibilities in audio detection. 

Project description

Deepfake technologies, which allow malicious actors to produce fake images, videos, and audio clips, are reaching an unprecedented convergence of quality, scalability, and ease of use. It will soon be possible to mass-produce highly realistic synthetic content that may be generated and spread faster than fake media detectors can manage. The proliferation of  these technologies poses clear threats to society and democracy (for example, consider the dangers of shared videos wherein politicians give fake speeches). It appears that the future of information channels which we rely on when forming our beliefs and opinions is on the shaky ground, unless detection technology can gain the upper hand. Synthetic audio detection is one key element in managing this threat.

Project outcome

The project will culminate in a real-world exercise in which audio clips published in the recent Anthony Bourdain documentary "Roadrunner" - clips which the filmmakers claim to be indiscernible as real or fake - will be tested by the students' custom toolkit.  Students will generate: 

  • A system to detect audio deepfakes
  • Research reports and publications
  •  Students may be supported by APL Internship (paid).

Project details

Timing, eligibility and other details
Length of commitment Longer than a semester (about 6-9 months )
Start time Anytime
Level of collaboration Small group project (2-3 students)
Engagement format  Hybrid Project 
Benefits Research experience; academic credit; possible financial compensation 
Who is eligible
Sophmores and juniors with experince in programming (Python); machine learning; experience in classes at UB CSE preferred

Core partners

Project mentor

Siwei Lyu

Professor

Computer Science and Engineering

Phone: (716) 645-1587

Email: siweilyu@buffalo.edu

Start the project

  1. Email the project mentor using the contact information above to express your interest and get approval to work on the project. (Here are helpful tips on how to contact a project mentor.)
  2. After you receive approval from the mentor to start this project, click the button to start the digital badge. (Learn more about ELN's digital badge options.) 

Preparation activities

Once you begin the digital badge series, you will have access to all the necessary activities and instructions. Your mentor has indicated they would like you to also complete the specific preparation activities below. Please reference this when you get to Step 2 of the Preparation Phase.