Smartphone-enabled Football and Basketball Game Analytics

Currently, coaches manually take notes about game statistics (including players performance) during practices and games for future evaluation and analysis. There are a few automated systems which rely on wearable and infrastructure sensors, as well as advanced computer technologies such as wireless sensing and communications and computer vision to gather the performance and statistics. However, such systems are costly and thus not feasible for most teams.

The objective of this project is to develop an effective system that relies on coaches, smartphones and cloud, speech-to-text (STT) or voice-text (V2T), and natural language processing (NLP) technologies to gather statistics. The basic idea is to ask (assistant) coaches to vocally comment during practices/games using their smartphones, and use the V2T/STT and NLP technologies to automatically generate reports. Each coach on the team may focus on some aspects of the play (defense or offense side), or certain players, but the system will automatically fuse the reports together to generate a complete report.

Ideally, the game statistics can be made available and updated in near real-time, so the coaches can adjust their strategies during time out periods, intermissions or half-time.

Application Instructions -
We are looking for highly motivated and skilled students (with knowledge about the games and strong coding skills) who are willing to work in the Fall’22 semester for credits, or as a volunteer (please note that there is no pay and if you register for a course, you can earn course credits by working on this project without having to do other course work but you are responsible for paying the tuition as well).

Interested candidates should send an email with “Subj: V2T/STT for Sports Analytics” and include their resume to qiao@buffalo.edu, cstirone@buffalo.edu, cstirone@verizon.net
In the email, the candidates should also mention-
1. Position(s) they are interested in (mobile, backend, web)
2. Details of related experience in software development, esp in terms of V2T/STT and NLP.
3. The number of hours per week they are available to work on the project, and
4. whether they are interested in registering a relevant course (e.g., independent study or supervised research or a project course such as CSE 611) to earn credits.
The applications will be reviewed on a rolling basis until the positions are filled, so please apply asap.

A smartphone app that takes voice input, parses it and generates a game report, along with analytics results that can be accessed through smartphones or a web portal.

• Select local high school and college teams and coaches

sports, analytics, AI/ML, mobile app, computer science and engineering