About Me

Since March 2022, I worked at Huawei as a senior research engineer. My work includes research on spatial audio and AI music, and promoting the launch of our technology onto Huawei products.

I joined the Distributed Systems Group in March 2017 as a research and teaching assistant. I successfully defended my doctoral thesis in June 2021. In January 2017, I received my M.Sc degree in Electrical Engineering and Information Technology from D-ITET, ETH Zurich. In July 2014, I received my B.Eng degree in Measuring and Control Technology and Instruments from Tianjin University.

From July 2021 to October 2021, I was a research intern at Nokia Bell Labs , Cambridge, UK. From June 2019 to September 2019, I was a visiting researcher at Empathic Computing Lab, Auckland Bioengineering Institute in Auckland, New Zealand. From November 2016 to January 2017, I was a research intern in the Social Computing Group at Idiap Research Institute in Martigny, Switzerland. From September 2015 to February 2016, I worked as a software engineer intern at Schindler Elevator Ltd. in Ebikon, Switzerland. In the academic year 2012-2013, I was an exchange student at The University of Hong Kong.

I always try to make a good work-life balance, although fail in most of the time, unfortunately :) Outside computer science, I enjoy reading books, watching movies, writing, drawing, and cooking. Besides, I keep the habit of practicing the flute and caligraphy.

Research

My research interests span multiple aspects about spatial audio, AI music, Augmented Reality (AR), Virtual Reality (VR), and Human-Computer Interaction (HCI). I aim to enhance people's auditory sense to facilitate intuitive, immersive, and intelligent human interactions with their local surroundings and remote environments in a range of domains. In addition, I aim to create novel auditory and musical applications for users to enjoy cutting-edge multimedia services in everyday life.

Activities

Program committee member: ETRA 2022, 2021.

Reviewer: I have been regularly reviewing papers, doctoral consortium submissions, demos, and posters for ETRA, IUI, VRST, CHI, IEEE VR, IMWUT, and Journal on Multimodal User Interfaces.

Publications
Google ScholarResearchGate

Student Projects

Master project

Autumn Semester 2020 (completed)
Musical Timbre Transfer for Arbitrary Notification Sounds for Less Intrusive Notification Delivery

Student: Andreas Roth
Supervisor: Jing Yang
In this project, we developed a method to transfer notification music into different musical timbres for less intrusive notification delivery.

Lab project

Spring Semester 2020 (completed)
Audio Style Transfer for Seamless Integration of Notifications into Music

Student: Tristan Cinquin
Supervisor: Jing Yang, Gábor Sörös
In this project, we explored audio style transfer technique and applied it to seamlessly integrate notifications into background music.

Semester project

Spring Semester 2019 (completed)
Inside-out Acoustic Head Tracking Using Imaginary Anchor Sources

Student: Felix Pfreundtner
Supervisor: Jing Yang, Gábor Sörös
We proposed a method to infer a person's head pose based on the room impulse response. We tested the method in simulated environments and real-world rooms.

Bachelor project

Spring Semester 2019 (completed)
Gaze Tracking-based Audio Augmentation

Student: Cheuk Yu Chan
Supervisor: Jing Yang
We implemented a prototype that activated audio augmentation based on a user's visual focus. We tested the prototype's applicability in a museum scenario, in which the gaze-based audio augmentation could enrich people's perception of paintings.

Master project

Autumn Semester 2018 (completed)
Ultrasound Based Device-Free Gesture Tracking

Student: Kim Marbach
Supervisor: Jing Yang
In this project, we implemented an ultrasound-based system that can track the user's hand movements around the smartphone. Besides, we built a NN-based gesture and speech recognition pipeline. We integrated both frameworks on a smartphone for touchless control and interactions. We proposed two demos to showcase the application.

Bachelor project

Autumn Semester 2018 (completed)
Spatial Audio based Motion Reaction on Smartphones

Student: Daniel Gstöhl
Supervisor: Jing Yang
In this project, we explored the interaction with smartphone based on spatial audio signals and motion gestures. We designed a rhythm game to demonstrate the idea.

Master project

Spring Semester 2018 (completed)
Spatial Audio for Human-Object Interactions

Student: Yves Frank
Supervisor: Jing Yang, Gábor Sörös
We aim to develop a system that can produce spatial audio messages from the object to the user in real time, which enhances a quick and lively interaction between the user and the objects.

Bachelor project

Autumn Semester 2017 (completed)
Eye Contact Detection on Constrained Devices

Student: Philipp Schimmelfennig
Supervisor: Mihai Bâce, Jing Yang
We explored computer vision and machine learning methods to detect eye contact in real time on constrained devices like Raspberry Pi.

Master project

Autumn Semester 2017 (completed)
User-centric rendering for handheld augmented reality

Student: Shiheng Wang
Supervisor: Jing Yang, Gábor Sörös
We developed a user-perspective rendering system on hand-held mobile devices. The system can render the digital contents from the user's viewpoint instead of an arbitrary perspective such as the rear camera of the smartphone.

Master project

Spring Semester 2017 (completed)
Incorporating Spatio-Temporal Context for Predicting the Next Place Using Neural Networks and Random Forests

Student: Jorim Urner
Supervisor: Dominik Bucher, Jing Yang, David Jonietz
We explored how GPS data obtained from smartphone users can be used to predict the user's next place based on neural networks and random forests.

Teaching

Informatik II

This course is for Bachelor's students at Department of Information Technology and Electrical Engineering. This course covers the most common problem solving methods, algorithms, data structures, and Java coding practices. My duty mainly included weekly 1-hour tutorial, exercise correction, and exam correction.

Informatik I

This course is for Bachelor's students at Department of Mechanical Engineering. This course covers fundamental programming and operational skills for developing high-quality programs in C++ language. My duty mainly included weekly 2-hour tutorial, assignment correction, and exam correction.

Einführung in die Programmierung

This course is for Bachelor's students at Department of Computer Science. This course covers introduction to fundamental concepts of modern programming and operational skills for developing high-quality programs, including large programs as in industry. My duty mainly included weekly 2-hour tutorial, assignment correction, and exam correction.

Seminar on Computational Haptics

This seminar aims to familiarize students with exciting new research topics in the area of computational haptics and teach basic scientific writing and oral presentation skills.

Contact Form
Feel free to contact me