Dr. sc. ETH Zurich
Senior Research Engineer at Huawei
Previously at ETH Zurich, Nokia Bell Labs, and Auckland Bioengineering Institute
Last updated: 21.03.2023
Explore the world with childlike curiosity
Since March 2022, I worked at Huawei as a senior research engineer. My work includes research on spatial audio and AI music, and promoting the launch of our technology onto Huawei products.
I joined the Distributed Systems Group in March 2017 as a research and teaching assistant. I successfully defended my doctoral thesis in June 2021. In January 2017, I received my M.Sc degree in Electrical Engineering and Information Technology from D-ITET, ETH Zurich. In July 2014, I received my B.Eng degree in Measuring and Control Technology and Instruments from Tianjin University.
From July 2021 to October 2021, I was a research intern at Nokia Bell Labs , Cambridge, UK. From June 2019 to September 2019, I was a visiting researcher at Empathic Computing Lab, Auckland Bioengineering Institute in Auckland, New Zealand. From November 2016 to January 2017, I was a research intern in the Social Computing Group at Idiap Research Institute in Martigny, Switzerland. From September 2015 to February 2016, I worked as a software engineer intern at Schindler Elevator Ltd. in Ebikon, Switzerland. In the academic year 2012-2013, I was an exchange student at The University of Hong Kong.
I always try to make a good work-life balance, although fail in most of the time, unfortunately :) Outside computer science, I enjoy reading books, watching movies, writing, drawing, and cooking. Besides, I keep the habit of practicing the flute and caligraphy.
My research interests span multiple aspects about spatial audio, AI music, Augmented Reality (AR), Virtual Reality (VR), and Human-Computer Interaction (HCI). I aim to enhance people's auditory sense to facilitate intuitive, immersive, and intelligent human interactions with their local surroundings and remote environments in a range of domains. In addition, I aim to create novel auditory and musical applications for users to enjoy cutting-edge multimedia services in everyday life.
Program committee member: ETRA 2022, 2021.
Reviewer: I have been regularly reviewing papers, doctoral consortium submissions, demos, and posters for ETRA, IUI, VRST, CHI, IEEE VR, IMWUT, and Journal on Multimodal User Interfaces.
- Jing Yang, Amit Barde, Mark Billinghurst
Audio Augmented Reality: A Systematic Review of Technologies, Applications, and Future Research Directions
Journal of the Audio Engineering Society 70 (10), 788-809, October 2022 - Jing Yang, Chulhong Min, Akhil Mathur, Fahim Kawsar
SleepGAN: Towards Personalized Sleep Therapy Music
Proceedings of the 47th International Conference on Acoustics, Speech and Signal Processing (ICASSP 2022). IEEE, Singapore, May 2022 - Jing Yang, Andreas Roth
Musical Features Modification for Less Intrusive Delivery of Popular Notification Sounds
Proceedings of the 26th International Conference on Auditory Display (ICAD 2021). Virtual Conference, June 2021
Abstract, BibTex - Jing Yang, Tristan Cinquin, Gábor Sörös
Unsupervised Musical Timbre Transfer for Notification Sounds
Proceedings of the 46th International Conference on Acoustics, Speech and Signal Processing (ICASSP 2021). IEEE, Toronto, Canada, June 2021
Abstract, BibTex - Felix Pfreundtner, Jing Yang, Gábor Sörös
(W)earable Microphone Array and Ultrasonic Echo Localization for Coarse Indoor Environment Mapping
Proceedings of the 46th International Conference on Acoustics, Speech and Signal Processing (ICASSP 2021). IEEE, Toronto, Canada, June 2021
Abstract, BibTex - Huidong Bai, Li Zhang, Jing Yang, Mark Billinghurst
Bringing Full-Featured Mobile Phone Interaction into Virtual Reality
Computers & Graphics (CAG), April 2021
Abstract, BibTex - Jing Yang, Felix Pfreundtner, Amit Barde, Kurt Heutschi, Gábor Sörös
Fast Synthesis of Perceptually Adequate Room Impulse Responses from Ultrasonic Measurements
Proceedings of the 15th International Audio Mostly Conference (AM 2020). ACM, Graz, Austria, September 2020
Abstract, BibTex - Jing Yang, Prasanth Sasikumar, Huidong Bai, Amit Barde, Gábor Sörös, Mark Billinghurst
The Effects of Spatial Auditory and Visual Cues on Mixed Reality Remote Collaboration
Journal on Multimodal User Interfaces, June 2020
Abstract, BibTex - Huidong Bai, Prasanth Sasikumar, Jing Yang, Mark Billinghurst
A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2020). ACM, Honolulu, HI, USA, April 2020
Abstract, BibTex - Jing Yang, Cheuk Yu Chan
Audio-Augmented Museum Experiences with Gaze Tracking
Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (MUM 2019). ACM, Pisa, Italy, November 2019
Abstract, BibTex - Jing Yang, Gábor Sörös
Audio-Augmented Museum Experiences using Wearable Visual-Inertial Odometry
Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (MUM 2019). ACM, Pisa, Italy, November 2019
Abstract, BibTex - Jing Yang, Friedemann Mattern
Audio Augmented Reality for Human-Object Interactions
Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (UbiComp/ISWC 2019). ACM, London, UK, September 2019
Abstract, BibTex - Jing Yang, Yves Frank, Gábor Sörös
Hearing Is Believing: Synthesizing Spatial Audio from Everyday Objects to Users
Proceedings of the 10th Augmented Human International Conference (AH 2019). ACM, Reims, France, March 2019
Abstract, BibTex - Jing Yang, Shiheng Wang, Gábor Sörös
User-Perspective Rendering for Handheld Applications
2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct 2018). IEEE, Munich, Germany, October 2018
Abstract, BibTex - Jing Yang, Gábor Sörös
Poster: Spatial Audio for Human-Object Interactions in Small AR Workspaces
(Best Poster Award)
Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys 2018). ACM, Munich, Germany, June 2018
Abstract, BibTex - Jorim Urner, Dominik Bucher, Jing Yang, David Jonietz
Assessing the Influence of Spatio-Temporal Context for Next Place Prediction using Different Machine Learning Approaches ISPRS International Journal of Geo-Information. Vol. 7, No. 5, Multidisciplinary Digital Publishing Institute, pp. 166, May 2018
Abstract, BibTex - Jing Yang, Carsten Eickhoff
Unsupervised Learning of Parsimonious General-Purpose Embeddings for User and Location Modeling
ACM Transactions on Information Systems (TOIS 2018), Vol. 36, No. 32, ACM, pp. 32:1--32:33, March 2018
Abstract, BibTex - Jing Yang, Gábor Sörös
Augmenting Smart Object Interactions with Smart Audio
Proceedings of the 9th Augmented Human International Conference (AH 2018). ACM, pp. 28:1 - 28:3, Seoul, Republic of Korea, February 2018
Abstract, BibTex - Zack Zhu, Jing Yang, Chen Zhong, Julia Seiter, Gerhard Tröster
Learning Functional Compositions of Urban Spaces with Crowd-Augmented Travel Survey Data
Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL 2015). ACM, pp. 22:1--22:10, Bellevue, WA, USA, November 2015
Abstract, BibTex - Jing Yang, Zack Zhu, Julia Seiter, Gerhard Tröster
Informative Yet Unrevealing: Semantic Obfuscation for Location Based Services
Proceedings of the 2nd Workshop on Privacy in Geographic Information Collection and Analysis (GeoPrivacy 2015). ACM, pp. 4:1--4:8, Bellevue, WA, USA, November 2015
Abstract, BibTex
Master project
Student: Andreas Roth
Supervisor: Jing Yang
In this project, we developed a method to transfer notification music into different musical timbres for less intrusive notification delivery.
Lab project
Student: Tristan Cinquin
Supervisor: Jing Yang, Gábor Sörös
In this project, we explored audio style transfer technique and applied it to seamlessly integrate notifications into background music.
Semester project
Student: Felix Pfreundtner
Supervisor: Jing Yang, Gábor Sörös
We proposed a method to infer a person's head pose based on the room impulse response. We tested the method in simulated environments and real-world rooms.
Bachelor project
Student: Cheuk Yu Chan
Supervisor: Jing Yang
We implemented a prototype that activated audio augmentation based on a user's visual focus. We tested the prototype's applicability in a museum scenario, in which the gaze-based audio augmentation could enrich people's perception of paintings.
Master project
Student: Kim Marbach
Supervisor: Jing Yang
In this project, we implemented an ultrasound-based system that can track the user's hand movements around the smartphone. Besides, we built a NN-based gesture and speech recognition pipeline. We integrated both frameworks on a smartphone for touchless control and interactions. We proposed two demos to showcase the application.
Bachelor project
Student: Daniel Gstöhl
Supervisor: Jing Yang
In this project, we explored the interaction with smartphone based on spatial audio signals and motion gestures. We designed a rhythm game to demonstrate the idea.
Master project
Student: Yves Frank
Supervisor: Jing Yang, Gábor Sörös
We aim to develop a system that can produce spatial audio messages from the object to the user in real time, which enhances a quick and lively interaction between the user and the objects.
Bachelor project
Student: Philipp Schimmelfennig
Supervisor: Mihai Bâce, Jing Yang
We explored computer vision and machine learning methods to detect eye contact in real time on constrained devices like Raspberry Pi.
Master project
Student: Shiheng Wang
Supervisor: Jing Yang, Gábor Sörös
We developed a user-perspective rendering system on hand-held mobile devices. The system can render the digital contents from the user's viewpoint instead of an arbitrary perspective such as the rear camera of the smartphone.
Master project
Student: Jorim Urner
Supervisor: Dominik Bucher, Jing Yang, David Jonietz
We explored how GPS data obtained from smartphone users can be used to predict the user's next place based on neural networks and random forests.
This course is for Bachelor's students at Department of Information Technology and Electrical Engineering. This course covers the most common problem solving methods, algorithms, data structures, and Java coding practices. My duty mainly included weekly 1-hour tutorial, exercise correction, and exam correction.
This course is for Bachelor's students at Department of Mechanical Engineering. This course covers fundamental programming and operational skills for developing high-quality programs in C++ language. My duty mainly included weekly 2-hour tutorial, assignment correction, and exam correction.
This course is for Bachelor's students at Department of Computer Science. This course covers introduction to fundamental concepts of modern programming and operational skills for developing high-quality programs, including large programs as in industry. My duty mainly included weekly 2-hour tutorial, assignment correction, and exam correction.
This seminar aims to familiarize students with exciting new research topics in the area of computational haptics and teach basic scientific writing and oral presentation skills.