Wang Receives NSF CAREER Award, Research Addresses Privacy Concerns in Videoconferencing
April 18, 2024
BATON ROUGE, LA – Since the pandemic, our primary means of interacting have evolved to include video conferencing applications, which are broadly used to connect geographically distant people for work, school, and even socially. During these interactions, it’s not uncommon for a user to turn off his or her microphone and/or camera out of concern for privacy. However, microphones and cameras can still leak other kinds of information beyond what is seen and heard through “micro signals,” which are too tiny for humans to recognize but detectable by machines.
Understanding and mitigating the risk these signals present is at the heart of LSU Computer Science Assistant Professor Chen Wang’s research, which was just funded by a National Science Foundation (NSF) CAREER Award.
“Any signals that are human-unobservable but machine-distinguishable are micro signals,” Wang said. “In online meetings, micro signals are the tiny audio and video signals, which are dominated by human speech and camera scenes and thus, usually unnoticed. We find that the audio feedback (i.e., echo sounds) in online meetings can bring location-dependent information back, which can be exploited to locate the user.
“So, when you turn off your camera or use a virtual background to hide your location, if your mic is on, your location may still be leaked. Moreover, we find that a video camera may capture your activities outside of its view angles. This is because the monitor’s screen lights and their reflections can be used for sensing the surroundings. Then, your secret actions in the camera’s blind spots, such as typing a password, may still be ‘seen’ by other meeting participants.”
An attacker can send malicious acoustic signals remotely, which sense the user’s physical surroundings and return to the attacker with location-specific echo signals. Deep-learning algorithms developed by the attacker are then used to circumvent the echo cancellation mechanisms enforced by audio streaming systems, maximizing the retrieval of sensitive echoes.
Wang’s research group will combat these attacks with targeted defenses that address their weaknesses separately, as well as broader techniques that cast a wider net.
“For example, we aim to detect suspicious echo sounds in online meetings and filter out these unwanted signals,” he said. “We can also shuffle the key positions to prevent an adversary from exploiting screen light signals to sense the user’s keystrokes off the camera.
“The general micro-signal removal aims to eliminate any micro signals and their variants, even if they are not identified by our study. We propose to develop AI algorithms to remove all micro signals from the audio and video data of online meetings without degrading the user experience.”
One added component of the project is that it will contribute to cybersecurity education through curriculum development, demo platform implementation, graduate/undergraduate student training, K-12 involvement, public outreach, and underrepresented student engagement in research.
On a more personal note, Wang said that the NSF CAREER Award marked a milestone in his career and served as recognition of his potential to serve as an academic role model in cybersecurity research and education.
“This five-year funding support enables me to continue working towards my career goal, ‘exploring unobtrusive sensing for enhanced security and better living and fostering cybersecurity education with hands-on learning,’” Wang said. “I would like to thank the LSU College of Engineering Research Facilitation Office, Provost’s Fund for Innovation Research-Summer Stipend, Louisiana Board of Regents Research Competitiveness Subprogram fund, and all of my lab students. They’ve helped me to achieve my academic success.”
Like us on Facebook (@lsuengineering) or follow us on X (formerly Twitter) and Instagram (@lsuengineering).
###
Contact: Joshua Duplechain
Director of Communications
225-578-5706
josh@lsu.edu
Latest College of Engineering News
- Computer Science PhD Student First to Receive Competitive AwardApril 25, 2024BATON ROUGE, LA - LSU Computer Science Ph.D. student Ruxin Wang is the recipient of the highly competitive 2024 Cyber-Physical Systems (CPS) Rising Stars Award, making her the first-ever LSU student to receive the honor. She is also the first female LSU student to publish a first-author security paper at one of the Big 4 Security conferences.
- LSU Mechanical Engineering Professor Designs Toxic Chemical SensorApril 24, 2024BATON ROUGE, LA - LSU Mechanical Engineering Associate Professor Manas Gartia is leading a team of researchers in designing a novel electrochemical sensor that will detect toxic chemicals in the environment. This sensor will help with environmental research, public health testing, and PFAS containment and alarm system.
- LSU Civil, Environmental Engineering Researchers Study Coastal Wetland Root DynamicsApril 16, 2024BATON ROUGE, LA - A team of LSU researchers led by LSU Civil and Environmental Engineering Associate Professor Navid Jafari (principal investigator) and LSU CEE Research Assistant Mohamed Hassan (co-PI) recently received a $50,000 National Science Foundation I-Corps grant to commercialize its algorithms in studying root productivity in Louisiana wetlands. A second grant was awarded by the Environmental Molecular Sciences Laboratory (EMSL), which is part of the Pacific Northwest National Laboratory in Richland, Wash., that allows the team to use X-ray computed tomography (XCT) and optical coherence tomography (OCT) scans to study these roots.
- LSU, Delaware and Johns Hopkins Researchers Examine the Mechanics of the Human BrainApril 4, 2024BATON ROUGE, LA - Faculty from LSU, the University of Delaware, and Johns Hopkins University are collaborating on a project that may help us better understand how fast or slow mechanical forces deform the brain during events such as falls and car crashes. Having this understanding is critical to developing computer models for predicting brain injury, as well as designing safer personal protective equipment and brain injury management and prevention strategies.
- LSU Mechanical Engineering Professor Researches Biodegradable, Metal-Free BatteriesApril 1, 2024BATON ROUGE, LA - Each year, Americans throw away more than 3 billion batteries, creating 180,000 tons of hazardous waste. Imagine how many more are discarded throughout the world. Thanks to a $50,000 grant, LSU Mechanical Engineering Associate Professor Ying Wang is exploring biodegradable, metal-free batteries that will be more sustainable in the medical field and less harmful on the environment.
- Kazemian Named Kavli Fellow by National Academy of SciencesMarch 28, 2024BATON ROUGE, LA - LSU Construction Management Assistant Professor Ali Kazemian has been named a Kavli Fellow by the National Academy of Sciences and was recently invited to give a talk at its symposium in Southern California on his research in Lunar robotic construction