EECS and CITRIS Frontiers in Technology presents Dr. Murali Annavaram on March 11, 12p

The Electrical Engineering and Computer Science Graduate Group and CITRIS UC Merced are pleased to host the Frontiers in Technology Distinguished Speaker Series, featuring Dr. Murali Annavaram, expert in computer architecture and machine learning, the founding director of REAL@USC-Meta Center, and Professor in the Ming-Hsieh Department of Electrical and Computer Engineering at the University of Southern California.

Frontiers in Technology Distinguished Speaker Series
Featuring Dr. Murali Annavaram

Training ML Models with Private Data on Untrusted Hardware

Friday, March 11, 2022

12-1 PM

COB 1, 205, UC Merced

Join on zoom bit.ly/FITMurali

Abstract:

Privacy and security-related concerns are growing as machine learning reaches diverse application domains. The data holders want to train or infer with private data while exploiting accelerators, such as GPUs, that are hosted in the cloud. Cloud systems are vulnerable to attackers that compromise the privacy of data and integrity of computations. Tackling such a challenge efficiently requires exploiting hardware security capabilities to reduce the cost of theoretical privacy algorithms. This talk will describe my group’s recent experiences in building privacy preserving machine learning systems. I will present DarKnight, a framework for large DNN training while protecting input privacy and computation integrity. DarKnight relies on cooperative execution between trusted execution environments (TEE) and accelerators, where the TEE provides privacy and integrity verification, while accelerators perform the bulk of the linear algebraic computation to optimize the performance.  

In the second part of my talk I will focus on ML training challenges in the cloud: namely, stragglers and Byzantine nodes. Unlike prior works that try to tackle these challenges in a unified framework, I will make a case for treating stragglers and Byzantine nodes as two distinct challenges. I will present our recent work called Adaptive Verifiable Coded Computing (AVCC)  that decouples the Byzantine node detection challenge from the straggler tolerance. AVCC leverages coded computing just for handling stragglers and privacy, and then uses an orthogonal approach that leverages verifiable computing to mitigate Byzantine workers.  AVCC dynamically adapts its coding scheme to trade-off straggler tolerance with Byzantine protection.  I will conclude with some of my thoughts on ML privacy and security going forward.

Speaker Bio: 

Murali Annavaram is a Professor in the Ming-Hsieh Department of Electrical and Computer Engineering and in the department of Computer Science (joint appointment) at the University of Southern California. He is the founding director of the REAL@USC-Meta center that is focused on research and education in AI and learning. His research group tackles a wide range of computer system design challenges, relating to energy efficiency, security and privacy. He has been inducted to the hall of fame for three of the prestigious computer architecture conferences ISCA, MICRO and HPCA. He served as a Technical Program Chair for HPCA 2021, and served as the General Co-Chair for ISCA 2018. Prior to his appointment at USC he worked at Intel Microprocessor Research Labs from 2001 to 2007. His work at Intel lead to the first 3D microarchitecture paper, and also influenced Intel’s TurboBoost technology. In 2007 he was a visiting researcher at the Nokia Research Center working on mobile phone-based wireless traffic sensing using virtual trip lines, which later become Nokia Traffic Works product. In 2020 he was a visiting faculty scientist at Facebook, where he designed the checkpoint systems for distributed training. Murali co-authored Parallel Computer Organization and Design, a widely used textbook to teach both the basic and advanced principles of computer architecture. Murali received the Ph.D. degree in Computer Engineering from the University of Michigan, Ann Arbor, in 2001. He is a Fellow of IEEE and Senior Member of ACM.    

Tea, coffee, and cookies will be available at the talk. If you would like to meet with Dr. Annavaram during his visit or if you have any questions about the event please contact Leigh Bernacchi citris@ucmerced.edu.

[Citris.ucmerced.edu/events]citris.ucmerced.edu/events]