FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models

Jiaao He, Jidong Zhai, Tiago Antunes, Haojie Wang, Fuwen Luo, Shangfeng Shi, Qin Li
January, 2022
Cite DOI URL
Type
Conference paper
Publication
PPoPP ‘22: 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Seoul, Republic of Korea, April 2 - 6, 2022
Jiaao He
Jiaao He
Ph.D. Student
Jidong Zhai
Jidong Zhai
Professor
(长聘教授、博士生导师)
Tiago Antunes
MS Student
Haojie Wang
Haojie Wang
Researcher