Pipe-BD: Pipelined Parallel Blockwise Distillation

Jang, H; Jung, J; Song, J; Yu, J; Kim, Y; Lee, J

Jang, H (通讯作者),Seoul Natl Univ, Dept Elect & Comp Engn, Seoul, South Korea.

2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023; ():

Abstract

Training large deep neural network models is highly challenging due to their tremendous computational and memory requirements. Blockwise distillation ......

Full Text Link