Seminar, 3. When BERT plays the lottery, all tickets are winning

In the talk, Anna Rogers presented the paper: When BERT plays the lottery, all tickets are winning The lottery ticket hypothesis was originally developed for randomly initialized models, but might it also apply to pretrained Transformers If the good subnetworks exist, can they tell us anything about how BERT achieves its performance Full article: