Evaluating Large Language Models Trained on Code

Views: 2

Notion Link: 0:03 Outline and Quick Takeaways 4:08 Generation Examples 5:01 Deep Learning with Code Data 6:12 Language Modeling 8:50 Unit Test Evaluation 10:15 Repeated Sampling 13:28 Datasets Used for Codex 17:42 Results 24:04 Broader Impact 24:48 Quick Thoughts on Augmented Intelligence