this is the list of readings recommended by Ilya himself. learn these and you'll have a decent understanding of the industry in todays world.
- The Annotated Transformer
- The First Law of Complexodynamics
- The Unreasonable Effectiveness of Recurrent Neural Networks
- Understanding LSTM Networks
- Recurrent Neural Network Regularization
- Keeping Neural Networks Simple by Minimizing the Description Length of the Weight
- Pointer Networks
- ImageNet Classification with Deep Convolutional Neural Networks
- Order Matters: Sequence to Sequence for Sets
- GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism
- Deep Residual Learning for Image Recognition
- Multi-Scale Context Aggregation by Dilated Convolutions
- Neural Message Passing for Quantum Chemistry
- Attention Is All You Need
- Neural Machine Translation by Jointly Learning to Align and Translate
- Identity Mappings in Deep Residual Networks
- A simple neural network module for relational reasoning
- Variational Lossy Autoencoder
- Relational recurrent neural networks
- Quantifying the Rise and Fall in Closed Systems: The Coffee Automation
- Neural Turing Machines
- Deep Speech 2: End-toEnd Speech Recognition in English and Mandarin
- Scaling Laws for Neural Language Models
- A Tutorial Introduction to the Minimum Description Length Principle
- Scaling Laws for Neural Language Models
- A Tutorial Introduction to the Minimum Description Length Principle
- Machine Super Intelligence
- Kolmogorov Complexity and Algorithmic Randomness
- CS321n Convolutional Neural Networks for Visual Recognition