Simply by waiting for faster GPUs and bigger datasets
Alex Krizhevsky, Ilya Sutskever and Geoffrey Hinton, 3 December 2012 (Advances in Neural Information Processing Systems 25 (NIPS 2012)). University of Toronto researchers describe the convolutional network, later called AlexNet, that won the ImageNet challenge in 2012 with a top-5 test error rate of
ImageNet Classification with Deep Convolutional Neural Networks
AI and science · Before ChatGPT
Who else?
What it refers to: The network's ImageNet results, limited mainly by GPU memory and training time, with training taking five to six days on two GTX 580 GPUs.
Other voices
- “No learning technique can succeed without a minimal amount of prior knowledge” Yann LeCun et al.,
- “Is it possible to learn a face detector using only unlabeled images?” Quoc V. Le, Andrew Ng, Jeff Dean et al.,
- “Human evaluators have difficulty distinguishing from articles written by humans” Brown et al.,
- “Models emit substantial carbon emissions” Emma Strubell et al.,
- “Machine learning has become alchemy” Ali Rahimi,
