RT @OpenAI@twitter.com

Since 2012, the amount of compute for training to AlexNet-level performance on ImageNet has been decreasing exponentially — halving every 16 months, in total a 44x improvement.

By contrast, Moore's Law would only have yielded an 11x cost improvement: https://openai.com/blog/ai-and-efficiency/

🐦🔗: https://twitter.com/OpenAI/status/1257701921969901569