Want to train a machine translation system? Train it on a gazillion pairs of sentences of parallel corpora, and that creates a lot of breakthrough results. Increasingly, I'm seeing results on small data where you want to try to take in results even if you have 1,000 images.

One of my philosophies of building companies is the importance of velocity.

I think the first wave of deep learning progress was mainly big companies with a ton of data training very large neural networks, right? So if you want to build a speech recognition system, train it on 100,000 hours of data.

Andrew Ng Quotes