AI Winter
Why would they write an article about the chief saying it’s going to stagnate? Why attract bad press, doesn’t make sense
He just says that there are limits to what the current approach is capable of. Neural networks are excellent for many things, but are really just an advanced form of pattern matching and aren't capable of general intelligence, so there's only so much we can do with them. That's what I took away at least
*Pictures a robot running into a wall*
A major problem with neural networks people are realizing is that it takes enormous data sets to train. That itself is a huge limitation
And all it does is do pattern matching on the elements.
He says that the cost of the compute power needed will exceed the benefit of current AI tech, hitting the ROI wall
Yes and now even gpu are being limited by the size of data bus
We need a step change to get to some version of machine consciousness, but so far all research has been incremental.
But what does Yann think?
rtfa and figure it out
I always thought “hit a wall” meant you got stuck. E.g., you hit a blocker at work and can’t figure something out.