I always thought hardware was harder than software. But all big hardware companies always had so many competitors and low rewards. While big software companies have few real competitors and high rewards. When openai came up with their models it seemed like something hard to replicate. Yet now we have so many companies coming up with similar models. On the other hand, Nvidia still doesn't have any competition in sight. What sets Nvidia apart? Really hard to understand whether a company has a big enough technological most or not.
Why amd can't support ml?
Openai didn't invent the tech, they polished it. The models themselves aren't that valuable, they are costly to make. So replicating their success was about $$$ spending on Nvidia stuff. Google uses TPUs so probably much cheaper than buying Nvidia cards. OpenAi will probably fold into Microsoft at some point.
The transformer model was developed by Google by the same folks who are now leading the openai. Google mgmt messed up and missed the train while openai and msft hit the bulls eye.
Want to tell me which folks? Because 80% aren't at openai?
Nvidia is winning because of the Cuda software support ecosystem. Most of the ML frameworks have support for this . Other hardware providers do not have that ecosystem