20
That stat about AI training costs blew my mind
Was reading a report from Stanford's AI Index and found out training a single large language model like GPT-4 cost around $100 million in compute. I knew it was expensive but that number is just absurd when you think about it. Has anyone else seen wild cost numbers for these models that made you do a double take?
3 comments
Log in to join the discussion
Log In3 Comments
evan_davis14d ago
Man that's a tough number to sit with. Makes you wonder how anyone smaller can even get a foot in the door with costs like that.
8
aaron88014d ago
Honestly, used to think open source was just a hobbyist thing that couldn't keep up with the big players. But @evan_davis this post really flipped my view. Seeing universities like Stanford and MIT drop models that actually compete with the billion dollar stuff changed my mind. Tbh, that kind of access for a fraction of the cost is going to pull in a lot more smart people who would've been locked out.
2
kimw5714d ago
Figure that price tag is probably why we're seeing more open source models pop up, especially from universities wanting to compete without the billion dollar budget. Do you think that trend will shake up who controls AI in the long run?
1