Andrej Karpathy Joins Anthropic: Should We Care?
So, Andrej Karpathy, the co-founder of OpenAI, has decided to lend his talents to Anthropic's pre-training team. For those not drowning in AI jargon every day, pre-training is that magical phase where AI models like Claude get their brains. It's also the phase that burns through more computing power than a small country.
The Pre-Training Hype
According to Anthropic, "Pre-training is responsible for the large-scale training runs that give Claude its core knowledge and capabilities." Sounds impressive, right? But let's not forget, it's also one of the most expensive and compute-intensive phases of building a frontier model. So, while everyone's busy clapping for Karpathy's new gig, maybe we should be asking who's footing the bill.
The Cost of AI Stardom
Here's a fun fact: the service is offered at a whopping $250 per month. For SMEs, that's not pocket change. But hey, who needs to pay rent when you can have the latest chatbot, right?
The Usual Suspects
- OpenAI: Still making headlines, especially after signing a controversial agreement with the U.S. military. Because nothing says "trustworthy AI" like military contracts.
- Anthropic: Trying to keep its head above water after the Pentagon's risk designation. Good luck with that.
- Claude: The chatbot that's supposedly challenging market leaders. But let's see how it fares when the hype dies down.
The Real Threats
- Compute Intensity: Pre-training is a resource hog. It's like trying to run a marathon with a backpack full of bricks.