Open-weight fashions are AI methods whose skilled parameters are publicly launched, which permits builders to run, fine-tune, and deploy them independently fairly than accessing them solely by a hosted API. Whereas closed-weight fashions from firms like OpenAI or Anthropic are delivered as managed companies, open-weight fashions give organizations direct management over how the fashions are deployed and used. Importantly, the efficiency of those fashions is steadily enhancing they usually’ve grow to be credible alternate options for manufacturing workloads, with benefits in customization and information privateness.
Fireworks AI is constructing a platform targeted on serving and customizing open-weight fashions at scale. The platform contains optimized inference infrastructure, multi-hardware assist throughout NVIDIA and AMD, and reinforcement fine-tuning capabilities.
Benny Chen is a Co-Founding father of Fireworks AI. On this episode, he joins Gregor Vand to debate his path from Meta’s ML infrastructure groups to co-founding Fireworks AI, why open-weight fashions have gotten more and more aggressive, how customized kernels and speculative decoding enhance efficiency, reinforcement fine-tuning, and rather more.
Gregor Vand is a security-focused technologist, having beforehand been a CTO throughout cybersecurity, cyber insurance coverage and normal software program engineering firms. He’s based mostly in Singapore and will be discovered through his profile at vand.hk or on LinkedIn.
Please click on right here to see the transcript of this episode.
Sponsorship inquiries: [email protected]
