xAI Releases Grok-1 — The Biggest Open-Source LLM

Jim Clyde Monge
Generative AI
5 min readMar 18, 2024

--

xAI Releases Grok-1 — The Biggest Open-Source LLM
Image by Jim Clyde Monge

Elon Musk’s artificial intelligence company, xAI, has released the weights and architecture of their 314 billion parameter Mixture-of-Experts model, Grok-1, under the Apache 2.0 license.

This follows a pledge by Musk last Monday to make Grok freely available to the public. As someone who has been closely following developments in the AI space, I have to say this is a massive…

--

--