Multimodal by Bakz T. Future

Share this post

Cerebras Systems sets record for largest AI models ever trained on one device

bakztfuture.substack.com

Cerebras Systems sets record for largest AI…

Bakz T. Future
Jun 22, 2022
2
Share this post

Cerebras Systems sets record for largest AI models ever trained on one device

bakztfuture.substack.com

The LLM/Multimodal AI community achieved a significant hardware milestone today, from a venturebeat article we see that: The Cerebras CS-2 system can train multibillion-parameter natural language processing (NLP) models including GPT-3XL 1.3 billion models, as well as GPT-J 6B, GPT-3 13B and GPT-NeoX 20B. Cerebras said that for the first time ever, a single CS-2 system with one Cerebras wafer can train models with up to 20 billion parameters — a feat not possible on any other single device. One of the CS-2 systems fits inside a standard datacenter rack and it’s about 26 inches tall.

Read →
  • New First
  • Chronological
© 2023 Bakz T. Future
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing