CIO

Understanding transformers: What every leader should know about the architecture powering GenAI

GenAI isn’t magic — it’s transformers using attention to understand context at scale. Knowing how they work will help CIOs ...
Android Police

Transformers: Everything you need to know about the deep learning model

Ben Khalesi writes about where artificial intelligence, consumer tech, and everyday technology intersect for Android Police. With a background in AI and Data Science, he’s great at turning geek speak ...
SiliconANGLE

AI21 Labs’ updated hybrid SSM-Transformer model Jamba gets longest context window yet

OpenAI rival AI21 Labs Ltd. today lifted the lid off of its latest competitor to ChatGPT, unveiling the open-source large language models Jamba 1.5 Mini and Jamba 1.5 Large. The new models are based ...
VentureBeat

Microsoft trains world's largest Transformer language model

Microsoft AI & Research today shared what it calls the largest Transformer-based language generation model ever and open-sourced a deep learning library named DeepSpeed to make distributed training of ...
VentureBeat

Meta's new BLT architecture replaces tokens to make LLMs more efficient and versatile

The AI research community continues to find new ways to improve large language models (LLMs), the latest being a new architecture introduced by scientists at Meta and the University of Washington.
SiliconANGLE

Nvidia, AMD back $56.5M round for Essential AI Labs, led by Transformer architecture co-inventors

Essential AI Labs Inc., a startup led by two co-inventors of the foundational Transformer neural network architecture, today announced that it has raised $56.5 million from a group of prominent ...