VentureBeat

New transformer architecture can make language models faster and resource-efficient

Large language models like ChatGPT and Llama-2 are notorious for their extensive memory and computational demands, making them costly to run. Trimming even a small fraction of their size can lead to ...
ZDNet

Microsoft and Nvidia create 105-layer, 530 billion parameter language model that needs 280 A100 GPUs, but it's still biased

Nvidia and Microsoft have teamed up to create the Megatron-Turing Natural Language Generation model, which the duo claims is the "most powerful monolithic transformer language model trained to date".
Android Police

Transformers: Everything you need to know about the deep learning model

Ben Khalesi writes about where artificial intelligence, consumer tech, and everyday technology intersect for Android Police. With a background in AI and Data Science, he’s great at turning geek speak ...
Forbes

Transformers Revolutionized AI. What Will Replace Them?

The transformer, today's dominant AI architecture, has interesting parallels to the alien language in the 2016 science fiction film "Arrival." If modern artificial intelligence has a founding document ...
InfoWorld

Large language models: The foundations of generative AI

Large language models evolved alongside deep-learning neural networks and are critical to generative AI. Here's a first look, including the top LLMs and what they're used for today. Large language ...