LLMs excel at compressing images and audio, reveals DeepMind study

September 26, 2023
LLMs excel at compressing images and audio, reveals DeepMind study

Don’t miss out on the exciting sessions from VB Transform 2023! Register now to access our on-demand library.


Prepare to see Large Language Models (LLMs) in a whole new light. These AI systems, known for their ability to predict the next part of a word, are now being recognized as powerful data compressors. A recent research paper by Google’s DeepMind suggests that LLMs can effectively compress information, sometimes even outperforming traditional compression algorithms. This fresh perspective offers valuable insights into the development and evaluation of LLMs.

“The compression aspect of learning and intelligence has been known to some researchers for a long time,” says Anian Ruoss, Research Engineer at Google DeepMind and co-author of the paper. “However, most machine learning researchers today are (or were) unaware of this crucial equivalence, so we decided to try to popularize these essential ideas.”

Event

VB Transform 2023 On-Demand

Did you miss a session from VB Transform 2023? Register to access the on-demand library for all of our featured sessions.

Avatar photo

Alex Carter

Alex studied Music Theory at Berklee College of Music and is a part-time DJ. A Star Wars fanatic, he writes about film scores and how music shapes geek culture.

Most Read

Categories

Enterprise Workers Experience 40% Performance Boost with GPT-4, Reveals Harvard Study
Previous Story

Enterprise Workers Experience 40% Performance Boost with GPT-4, Reveals Harvard Study

The Marvels Take Center Stage in Marvel Move’s Inaugural Virtual Race
Next Story

The Marvels Take Center Stage in Marvel Move’s Inaugural Virtual Race