AI Says It Can Compress Better Than FLAC?! Hold My Entropy 🍿 (Ep. 268) 54w67

21/10/2024

Can AI really out-compress PNG and FLAC? 🤔 Or is it just another overhyped tech myth? In this...

Can AI really out-compress PNG and FLAC? 🤔 Or is it just another overhyped tech myth? In this episode of Data Science at Home, Frag dives deep into the wild claims that Large Language Models (LLMs) like Chinchilla 70B are beating traditional lossless compression algorithms. 🧠💥
But before you toss out your FLAC collection, let's break down Shannon's Source Coding Theorem and why entropy sets the ultimate limit on lossless compression.
We explore: ⚙️ How LLMs leverage probabilistic patterns for compression 📉 Why compression efficiency doesn’t equal general intelligence 🚀 The practical (and ridiculous) challenges of using AI for compression 💡 Can AI actually BREAK Shannon’s limit—or is it just an illusion?
If you love AI, algorithms, or just enjoy some good old myth-busting, this one’s for you. Don't forget to hit subscribe for more no-nonsense takes on AI, and the conversation on Discord!
Let’s decode the truth together.

the discussion on the new Discord channel of the podcast https://discord.gg/4UNKGf3
 
Don't forget to subscribe to our new YouTube channel 
https://www.youtube.com/@DataScienceatHome
 
 
References
Have you met Shannon? https://datascienceathome.com/have-you-met-shannon-conversation-with-jimmy-soni-and-rob-goodman-about-one-of-the-greatest-minds-in-history/
 
 

VC Advice Exposed: When Investors Don’t Know What They Want (Ep. 269) 7 meses 17:57 Love, Loss, and Algorithms: The Dangerous Realism of AI (Ep. 270) 7 meses 24:25 AI vs. The Planet: The Energy Crisis Behind the Chatbot Boom (Ep. 271) 7 meses 22:28 AI bubble, Sam Altman’s Manifesto and other fairy tales for billionaires (Ep. 272) 6 meses 18:56 Humans vs. Bots: Are You Talking to a Machine Right Now? (Ep. 273) 6 meses 49:33 Ver más en APP Comentarios del episodio f3c49