turn any device into a smart device powered by meta muse

Video authored by the channel shown, not by IANIA; all rights belong to the creator. Transcript and summary generated automatically; the original-language content is preserved.

Original language: English

Original video: turn any device into a smart device powered by meta muse · Channel: Riley Brown · 02:34 · Watch on YouTube

Topics: AI agents, AI infrastructure and hardware, AI models, Open source and software ecosystems

Summary

The video describes how Meta Muse agents come with a virtual machine that can use a browser and other computer programs. It introduces Muse Gadgets, an open-source ESP32 firmware and Linux SDK intended to let hardware devices work with Muse. Using a Mod Retro handheld as an example, the creator says Codex helped turn it into a device that can switch between playing Tetris and interacting with an AI agent. The video ends by suggesting that viewers try adapting an old device as a weekend project.

Key points

Meta Muse is presented as a free AI agent platform that can control apps such as email and Slack.
Each Muse agent comes with a virtual machine and can operate a browser.
The agent described in the video is powered by the Muse Spark 1.3 model.
Muse Gadgets is described as open-source ESP32 firmware and a Linux SDK for making hardware work with Muse.
The Mod Retro handheld is designed to play original Game Boy Color cartridges.
The creator asked Codex whether the Mod Retro could be custom programmed and repurposed.
The resulting app lets the handheld switch between playing Tetris and using an AI agent.
The creator demonstrates asking the agent to check email and report Emily’s most recent message.
The suggested project is to connect an old device to a computer and ask Codex or Cloud Code whether it is compatible.

Chapters

Start	Chapter	Summary
00:00	Introducing Meta Muse	The creator introduces the idea of turning household devices into smart devices and explains that Muse agents can control apps.
00:31	Muse’s virtual machine	The video shows a Muse agent controlling a browser through its virtual machine and describes its capabilities.
01:03	Muse Gadgets and compatible hardware	The creator explains that Muse Gadgets provides firmware and an SDK for connecting hardware devices with Muse.
01:33	Repurposing the Mod Retro	After consulting Codex, the creator turns the Mod Retro handheld into an AI agent platform that communicates through Muse.
02:04	Switching between games and AI	The creator demonstrates switching between Tetris and an AI agent, then recommends trying the process with an old device.

Quotes

What if I told you any device laying around your house could be given an AI agent and turned into a smart device? — 00:00

It’s actually searching Google right now. I’m not controlling the browser. Muse is controlling the browser. — 00:31

it lets you turn any of your old devices into a device that works with Muse. — 01:03

I want you to completely remake the device into like an AI agent platform that can communicate through Muse. — 01:33

You can literally switch to play Tetris, and then I can switch back to an AI agent that can send me things. — 02:04

Concepts and entities

Meta Muse, Muse Spark 1.3, Muse Gadgets, Codex, ModRetro Chromatic, Nat Friedman

Full transcript (original language)

00:00 Okay, this is actually insane. What if I told you any device laying around your house could be given an AI agent and turned into a smart device? So, I’m going to explain the mod retro in just a second, but first we need to talk about muse. As many of you know, Mark Zuckerberg and Meta released a new AI agent platform that’s basically free, and it’s called Meta muse, and it can fully control your email, your slack, or any other app that you use. But most importantly, this little AI agent comes

00:31 with a little virtual machine. So, this is Rick, my muse agent, and I’ve never paid Meta a dime. It’s basically free, and every single agent comes with a computer. And you can see here, this is a little computer. It’s actually searching Google right now. I’m not controlling the browser. Muse is controlling the browser. Point is, it’s a little AI agent powered by the AI model Muse Spark 1.3 built any app, and it can use computer programs that run on that virtual machine, and it can run a browser. Okay, so why does this matter? Well, that’s because of this thing that

01:03 uh Meta released yesterday. So, yesterday Nat Friedman announcing Muse gadgets an open-source ESP32 firmware and Linux SDK, so you can make hardware devices that work with Muse. You can learn more about it here. And long story short, it lets you turn any of your old devices into a device that works with Muse. Back to the mod retro. So, this device right here, mod retro, is a little handheld device designed to play original Game Boy Color cartridges. But after I saw this, it got me thinking.

01:33 So, I went to Codex and started asking questions. Like I said, mod retro chromatic, can I do stuff with it? Can I custom program it? Like do something cool with it? And it eventually said, “Yes, we can repurpose it into a very different device.” Mod retro publishes both the programmable hardware logic and the ESP32 firmware, etc. etc. etc. And then I was like, “I want you to completely remake the device into like an AI agent platform that can communicate through Muse.” And then I passed that link to Nat Friedman’s tweet, which announced it. I didn’t even give it the this link right here. I just said, “Look at the tweet, do it.” And then after about 40 minutes, I eventually figured it out and it created this app right here. And so remember,

02:04 this thing is a Game Boy. You can literally switch to play Tetris, and then I can switch back to an AI agent that can send me things. Hey, can you please check my email and let me know what Emily has said to me most recently? And there you go. Most recent, here’s the email that she sent. So if you want

02:34 a fun weekend project, take any old device that you have, plug it into your computer, and then ask Codex or Cloud Code if it’s compatible with and then paste this link. You might be able to turn it into a smart device.