Skip to main content

Marimba-playing robot uses deep-learning AI to compose and perform its own music

When the inevitable robot invasion happens, we now know what the accompanying soundtrack will be — and we have to admit that it’s way less epic than the Terminator 2: Judgment Day theme. Unless you’re a massive fan of the marimba, that is!

That assertion is based on research coming out of the Georgia Institute of Technology, where engineers have developed a marimba-playing robot with four arms and eight sticks that is able to write and perform its own musical compositions. To do this, it uses a dataset of 5,000 pieces of music, combined with the latest in deep learning neural network-based AI.

Recommended Videos

“This is the first example of a robot composing its own music using deep neural networks,” Ph.D. student Mason Bretan, who first began working on the so-called Shimon robot seven years ago, told Digital Trends. “Unlike some of the other recent advances in autonomous music generation from research being done in academia and places like Google, which is all simulation done in software, there is an extra layer of complexity when a robotic system that lives in real physical three-dimensional space generates music. It not only needs to understand music in general, but also to understand characteristics about its embodiment and how to bring its musical ‘ideas’ to fruition.”

Robot Composes, Plays Own Music Using Deep Learning

Training Shimon to generate new pieces of music involves first coming up with a numerical representation of small chunks of music, such as a few beats or a single measure, and then learning how to sequence these chunks. Two separate neural networks are used for the work — with one being an “autoencoder” that comes up with a concise numerical representation, and the second being a long short-term memory (LSTM) network that models sequences from these chunks.

“These sequences come from what is seen in human compositions such as a Chopin concerto or Beatles’ piece,” Bretan continued. “The LSTM is tasked with predicting forward, which means given the first eight musical chunks, it must predict the ninth. If it is able to successfully to do this, then we can provide the LSTM a starting seed and let it continue to predict and generate from there. When Shimon generates, it makes decisions that are not only based off this musical model, but also include information about its physical self so that its musical decisions are optimized for its specific physical constraints.”

It’s pretty fascinating stuff. And while the idea of a music-generating bot might sound of interest only to people studying music, the bigger questions it raises about computational creativity are only going to get more important as time goes on.

“Though we are focusing on music, the more general questions and applications pertain to understanding the processes of human creativity and decision-making,” Bretan said. “If we are able to replicate these processes, then we are getting closer to having a robot successfully survive in the real world, in which creative decision-making is a must when encountering new scenarios and problems each day.”

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The Ioniq 5 is once again eligible for the $7,500 tax credit
2025 Hyundai Ioniq 5

After a brief and confusing absence, the Hyundai Ioniq 5 is once again eligible for the full $7,500 federal tax credit — and this time, it's sticking around (at least for now). So, what happened? Let’s unpack the ride.

The Ioniq 5, a sleek and tech-savvy electric crossover, initially made headlines not just for its design, but for being built at Hyundai’s brand-new Metaplant in Georgia. That domestic assembly qualified it for the EV tax credit under the Inflation Reduction Act (IRA), which requires vehicles to be made in North America with batteries sourced from trade-friendly countries. But early in 2025, the Ioniq 5 vanished from the list. Why? Likely due to its battery packs, which were then still being sourced from SK On’s Hungarian facility.

Read more
Sebastian Stan lays out Bucky’s future after Thunderbolts
Sebastian Stan in Thunderbolts.

There are some spoilers ahead for the ending of Marvel's Thunderbolts. Stop reading now if you don't want to be spoiled.

Earlier this year, Captain America: Brave New World briefly introduced a new direction for James "Bucky" Barnes, a character Sebastian Stan has been playing since 2011 in Captain America: The First Avenger. In Brave New World, the former Winter Soldier apparently retired from being a reformed hero and went into politics by running for Congress. Thunderbolts reveals that Bucky won his election to the House of Representatives. But his stay in Congress was short.

Read more
Jeep Compass EV breaks cover—but will it come to the U.S.?
jeep compass ev us newjeepcompassfirsteditionhawaii  4

Jeep just pulled the wraps off the all-new Compass EV, and while it’s an exciting leap into the electric future, there's a catch—it might not make it to the U.S. anytime soon.
This is a brand new electric version of the Jeep Compass, and being built on Stellantis' STLA platform—the same architecture underpinning models like the Peugeot E-3008 and E-5008—it looks much slicker and packs a lot more inside than previous versions of the Compass.
Let’s start with what’s cool: the new Compass EV is packing up to 404 miles of range on a single charge, a 74 kWh battery, and fast-charging that gets you from 20% to 80% in about 30 minutes. Not bad for a compact SUV with Jeep's badge on the nose.
There are two versions: a front-wheel-drive model with 213 horsepower and a beefier all-wheel-drive version with 375 horsepower. That AWD setup isn’t just for looks—it can handle 20% inclines even without front traction, and comes with extra ground clearance and better off-road angles. In short, it’s still a Jeep.
The design's been refreshed too, and inside you’ll find the kind of tech and comfort you’d expect in a modern EV—sleek, smart, and ready for both city streets and dirt trails.
But here’s the thing: even though production starts soon in Italy, Jeep hasn’t said whether the Compass EV is coming to America. And the signs aren’t promising.
Plans to build it in Canada were recently put on hold, with production now delayed until at least early 2026. Some of that might have to do with possible U.S. tariffs on Canadian and Mexican vehicles—adding a layer of uncertainty to the whole rollout.
According to Kelley Blue Book, a Stellantis spokesperson confirmed that the company has “temporarily paused work on the next-generation Jeep Compass, including activities at” the Canadian plant that was originally meant to build the model. They added that Stellantis is “reassessing its product strategy in North America” to better match customer needs and demand for different powertrain options.
So while Europe and other markets are gearing up to get the Compass EV soon, American drivers might be left waiting—or miss out entirely.
That’s a shame, because on paper, this electric Jeep hits a lot of sweet spots. Let’s just hope it finds a way over here.

Read more