Skip to main content

It was an Amazon employee’s typo that mangled the internet on Tuesday

typo mangles internet 22137378  challenges of working at a computer
mikekiev/123RF
Earlier this week a good chunk of the internet started playing up for millions of users.

Tuesday’s disruption, caused by an issue at website-hosting operation Amazon Web Services (AWS), lasted for about five hours, which was about five hours too long for most of those affected.

Amazon fessed up on Thursday and admitted it was human error that had caused the problem. Specifically, a typo — yes, a careless typo — led to the cloud-based chaos, the result of some erroneous input procedure by an Amazon employee.

In an explanatory message posted online, the company said its Simple Storage Service (S3, part of AWS) team in northern Virginia had been sorting out an issue that was causing the S3 billing system to progress slower than it should.

During the work, a team member “executed a command which was intended to remove a small number of servers” used by the S3 billing process.

But “one of the inputs to the command was entered incorrectly and a larger set of servers was removed than intended.”

When that happened, lots of web users around the world presumably started frowning at their displays, possibly uttering an expletive or two while at the same wondering, “Is it my end or their end?”

While Amazon Web Services hosts plenty of big-name operations such as Netflix, Spotify, Instagram, Airbnb, and Expedia, these sites apparently escaped any disruption during the incident. Instead, those that temporarily hit the buffers included collaboration tool Trello, sites built with website-building tool Wix, and others such as Lonely Planet, Medium, IFTTT, and Quora.

Amazon’s cloud computing service has grown massively since it launched in 2006 and is now a fast-growing part of its business as more and more companies turn to it for hosting responsibilities.

That’s why mishaps with the service can quickly cause serious trouble for millions of web users. On Thursday, Amazon apologized for the incident and promised to “do everything we can to learn from this event.”

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
Amazon fires two employees who criticized warehouse safety conditions
Amazon sign on warehouse

Amazon has fired two of its employees after they reportedly spoke out about safety conditions in the company’s warehouses.

User experience designers Emily Cunningham and Maren Costa were both fired last week, according to The Washington Post. 

Read more
Can U.S. internet infrastructure handle increased demand? Experts weigh in
A man working from home.

As schools and businesses nationwide are urging staff and students to work from home due to the outbreak of coronavirus, experts have said that the U.S. internet infrastructure should be able to handle the increased strain on demand -- mostly. As reported by the Associated Press, experts are predicting that internet access will continue to be available, but some issues are likely to arise. People may have to settle for audio-only conferencing if too many people are trying to use videoconferencing at the same time, for example.

“The core of the network is massively over-provisioned,” Paul Vixie, CEO of Farsight Security and infrastructure expert told AP. As the national internet infrastructure has developed over time to handle bandwidth-demanding services like Netflix and YouTube, it should have no problem handling the increase in demand due to many people staying home.
Senators call for help from ISPs
Earlier this week, U.S. Sen. Mark R. Warner (D-VA) and 17 of his colleagues called on the CEOs of major internet service providers to make accommodations for the spike in remote work caused by the coronavirus outbreak. As well as remote work, there is also an increased strain on internet services due to a rise in remote learning for schoolchildren and students, and remote telehealth services as well.

Read more
Amazon’s first employee thinks the company is scary-big
Amazon Logo

Amazon’s very first employee from 1994 said in a new interview that he is scared of how big the company has become since he left and that it deserves to be broken up.

Shel Kaphan, who was once Amazon's chief technology officer, was featured in a PBS Frontline special titled “Amazon Empire: The Rise and Reign of Jeff Bezos” that aired on Tuesday, February 18. Kaphan shared his thoughts about where the company has gone since he left it in 1999. 

Read more