Twitter’s imminent collapse could wipe out vast records of recent human history
Almost from the time the first tweet was posted in 2006, Twitter has played an important role in world events. The platform has been used to record everything from the Arab Spring to the ongoing war in Ukraine. It’s also captured our public conversations for years.
But experts are worried that if Elon Musk tanks the company, these rich seams of media and conversation could be lost forever. Given his admission to employees in a November 10 call that Twitter could face bankruptcy, it’s a real and present risk.
Musk himself acknowledges that Twitter is a public forum, and it’s this fact that makes the potential loss of the platform so significant. Twitter has become integral to civilization today. It’s a place where people document war crimes, discuss key issues, and break and report on news.
It’s where the US raid that would result in Osama bin Laden’s death was first announced. It’s where people get updates on Russia’s invasion of Ukraine. It’s where news of the downing of flight MH17, a Malaysia Airlines plane that was likely shot down by pro-Russia forces in Ukraine in 2014, first surfaced. It is a living, breathing historical document. And there’s real concern it could disappear soon.
“If Twitter was to ‘go in the morning’, let’s say, all of this—all of the first-hand evidence of atrocities or potential war crimes, and all of this potential evidence—would simply disappear,” says Ciaran O’Connor, senior analyst at the Institute for Strategic Dialogue (ISD), a global think tank. Information gathered using OSINT (open-source intelligence) has been used to support prosecutions for war crimes, and acts as a record of events long after the human memory fades.
Part of what makes Twitter’s potential collapse uniquely challenging is that the “digital public square” has been built on the servers of a private company, says O’Connor’s colleague Elise Thomas, senior OSINT analyst with the ISD. It’s a problem we’ll have to deal with many times over the coming decades, she says. “This is perhaps the first really big test of that.”
Twitter’s ubiquity, its adoption by nearly a quarter of a billion users in the last 16 years, and its status as a de facto public archive, has made it a gold mine of information, says Thomas.
“In one sense, this actually represents an enormous opportunity for future historians—we’ve never had the capacity to capture this much data about any previous era in history,” she explains. But that enormous scale presents a huge storage problem for organizations.
For eight years, the US Library of Congress took it upon itself to maintain a public record of all tweets, but it stopped in 2018, instead selecting only a small number of accounts’ posts to capture. “It never, ever worked,” says William Kilbride, executive director of the Digital Preservation Coalition. The data the library was expected to store was too vast; the volume coming out the firehose too great. “Let me put that in context: it’s the Library of Congress. They had some of the best expertise on this topic. If the Library of Congress can’t do it, that tells you something quite important.”
That’s problematic, because Twitter is teeming with significant content from the past 16 years that could help tomorrow’s historians to understand the world today.
“In a way, Twitter has become a kind of aggregator of information,” says Eliot Higgins, founder of open-source investigators Bellingcat, who helped bring the perpetrators of the downing of MH17 to justice. “A lot of this stuff you see from Ukraine, the footage comes from Telegram channels that other people are following, but they’re sharing it on Twitter.” Twitter has made it easier to categorize and consume content around almost any niche in the world, tapping into a real-time news feed of relevant information from both massive organizations and small, independent voices. Its absence would be keenly felt.
The disappearance of huge volumes of information from the internet is not a new problem. In 2017, YouTube was accused of harming investigators’ ability to pinpoint alleged crimes against humanity in Syria by permanently deleting accounts that posted videos from Syrian cities. It eventually reneged, realizing the importance it played as a host of historical information.
“I don’t think that’s going to happen with Elon Musk,” says Higgins. (Musk did not immediately respond to a request for comment asking if he would assure or assist in the permanent storage of Twitter’s history of posts in the event of bankruptcy. Twitter, as has now been extensively reported, no longer has a communication team after mass layoffs.)
It’s not just OSINT researchers who are worried. US public agencies’ concern about the loss of their verified status highlights the fact that lots of official statements by governments and public bodies are now made on Twitter first. “There’s no indication that those formal records of government agencies have ever been archived, or indeed how they’d go about doing that,” says Kilbride.
Many users have taken it upon themselves to independently back up their data, while the Internet Archive can be used to permanently store snapshots of Twitter’s webpages in a more reliable place than Twitter’s own servers. But both methods are not without their own issues: multimedia often isn’t stored alongside such methods of archiving tweets—something that would impact the vast numbers of accounts posting images and videos from Iran’s revolution, or documenting Russia’s invasion of Twitter—while accessing the information easily requires knowing the exact URL of any given tweet to access it. “You may have trouble finding that if it’s not already been preserved in some way somewhere else on the internet,” says Higgins.
Some users are relying on third-party services usually used to try and make long Twitter threads more decipherable, such as Thread Reader, as an archiving tool—but that’s not an ideal solution, either. “The companies behind those services are almost certainly smaller and more transient than Twitter itself, and there’s no real reason to think the content will be preserved forever there either—especially as once Twitter is gone, so is the Twitter thread unrolling company’s business model,” says Thomas.
“There’s a nice way to turn the lights out,” pleads Kilbride, who asks that if Twitter were to go under, Musk doesn’t pull the plug immediately. “A managed, structured close down to the service has to be preferred to the chaos we’ve got now,” he says.
Thomas doesn’t have a good solution to the problem, and like much of Twitter at present, the outlook isn’t exactly rosy, she says. “We’re going to lose such a lot of digital history if Twitter goes kaput without warning.”
