The internet is disappearing, study says

Almost 40% of webpages from 2013 no longer exist a decade on, research finds

Andrew Griffin
Tuesday 28 May 2024 06:22 EDT
Comments
Is This Internet Transmission Faster Than Broadband?

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

The internet is disappearing, a new study has suggested, as web pages and online content is lost.

The web is often thought of as a place where content lasts forever. But vast swathes of its are being lost as pages are deleted or moved, according to new research.

Of the webpages that existed in 2013, for instance, 38 per cent are now lost. Even newer pages are disappearing: 8 per cent of pages that existed in 2023 are no longer available.

(Getty Images)

Those pages tend to disappear when they are deleted or moved. That happens on otherwise functional websites, the study from the Pew Research Center indicated, rather than happening when whole websites disappear.

The effect means that vast amounts of news and important reference content are disappearing. Some 23 per cent of news pages include at least one broken link, and 21 per cent of government websites, it said – and 54 per cent of Wikipedia pages include a link in their references that no longer exists.

Much the same effect is happening on social media. A fifth of tweets disappear from the site within months of being posted.

The study was completed by gathering a random samples of almost a million webpages, taken from Common Crawl, a service that archives parts of the internet. Researchers then looked to see whether those pages continued to exist between 2013 and 2023.

It found that 25 per cent of all pages collected between 2013 and 2023 were no longer available. Of those, 16 per cent of pages came from a website that continues to exist, while 9 per cent were located on websites that no longer exist at all.

The report, ‘When Online Content Disappears’, is published on the website of the Pew Research Center.

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in