The great digital information disappearing act

Spotlight on Information Society

Could the information age spell the death of information? This is a genuine risk that proper action to store websites and other electronic information can avoid. Now the British have enacted legislation so that electronic publications would be saved for future generations.

How magnificent is a notebook from Leonardo da Vinci? It is full of exquisite illustrations of thoughts and ideas. Nobody could deny it is a unique and valuable record of a great mind.

Who is the Leonardo of 2003, or the modern day Marie Curie or John Lennon? How will we know? Will anyone keep their palm pilots or store their personal web pages? After all, surely today’s great thinkers, inventors and creative minds are largely using the latest technology to “pen” their thoughts, instead of ink and paper. You can do so much more in digits and pixels!

Perhaps they were already creating digital documents 20 years ago, but will their old Commodore 64 work when we dig it out of the attic to rediscover their genius in 15 or 50 years time? Leonardo’s notebook opens, but would the old computer work? Even if we could turn it on, the old software applications and commands could make it impossible to read the information. Genius would be lost.

Sure enough, there will always be somebody out there who will know how to use it, or even have a Commodore 64 at home. However, we cannot rely on a curious minority of enthusiasts for the continued maintenance of our documentary heritage and written history, especially in view of the vast amount of digital material being created in the world today.

Look at another seemingly innocent problem: the dead link. You click a hyperlink you have saved, but the document you wished to re-read has disappeared. Whether it has been stored or deleted is one question. The next day, you discover the link is back, but the document seems to have been slightly amended. Has it? Revisionists will be smiling, but for researchers and keepers of record, this represents a growing challenge. And there are others.

The worldwide web is estimated to contain over 250 terabytes of information and is still growing rapidly. That is equivalent to 17 times the volume of the print collections in the United States Library of Congress. This alone sounds mind-boggling and yet, according to the same research source, e-mail creates roughly 400,000 terabytes of information a year!

Consider the information created in your organisation, the e-mail and work documents that form the basis of your organisation or business. Can you guarantee that you will still have the right computer hardware and software to use these important records and data in the future? It will require a long-term plan.

Electronic Records Management systems definitely improve the immediate management of this material, but how long can they really keep the memory of our organisations? Technology moves at such a great pace that keeping up with current and new trends often leaves the older information behind. File formats and software applications are constantly evolving. We need to take these issues into account before we suffer severe digital amnesia.

Simply saving all the bits and bytes is a good start, but it will not necessarily be enough to be able to use the information again in the future. Managing large amounts of data is a considerable challenge also. You need to understand the technical profile of your entire collection, as well as be able to efficiently find a single piece of information within a huge storage system – a needle in a virtual haystack.

Librar-e

Libraries have always dealt with large amounts of information, and large ones are a good place to look for inspiration in solving this problem. Take the national library of the United Kingdom, the British Library (BL), which has the ethical and legal responsibility to acquire, preserve and make available all printed material published in the UK. This is enforced through legal deposit law. In recent years the national published output has included an increasingly digital component that was not covered by the law. Legislation to extend legal deposit to non-print publications made significant progress through parliament in 2003 culminating in a Royal Assent Act in October, in a bid to ensure electronic publications are saved for future generations.

The BL collection of digital material also extends beyond the deposit of publications. The Library receives digital collection material through several methods: deposit, purchase, capture and creation. It arrives on disk or online, in the form of CD-ROMs, CD-Rs, DVDs, floppy disks, online publications and web sites. It can then also exist in a multitude of logical formats such as images, text, audio, interactive databases or geographic information systems. This diversity adds several degrees of complication to finding digital preservation solutions.

Preservation needs to be addressed throughout the life cycle of digital material in order to be effective. Appropriate steps must be introduced to acquisition and cataloguing, for example, to ensure the capture and management of technical details and preservation information, and guarantee the digital files are not altered in any way. Ignoring preservation and not performing these tasks at this stage would be like putting a book on the wrong shelf and never being able to find it again, or as bad, storing the book under a water drip. The information may still be between the pages, or in a digital file, but you cannot see or use it anymore.

New systems are being developed specifically to collect, manage and preserve the digital collections in the Library, such as the recently established Web Archiving Programme. Under the programme, the British Library will take a leading role in negotiating permission with authors and owners to collect UK web sites in partnership with other institutions, nationally and internationally. Given the huge scale and dynamic nature of the web – there are currently more than 4 million UK-based web sites – the Library does not consider it feasible or affordable to aim at truly comprehensive coverage. The approach will be selective and based on voluntary terms negotiated with the web site owners.

The BL is also working towards improving the archiving of digital resources as part of the Digital Preservation Coalition (DPC) in the UK. This is a nationwide consortium of 25 major UK organisations which was established in 2001 to foster joint action to address the urgent challenges of securing the preservation of digital resources in the UK and to work with others internationally to secure our global digital memory and knowledge base. Initiatives such as these will ensure a way forward for at least some digital information, but more action will be needed in all countries if we are to avoid a digital “dark age” in years to come.

References

Digital Preservation Coalition website www.dpconline.org/

Lyman, P. and Varian, H., “How Much Information 2003”, online report by the School of Information Management and Systems (SIMS) at the University of California, Berkeley www.sims.berkeley.edu/research/projects/how-much-info-2003/

Preserving Access to Digital Information (PADI) at www.nla.gov.au/padi/

Read about the UK’s extension of legal deposit to non-print: www.bl.uk/collections/britirish/depintr.html

Also see “Historic change in Legal Deposit Law saves electronic publications for future generations”: www.bl.uk/cgi-bin/press.cgi?story=1382

For more on the British Library Act: www.bl.uk/about/blact.html

©OECD Observer No 240/241, December 2003




Economic data

GDP growth: +0.6% Q4 2017 year-on-year
Consumer price inflation: 2.6% May 2018 annual
Trade: +2.7% exp, +3.0% imp, Q4 2017
Unemployment: 5.4% Mar 2018
Last update: 06 Jul 2018

E-Newsletter

Stay up-to-date with the latest news from the OECD by signing up for our e-newsletter :

Twitter feed

Suscribe now

<b>Subscribe now!</b>

To receive your exclusive paper editions delivered to you directly


Online edition
Previous editions

Don't miss

  • Watch the webcast of the final press conference of the OECD annual ministerial meeting 2018.
  • International co-operation, inclusive growth and digitalisation lead the themes of the 2018 OECD Forum in Paris on 29-30 May, under the banner of What brings us together www.oecd.org/forum. It is held alongside the annual OECD Ministerial Council Meeting on 30-31 May, chaired this year by France with a focus on multilateralism www.oecd.org/mcm.
  • Listen to the "Robots are coming for our jobs" episode of The Guardian's "Chips with Everything podcast", in which The Guardian’s economics editor, Larry Elliott, and Jeremy Wyatt, a professor of robotics and artificial intelligence at the University of Birmingham, and Jordan Erica Webber, freelance journalist, discuss the findings of the new OECD report "Automation, skills use and training". Listen here.
  • Do we really know the difference between right and wrong? Alison Taylor of BSR and Susan Hawley of Corruption Watch tell us why it matters to play by the rules. Watch the recording of our Facebook live interview here.
  • Has public decision-making been hijacked by a privileged few? Watch the recording of our Facebook live interview with Stav Shaffir, MK (Zionist Union) Chair of the Knesset Committee on Transparency here.
  • Can a nudge help us make more ethical decisions? Watch the recording of our Facebook live interview with Saugatto Datta, managing director at ideas42 here.
  • Ambassador Aleksander Surdej, Permanent Representative of Poland to the OECD, was a guest on France 24’s English-language show “The Debate”, where he discussed French President Emmanuel Macron’s speech at the World Economic Forum in Davos.
  • The fight against tax evasion is gaining further momentum as Barbados, Côte d’Ivoire, Jamaica, Malaysia, Panama and Tunisia signed the BEPS Multilateral Convention on 24 January, bringing the total number of signatories to 78. The Convention strengthens existing tax treaties and reduces opportunities for tax avoidance by multinational enterprises.
  • Rousseau
  • Do you trust your government? The OECD’s How's life 2017 report finds that only 38% of people in OECD countries trust their government. How can we improve our old "Social contract?" Read more.
  • Papers show “past coming back to haunt us”: OECD Secretary-General Angel Gurria tells Sky News that the so-called "Paradise Papers" show a past coming back to haunt us, but one which is now being dismantled. Please watch the video.
  • When someone asks me to describe an ideal girl, in my head, she is a person who is physically and mentally independent, brave to speak her mind, treated with respect just like she treats others, and inspiring to herself and others. But I know that the reality is still so much different. By Alda, 18, on International Day of the Girl. Read more.
  • Globalisation’s many benefits have been unequally shared, and public policy has struggled to keep up with a rapidly-shifting world. The OECD is working alongside governments and international organisations to help improve and harness the gains while tackling the root causes of inequality, and ensuring a level playing field globally. Please watch.
  • Read some of the insightful remarks made at OECD Forum 2017, held on 6-7 June. OECD Forum kick-started events with a focus on inclusive growth, digitalisation, and trust, under the overall theme of Bridging Divides.
  • Checking out the job situation with the OECD scoreboard of labour market performances: do you want to know how your country compares with neighbours and competitors on income levels or employment?
  • Trade is an important point of focus in today’s international economy. This video presents facts and statistics from OECD’s most recent publications on this topic.
  • The OECD Gender Initiative examines existing barriers to gender equality in education, employment, and entrepreneurship. The gender portal monitors the progress made by governments to promote gender equality in both OECD and non-OECD countries and provides good practices based on analytical tools and reliable data.
  • Interested in a career in Paris at the OECD? The OECD is a major international organisation, with a mission to build better policies for better lives. With our hub based in one of the world's global cities and offices across continents, find out more at www.oecd.org/careers .
  • Visit the OECD Gender Data Portal. Selected indicators shedding light on gender inequalities in education, employment and entrepreneurship.

Most Popular Articles

OECD Insights Blog

NOTE: All signed articles in the OECD Observer express the opinions of the authors
and do not necessarily represent the official views of OECD member countries.

All rights reserved. OECD 2018