BBC Domesday Project

The BBC Domesday Project was a partnership between Acorn Computers, Philips, Logica, and the BBC (with some funding from the European Commission's ESPRIT programme) to mark the 900th anniversary of the original Domesday Book, an 11th-century census of England. It has been cited as an example of digital obsolescence on account of the physical medium used for data storage.[1][2][3][4]

1986 Domesday Book running on its original hardware

This new multimedia edition of Domesday was compiled between 1984 and 1986 and published in 1986. It included a new "survey" of the United Kingdom, in which people, mostly school children, wrote about geography, history or social issues in their local area or just about their daily lives. This was linked with maps, and many colour photos, statistical data, video and "virtual walks". The project also incorporated professionally prepared video footage, virtual reality tours of major landmarks and other prepared datasets such as the 1981 census. Over a million people participated in the project, including children from more than 9,000 schools.[5][6]

Purpose

Initially estimated to require the involvement of 10,000 schools and about one million children, the intention was to make the role of schools central in a data gathering project that would assign each school to a geographical area, have parents and local societies collect data, with the schools "acting as a focus and providing the computer". Questionnaires about geography, amenities and land use were to be completed, with school pupils and other contributors also able to write about their local area and "the issues affecting them" in their own words.[7]

In the context of the educational relevance of microcomputers and of information retrieval software operating on repositories of data that might potentially be built by children, it was felt that:

It is in the handling of data that children can best develop an understanding of what counts for knowledge. They can be led into the areas of critical interpretation. As the computer takes over the role of storing and sorting the data, children can increasingly involve themselves in analysing the significance of the data.

— Bill O'Neill, University of Ulster, quoted by John Lamb in New Scientist, 28 March 1985[5]

With regard to potential applications of the system and of its significance, one contemporary reviewer of the system reflected:

The concept behind Domesday is very far reaching, since for the first time large quantities of images and data can be held together. For publishers and knowledge workers, the media for communication will never be quite the same. And this really is just the start.

— Pip Forer[8]

Format
The Domesday System
BBC Master AIV
Function key strip for navigation
Philips VP415 LaserVision laserdisc player

The project was stored on adapted LaserDiscs in the LaserVision Read Only Memory (LV-ROM) format, which contained not only analogue video and still pictures, but also digital data, with 300 MB of storage space on each side of the disc. Initial estimates indicated a total storage capacity of 2 GB per disc, described as sufficient for 80,000 pictures (including satellite images) and "half a million text pages" plus software to process maps and graphical information.[7] The delivered product was estimated to offer a "total potential capacity" of around 1400 MB with half of that capacity filled.[9]

Data and images were selected and collated by the BBC Domesday project based in Bilton House in West Ealing. Pre-mastering of data was carried out on a VAX-11/750 mini-computer, assisted by a network of BBC Micro microcomputers. The discs were mastered, produced, and tested by the Philips Laservision factory in Blackburn, England.

Viewing the discs required a BBC Master AIV - an Acorn BBC Master expanded with a SCSI controller and the 65C102 "Turbo" co-processor[10] - which controlled a Philips VP415 LaserVision laserdisc player. The user interface consisted of the BBC Master's keyboard and a trackball (more specifically the Marconi RB2 Trackerball rebranded by Acorn).[9] The enhancements provided by the Philips VP415 permitted computer control and access to data stored on the discs.[11]

The project was split over two laserdiscs:

  • The Community Disc contained personal reflections on life in Britain and is navigated on a geographic map of Britain. The entire country was divided into blocks that were 4 km wide by 3 km long, based on Ordnance Survey grid references. Each block could contain up to 3 photographs and a number of short reflections on life in that area. Most, but not all, of the blocks are covered in this way. In addition more detailed maps of key urban areas and blocks of 40x30 km and regional views were captured, allowing "zoom-out" and "zoom-in" functions. The community disc was double sided, with a "Southern" and a "Northern" side, although country-wide data at the 40x30km level and above was on both sides.
  • The National Disc contained more varied material, including data from the 1981 census, sets of professional photographs and virtual reality-like walkarounds shot for the project. Side 2 of the National disc contained video material. The material was stored in a hierarchy and some of it could be browsed by walking around a virtual art gallery, clicking on the pictures on the wall, or walking through doors in the gallery to enter the VR walkarounds. In addition a natural language search was provided, supported through the application of the Porter stemming algorithm.[12]

Supported platforms

The application software for the project was written in BCPL (a precursor to C) for portability between different hardware and software platforms, although the software required additional patches to run on the RM Nimbus version of the system. An Amiga version of the system was considered but not initiated.[13]

Concerns over electronic preservation
A BBC Master computer, laserdisc and player on exhibition
A Domesday system at the VCF-GB 2010

In 2002, concerns emerged over the potential unreadablility of the discs as computers capable of reading the format became rare and drives capable of accessing the discs even rarer.[14][15] Aside from the difficulty of emulating the original code, a major issue was that the still images had been stored on the laserdisc as single-frame analogue video, which were overlaid by the computer system's graphical interface. The project had begun years before JPEG image compression and before truecolour computer video cards had become widely available.

CAMiLEON

However, the BBC later announced that the CAMiLEON project (a partnership between the University of Leeds and University of Michigan, led by Margaret Hedstrom and managed by researcher Paul Wheatley[16]) had developed a system capable of accessing the discs using emulation techniques.[17] The CAMiLEON project transferred the text and database files stored on the Domesday laserdiscs to a Linux-based computer using an SCSI connection to the player. Images, stored as still-frame video, were digitised at full resolution using video capture hardware and stored uncompressed, ultimately requiring around 70 GB of storage per side of each laserdisc. A modified version of the Free Software emulator, BeebEm, was then used to access the archived data, with enhancements introduced to support emulation of the Turbo co-processor, SCSI communication and laserdisc player functionality.[18]

Videotape Digitisation Efforts

Another team, working for the UK National Archives (who hold the original Domesday Book) tracked down the original 1-inch videotape masters of the project. These were digitised and archived to Digital Betacam.[12]

Domesday 1986

A version of one of the discs was created that runs on a Windows PC. This version was reverse-engineered from an original Domesday Community disc and incorporates images from the videotape masters. It was initially available only via a terminal at the National Archives headquarters in Kew, but was published on the web as Domesday 1986 (at domesday1986.com) in July 2004.[19] This version was taken off-line early in 2008 when its programmer, Adrian Pearce, suddenly died.[20]

Domesday Reloaded
Main article: BBC Domesday Reloaded
The Domesday machine in 2011

In 2011, a team at BBC Learning, headed by George Auckland, republished much of the Community disc data in a short-lived web-based format.[21] This data comprising around 25,000 images was loaded onto the BBC Domesday Reloaded website which went online in May 2011[22] and offline in June 2018, being hosted in archived form at the National Archives thereafter.[23] The data extraction underlying the Domesday Reloaded site was carried out in 2003 and 2004 by Simon Guerrero and Eric Freeman.[24][25]

Domesday86

Subsequent efforts by the Domesday86 project have taken a broader approach to preservation by attempting to preserve the technologies used to access Domesday and other interactive video content, along with the content itself, focusing on the laserdiscs as preservation artefacts in their own right.[26] The stated objective of the group is to create hardware and software to permit the use of the BBC Domesday system without the need for the rare and expensive specialist hardware employed by the original system, also providing support for the original hardware, releasing developments under Free Software and open hardware licences.[27]

Museum preservation initiatives

The Centre for Computing History in Cambridge has undertaken a similar project to preserve the data from the Domesday Project and made it available online.[28] In 2011, with the National Disc and Community Disc processed, the museum was investigating copyright issues before releasing the URL to the general public.[29] An emulator has since been made available in collaboration with the Domesday86 project.[30] The museum has a working Domesday system on display and accessible to the public. They also have possibly the largest Domesday and interactive laserdisc archive in the world.[31]

The National Museum of Computing based beside Bletchley Park in Milton Keynes previously had two working Domesday systems but has retired the displays as of 2017.

Archival of material

The deputy editor of the Domesday Project, Mike Tibbets, has criticised the UK's National Data Archive to which the archive material was originally entrusted, arguing that the creators knew that the technology would be short-lived but that the archivists had failed to preserve the material effectively.[32]

Language and regional issues

An initial decision to only support the entry of text in English for the Domesday discs led to a dispute involving Welsh schools in areas where local education authorities supported both English and Welsh as first languages:

There's no way you can ask children whose first language is Welsh to write about their local area in a foreign language.

— Charles Davies, Domesday co-ordinator for Clwyd[6]

A compromise saw the BBC allowing ten pages of Welsh text that were to be accompanied by ten pages of English translation for each school submitting content in the Welsh language. With such schools effectively seeing their allocation being reduced from twenty pages to ten, some Welsh schools were apparently boycotting the project in protest at this apparent discrimination. Other concerns from Welsh schools were raised in relation to featured amenities to be surveyed by each school, these being less commonplace in rural areas, suggesting a bias towards urban areas in the design of the survey criteria.[6]

Although as many as 13,000 schools showed an interest in collecting and submitting data, these schools mainly covered urban areas, leaving "large gaps of knowledge" in rural areas, and leading the Domesday Project team to reach out to the Women's Institute, Scout Association, Guide Association and to farmers.[33]

In addition to preserving the project, untangling the copyright issues also presents a significant challenge. In addition to copyright surrounding the many contributions made by the estimated 1 million people who took part in the project, there are also copyright issues that relate to the technologies employed. It is likely that the Domesday Project will not be completely free of copyright restrictions until at least 2090 (assuming no further extensions of copyright terms).[34]

Interactive video

The BBC Master-based system used to deliver the Domesday Project content, known as the Domesday Advanced Interactive Video (AIV) System,[35] was also intended as a platform to support other interactive video applications, integrating with programming languages such as BASIC and Logo via the operating system.[9] Opportunities were perceived for the introduction of the technology beyond the education sector and into various areas of the public and private sectors, estimating "300,000 potential business customers".[36] Acorn set up a subsidiary, Acorn Video, offering the platform under the name Master Video with a choice of Philips or Pioneer laserdisc player for £3220, or £3750 for a more compact version.[37] (This ostensibly followed on from earlier products: the Acorn Interactive System, based on the BBC Micro and Pioneer[38] or Philips laserdisc player,[39] which only supported unidirectional control of a laserdisc player via a serial link,[40] and the Viewpoint Interactive Video Workstation.[41])

BBC Enterprises and Virgin released interactive video discs for education.[42] Following on from the initial Domesday content, the Ecodisc from BBC Enterprises provided an ecological simulation of Slapton Ley nature reserve designed to complement biology and ecology field trips at secondary school level. It was priced at £169 plus VAT, with one side of the disc containing the interactive content and data, the other side containing the BBC Schools Television programme Ecology and Conservation.[35]

Virgin's North Polar Expedition title, in contrast to Ecodisc, provided the software to support interaction on separate floppy disks instead of as LV-ROM content. It was priced at £199 plus VAT, and was reportedly a "testbed for CDI applications" planned by Virgin Publishing.[43] Having received one unfavourable verdict that the title offered "a tired question and answer format in what should be an innovative new medium",[44] a response to this particular review attempted to address such criticisms by noting the limitations of the interaction method employed by the Domesday system, the tightly coupled sound and video capabilities of the medium, and the need to deliver and improve the software without involving the "expensive and complex LV-ROM mastering process". The response also questioned the future of the LV-ROM format, in contrast to Laservision and CD-ROM, also indicating that CD-I would remove various restrictions experienced with the laserdisc medium.[45]

The BBC's Countryside disc provided various census and agricultural datasets and was sponsored by a broad consortium of public and private sector organisations. The BBC's Volcanoes disc, produced in association with Oxford University Press, featured volcanic eruption footage and animated computer graphics sequences by award-winning animator, Rod Lord, together with hypertext features.[46] The Volcanoes disc (priced at £194.35) employed "new AIV features like hypertext" and had graphical content that was created on Archimedes computers.[47] Shell Education Services offered an "interactive video project pack" intended for educational use in various subjects based on "a system developed by Shell UK to provide route maps in filling stations".[48] Epic Industrial Communications offered a "complete course in solid state electronics" for the AIV system, priced at £2300 plus VAT.[49]

Support software was also made for the AIV platform such as the Domesday Display application suite which allowed users to extract data and pictures from the laserdiscs and to present them in the form of a slideshow.[50] The Domesday Presenter application focused on Domesday and AIV system laserdiscs, whereas the Domesday Captions application allowed video frames to be selected from AIV system laserdiscs or any other CAV (constant angular velocity) laserdisc, with the user adding their own captions.[51]

Although this particular interactive video implementation had progressed away from previous "cumbersome and boring" solutions relying on the navigation of sequential-access video tape,[9]: 81  tape-based solutions persisted as competitors. For example, the tape-based VP170 Video Presenter package from Interactive Media Resources (whose system processor was packaged similarly to an Acorn second processor) and the Companion system from Bevan Technology which could control VHS-based tape and Philips LaserVision players, both apparently offered support for integration with applications using the Microtext language.[52][53] Ivan Berg Software (a one-time partner with Acornsoft on various titles) offered the Take Five system on Betamax format video tape with the BBC Micro supplying "question-and-answer frames" in interactive training course material.[37] The Polymedia PCL 1000 also offered a combination of BBC Micro and Sony Betamax video tape recorder bundled with interface, single disc drive, colour monitor and software for £2,450.[54] Earlier competitors included the Felix Link interface from Felix Learning Systems, supporting laserdisc, VHD video discs, U-Matic tapes, with VHS tapes promised, along with Cameron Communications' Interact B system offering touchscreen control over a Thorn EMI VHD video disc player.[38]

Acorn's success in the interactive video market was reportedly hindered by Acorn's financial difficulties of 1985 putting the company's "support or commitment" into question, even leading to the BBC taking over the development of the Domesday Project's retrieval software from Acorn. Consequently, a contract for 1500 machines with Lloyd's Bank ended up being signed by Video Logic, and other potential customers had not progressed beyond trial purchases of Acorn's machines.[37] By early 1988, "fewer than 2,000" Domesday systems had been sold, with the total price of the system being around £5,200. However, a voucher scheme had been in operation, reducing the purchase price to £3000, and this was to be extended until the end of that year.[55]

Subsequent Acorn machines were also featured in laserdisc solutions. For instance, a system was offered by Eltec Computers and the British Nuclear Forum consisting of a BBC A3000, LaserVision 406 player, genlock card, and three discs designed by educators at Newcastle University aimed at secondary schools. The system cost £1899.[56] Some software on the RISC OS platform also supported use of laserdisc players such as the Key Plus data collection and analysis software for the educational market.[57] Oak Solutions' Genesis product supported use of laserdisc hardware, with The Battle of the Somme title, produced by Netherhall School in conjunction with NCET and the Imperial War Museum, incorporating "Laservision material which really brings the project alive" and offering "potentially a new beginning for that old Domesday system".[58]

References
  1. Lord, Timothy (3 March 2002). "1086 Domesday Book Outlives 1986 Electronic Rival". science.slashdot.org. Mountain View, California: Geeknet. Retrieved 23 March 2011.
  2. Cohen, Daniel J; Rosenzweig, Roy (30 August 2005). "Preserving Digital History". Digital History: A Guide to Gathering, Preserving, and Presenting the Past on the Web. Philadelphia: University of Pennsylvania Press. ISBN 978-0-8122-1923-4. Retrieved 23 March 2011.
  3. Brown, Douglas (June 2003). "Lost in Cyberspace: The BBC Domesday Project and the Challenge of Digital Preservation". Discovery Guides. Ann Arbor, Michigan. Archived from the original on 7 September 2011. Retrieved 23 March 2011.
  4. Keene, Suzanne (2006). "Practical challenges: Technical obsolescence". Now you see it, now you won't: Preserving digital cultural material. London: Suzanne Keene. Archived from the original on 31 August 2006. Retrieved 23 March 2011.
  5. Lamb, John (28 March 1985). "Programming the first generation". New Scientist. IPC Magazines. p. 36. The BBC's Domesday project, which involves 9000 schools, is one example of how information retrieval programs are used. The project is an attempt to produce an up-to-date version of the original Domesday book. Schools will collect and store information about their local communities on their own micros and then forward their findings to a central team. Eventually the data will be transferred to a videodisc, to mark the 900th anniversary of the original census in 1086.
  6. Nairn, Geoff (September 1985). "Countdown to Domesday" (PDF). Acorn User. pp. 16–17. Retrieved 29 November 2020.
  7. "Domesday Plus 900". Acorn User. December 1984. pp. 28–29. Retrieved 25 October 2020.
  8. Forer, Pip (September 1986). "Domesday: Geography (and much else) will never be quite the same". Bits and Bytes. pp. 34–37, 66. Retrieved 28 December 2020.
  9. Telford, Joe (July 1987). "The Domesday Device". Acorn User. pp. 81–83, 85. Retrieved 26 October 2020.
  10. "Master to drive video disc". Acorn User. September 1986. p. 7. Retrieved 21 March 2021.
  11. "Philips VP410". Domesday86.com. Retrieved 30 November 2020.
  12. Finney, Andy. "The BBC Domesday Project".
  13. Hallas, Richard. "Countdown from Domesday". RISCOS.com. Archived from the original on 1 February 2013.
  14. Digital Domesday Book lasts 15 years not 1000 by Robin McKie The Observer 3 March 2002
  15. Darlington, Jeffrey; Finney, Andy; Pearce, Adrian (30 July 2003). "Domesday Redux: The rescue of the BBC Domesday Project videodiscs". Ariadne (36). Archived from the original on 11 December 2007. Retrieved 30 November 2020.
  16. Wells, Emma (6 December 2002). "Doomed BBC project rescued". Leeds Student. p. 2. Retrieved 17 December 2020.
  17. McKie, Robin; Thorpe, Vanessa (3 March 2002). "Digital Domesday Book lasts 15 years not 1000". The Guardian. Retrieved 18 July 2011. 'That means we have to find a way to emulate this data, in other words to turn into a form that can be used no matter what is the computer format of the future. That is the real goal of this project.'
  18. Mellor, Phil (15 January 2003). "CAMiLEON: Emulation and BBC Domesday". The Icon Bar. Retrieved 15 November 2020.
  19. "Home". Domesday 1986. Archived from the original on 22 December 2008. Retrieved 15 November 2020.
  20. "The Story of the Domesday Project". 2011. Archived from the original on 11 September 2011. Retrieved 15 November 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  21. Dartford, Katy (2 March 2011). "Domesday project for BBC London". Katy Dartford's blog. WordPress.com. Retrieved 12 April 2011. 25 years on, in May 2011, the BBC will release around 25,000 photos of British life and landscapes and approximately 150,000 pages of accompanying text, onto the Domesday Reloaded website.
  22. Dennett, Melita (5 April 2011). "BBC Domesday reloaded: Call for community contributors". Brighton: North Laine Community Association. Archived from the original on 19 July 2011. Retrieved 12 April 2011. [T]he data has been extracted and the BBC would like to update the information on the discs for a new website, Domesday Reloaded.
  23. Mansfield, Alex. "The Last Post". BBC Domesday Reloaded. Retrieved 9 July 2018.
  24. Freeman, Eric (1 June 2011). "Rescuing the Domesday Project (part 1)". PC Plus Article. Archived from the original on 21 April 2012. Retrieved 15 April 2013. Eric Freeman's account of the BBC's Domesday Project restoration.
  25. Freeman, Eric (1 June 2011). "Rescuing the Domesday Project (part 2)". PC Plus Article. Archived from the original on 21 April 2012. Retrieved 15 April 2013. Eric Freeman's account of the BBC's Domesday Project restoration.
  26. "Domesday Duplicator Overview". Domesday86.com. Retrieved 15 November 2020.
  27. "Introduction to the Domesday86 project". Domesday86.com. Retrieved 15 November 2020.
  28. "BBC Domesday Preservation Project". Centre for Computing History. Retrieved 15 November 2020.
  29. "Museum Helps BBC Domesday Reloaded Project". Centre for Computing History. Retrieved 15 November 2020.
  30. "bbc_domesday_emulator". Retrieved 15 November 2020.
  31. "Interactive Laserdisc Software Collection". Centre for Computing History. Retrieved 24 September 2021.
  32. Tibbetts, Mike (4 November 2008). "Re: BBC Domesday Project (Leeson, RISKS-21.93)". The Risks Digest. Newcastle upon Tyne: ACM Committee on Computers and Public Policy. 25 (44). Retrieved 23 March 2011.
  33. "Camera prizes for Domesday photos". Acorn User. June 1985. p. 17. Retrieved 1 December 2020.
  34. Charlesworth, Andrew (5 November 2002). "The CAMiLEON Project: Legal issues arising from the work aiming to preserve elements of the interactive multimedia work entitled "The BBC Domesday Project."". Kingston upon Hull: Information Law and Technology Unit, University of Hull. Archived from the original (Microsoft Word) on 6 February 2011. Retrieved 23 March 2011.
  35. "Interactive Ecodisc". A&B Computing. August 1987. pp. 43–44. Retrieved 25 November 2020.
  36. "Acorn pushes its Domesday System". Micro User. June 1987. p. 9. Retrieved 31 October 2020.
  37. "Video from Ivan Berg". Acorn User. May 1986. p. 179. Retrieved 17 December 2020.
  38. "Three systems compete". Acorn User. December 1984. p. 7. Retrieved 7 January 2021.
  39. "Video". ELBUG. January 1985. p. 24. Retrieved 28 December 2020.
  40. Sargent, Richard; Luke, Peter (December 1984). "Interactive Video". Electronics and Computing Monthly. pp. 46–49. Retrieved 31 December 2020.
  41. Forer, Pip (June 1986). "A day in the Fens". Bits and Bytes. p. 51. Retrieved 28 December 2020.
  42. "BBC and Virgin launch IV discs". Acorn User. March 1989. p. 13. Retrieved 1 November 2020.
  43. Storer, Andy (21 January 1989). "To the Top of the World... with CDI". New Computer Express. pp. 10–11. Retrieved 30 March 2021.
  44. Bell, Graham (March 1989). "Domesday at the North Pole". Acorn User. p. 17. Retrieved 1 November 2020.
  45. Beckett, William (June 1989). "Frosty Reception". Acorn User. p. 129. Retrieved 31 March 2021.
  46. "Forthcoming AIV discs". A&B Computing. April 1988. p. 59. Retrieved 25 November 2020.
  47. "Big bang". Acorn User. June 1988. p. 7. Retrieved 26 February 2021.
  48. "Laser Disc from Shell". Acorn User. May 1990. p. 9. Retrieved 1 November 2020.
  49. "Solid state electronics". A&B Computing. April 1988. p. 59. Retrieved 25 November 2020.
  50. "Domesday floppies". A&B Computing. August 1987. p. 43. Retrieved 25 November 2020.
  51. "Domesday Display". Domesday86.com. Archived from the original on 10 August 2020.
  52. "Two more IV systems". Acorn User. June 1987. p. 9. Retrieved 31 October 2020.
  53. "Add-on video". Micro User. June 1987. p. 9. Retrieved 31 October 2020.
  54. "Polymedia enters the video market". Acorn User. October 1985. p. 119. Retrieved 7 April 2021.
  55. Bell, Graham (May 1988). "Ecology Explained". Acorn User. pp. 144–145, 147. Retrieved 31 March 2021.
  56. "Arc Enters the Nuclear Forum". Acorn User. January 1991. p. 9. Retrieved 24 February 2021.
  57. Drage, Chris (March 1991). "Handle Bars". Acorn User. pp. 78–79. Retrieved 24 February 2021.
  58. Drage, Chris (November 1992). "Every Picture Tells a Story". Acorn User. pp. 117, 119–120. Retrieved 31 March 2021.
Wikimedia Commons has media related to BBC Domesday Project.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.