Todd R. Hanneken, St. Mary’s University
Before digital technology, most of us had access to manuscripts by way of photographic plates and critical editions. Those few who had the privilege of handling the manuscript itself faced their own challenges. Digital technology opens new possibilities for extending and improving the role of manuscripts in our research and teaching. The impact of digitizing manuscripts is unmistakable, but digitizing is not an end in itself. We should think about why we digitize and what we expect a digital simulation of a manuscript to be able to do. In turn, this leads to consideration of how to digitize and what to do with the digital simulation. This essay discusses three priorities I consider most essential when digitizing manuscripts for the benefit of research and teaching in biblical literature. I draw from my experience directing the Jubilees Palimpsest Project, which faced challenges in these areas in the pursuit of the study of the only copy of Jubilees in Latin and the only copy anywhere of the Testament (or Assumption) of Moses. I started off with an interest in recovering more text from the manuscript, which dates from the fifth century and which has been abused to the point of illegibility since that time. As the project progressed, I realized the potential for the digitization of manuscripts to do much more than add to critical editions.
The first priority is access. One of the core advantages of digital information is that it can be copied and transmitted with no loss and little cost over the Internet or other digital media. But we do not reap the benefit without thinking about standards for interoperability, permissions, discoverability, permanence, and ease of visualization interface. The second priority is comparability to first-hand experience. How do we answer someone who says there is no substitute for first-hand experience? What exactly do we do with a manuscript when we handle it in a reading room? Can digital technology provide something like that experience, or at least help us answer the same scholarly questions? The third consideration is the value of improving on first-hand experience. Even direct access does not guarantee answers to all our questions. Spectral imaging gives us superpowers – the ability to see what the natural human eye cannot. These priorities become more complex when one imagines that a scholar might want to study a manuscript in a way other than reading its text beginning to end.
Before examining the three priorities individually, a brief consideration of the term “simulation” and some alternatives is in order. Many who have thought about the relationship between a manuscript and a digital representation thereof can agree that the digital object is not to be equated with the manuscript. It has distinct advantages and disadvantages, or opportunities and challenges. An examination of an image of a manuscript is not an examination of the manuscript. However, a single word that captures the nature and role of the digital object is more difficult. Bill Endres, building on an excellent analysis of the relationship between experience, perception, and epistemology, prefers “digital version” or “digital artifact.” 1 These options understate the point that Endres clarifies separately, namely that the digital artifact is its own artifact, not the same artifact seen through a digital lens or duplicated by digital means. The term “avatar” does more to signify non-identity, but has its own problems of connotation and appropriation. Besides the mixed connotations from popular culture, the appropriation of a term from Hinduism for human experience of the sacred in the world distracts more than it helps (and similarly “incarnation” from Christianity). The term “surrogate” may appropriately convey a distinct but functionally representative stand-in for a separate authority, but unhelpfully connotes human bodies being controlled by others. 2 “Facsimile” may be appropriate when the digital object has no advantages other than access. However, this essay will highlight what Endres has called “excesses,” ways in which a digital object can be better than that which is copied. In adopting from Liv Lied the term “simulation,” I intend to emphasize that the experience of a digital object is distinct from the experience of a manuscript.3 I also emphasize that one simulation can be better than another if it comes closer to achieving what could be done with access in real life. Furthermore, a simulation may allow experiences that could not be safely enacted or replicated in real life, here for the conservation safety of the manuscript. As with a good simulation of flying or driving, a simulation of a manuscript first should be accessible, second should realistically represent as many nuances and details as possible, and third should allow experiences beyond what would be safe or possible with the non-digital experience.
1 William Endres, “More than Meets the Eye: Going 3D with an Early Medieval Manuscript,” in Proceedings of the Digital Humanities Congress 2012 (ed. Clare Mills, Michael Pidd, and Esther Ward; Studies in the Digital Humanities; Sheffield: The Digital Humanities Institute, 2012), https://www.dhi.ac.uk/openbook/chapter/dhc2012-endres, accessed 15 June 2020. See also, Bill Endres, Digitizing Medieval Manuscripts: The St. Chad Gospels, Materiality, Recoveries, and Representation in 2D and 3D (Medieval Media Cultures; Leeds: Arc Humanities, 2019) 65.
2 Dot Porter, “Is This Your Book? What We Call Digitized Manuscripts and Why It Matters,” Dot Porter Digital, accessed 15 June 2020, http://www.dotporterdigital.org/is-this-your-book-what-digitization-does-to-manuscripts-and-what-we-can-do-about-it/.
3 Liv Ingeborg Lied, “Digitization and Manuscripts as Visual Objects: Reflections from a Media Studies Perspective,” in Ancient Manuscripts in Digital Culture: Visualisation, Data Mining, Communication, (ed. David Hamidović, Claire Clivaz, and Sarah Bowen Savant; Digital Biblical Studies 3; Leiden: Brill, 2019).
Just as one would not speak of the advantages or disadvantages of flight simulation without recognizing the difference between a flight simulator built by the United States Air Force and a flight simulator on a home gaming console, we should not speak of the advantages and disadvantages of manuscript digitization without recognizing the range of possibilities. Conversations about the benefits and pitfalls of the study of manuscripts by way of digital simulations often fail to consider the variety of what it can mean to digitize.4 Many have offered warnings about the limitations of digitization, suggestions for practical measures addressing “anxiety,” and exhortations to embrace the potential of the digital artifact as its own thing.5 These questions become more complex when one thinks of a manuscript not just as a text container, but a record of the cultures of those who created and used the manuscript, often adding their interpretations, notes, and prayers.6 The contribution at hand is not to adjudicate these positions, but to explore the underlying assumption. With few exceptions, most contributors to the debate about digitization assume that because they have seen digital images, they therefore know what digitization is and they know its intrinsic limitations. The range of possibilities even now, and certainly for the imaginable future, is not as simple as quality on a linear scale from poor quality to high quality. Rather, there are many qualities that digital simulations can have. A digital image may be very good at doing one thing and very poor at doing another. For example, an image good at being readable may be poor at tracking conservation or identifying scribal practices. Just as we have learned not to equate a digital image with the manuscript imaged, we must be careful not to speak of the limitations of digitization when we mean the limitations of one particular mode of digitization and representation.
4 This trend is more understandable when the goal is to contrast handwritten, print, and digital media cultures broadly rather than critiquing “digital” specifically. See, for example, L.W.C. van Lit, O.P., Among Digitized Manuscripts: Philology, Codicology, Paleography in a Digital World (Handbook of Oriental Studies 137; Leiden: Brill, 2020).
5 A variety of views are expressed in David Hamidović, Claire Clivaz, and Sarah Bowen Savant, eds., Ancient Manuscripts in Digital Culture: Visualisation, Data Mining, Communication (Digital Biblical Studies 3; Leiden: Brill, 2019). See especially, Liv Ingeborg Lied, “Digitization and Manuscripts as Visual Objects,” and Brent Landau, Adeline Harrington, and James C. Henriques, “‘What No Eye Has Seen’: Using a Digital Microscope to Edit Papyrus Fragments of Early Christian Apocryphal Writings.” See also the September 2018 special issue of Archive Journal, “Digital Medieval Manuscript Cultures,” edited by Michael Hanrahan and Bridget Whearty, and especially the articles by A.S.G. Edwards, “The Digital Archive, Scholarly Enquiry, and the Study of Medieval English Manuscripts,” and Andrew Prescott and Lorna Hughes, “Why Do We Digitize? The Case for Slow Digitization,” http://www.archivejournal.net/essays/digital-medieval-manuscript-cultures/. The same volume expresses optimism about the potential of digital surrogates to do what was not previously possible, especially Johanna M. E. Green, “Digital Manuscripts as Sites of Touch,” and Julia Craig-McFeely, “Recovering Lost Texts: Rebuilding Lost Manuscripts.”
6 See especially Liv Ingeborg Lied, “Bible as Notepad: Exploring Annotations and Annotation Practices in Biblical Manuscripts,” in Bible as Notepad (ed. Liv Ingeborg Lied and Matthew Maniaci; Berlin: De Gruyter, 2018): 1–9. See also Garrick V. Allen, “Digital Tools for Working with New Testament Manuscripts,” Open Theology 5 (2019): 13–28, here 22. The complexity compounds when including digitization of non-written or non-literary written artifacts, such as inscriptions. Even more so than a manuscript, a monument, amulet, or phylactery cannot be understood merely as a text container. On the challenge of conceptualizing structure for digital presentation of inscriptions and the InscriptiFact project, see Leta Hunt, Marilyn Lundberg, and Bruce Zuckerman, “Concrete Abstractions: Ancient Texts as Artifacts and the Future of Their Documentation and Distribution in the Digital Age,” in Text Comparison and Digital Creativity (ed. Wido Th. van Peursen, Ernst D. Thoutenhoofd, and Adriaan van der Weel; Leiden: Brill, 2011), 149–71.
It will be helpful to consider three examples that illustrate the range of possibilities of what it can mean to digitize a manuscript. For the first example of the variety of qualities of digital simulations, consider Figures 1–6, all of which are digital images representing the same page of the Jubilees Palimpsest. Figure 1 is a one-bit image of Ceriani’s edition from 1861.7 It may be the most legible of all, but gives the least sense of the manuscript as anything other than a text container. Even as a transcription, it is incomplete and questionable. It is highly accessible, thanks to Google Books. My first look at an image of the manuscript was on microfilm, shown in Fig. 2 as an eight-bit digital scan. I had access to it only by special request to my dissertation director, James VanderKam. It preserves data from a moment in the conservation history of the manuscript, but is useless for reading the erased text. I saw the manuscript in real life for the first time in 2011, again thanks to inside connections. The Biblioteca Ambrosiana was willing to digitize one bifolio for me, shown here as Fig. 3. It would look good if not juxtaposed to Fig. 4, which was captured in 2017 with high-precision spectral imaging equipment calibrated for color accuracy. Just because something is digitized in color does not mean the color is accurate. Figure 5 is captured with raking light to show the texture of the folio. Texture sometimes helps us recover the writing, but more importantly comes closest (among still images) to representing what it is like to handle the folio. Figure 6 departs from efforts to accurately represent the artifact in favor of enhancing the text for legibility. Using data captured using light range and resolution beyond human capability, the processed image shows more of the erased text than any of the others. All six images represent the same page, and all are digital. But if we are going to talk about digitizing manuscripts and working with digital manuscripts, we need to be aware that “digital” encompasses a range of possibilities with different advantages and limitations. Any one of them may be better than nothing, and no single image conveys all that a scholar might want to investigate.
7 Antonio Maria Ceriani, Fragmenta latina evangelii S. Lucae, parvae genesis et assuptionis Mosis, Baruch, threni et epistola Jeremiae versionis syricae Pauli telensis cum notis et initio prolegomenon in integram ejusdem versionis editionem (Monumenta Sacra et Profana ex Codicibus praesertim Bibliotheca Ambrosiana 1.1; Milan: Typis et impensis Bibliothecae Ambrosinae, 1861).
A second example illustrates the implications of spatial resolution, color resolution, and non-natural color enhancements. The most familiar distinction is spatial resolution, which determines whether an image looks pixelated or blurry, as in Fig. 7. Color resolution at the minimum extreme is binary black and white (Fig. 8), which may be adequate for printed material. A single channel of color, monochrome, is a big improvement (Fig. 9).8 A second channel of color is a further improvement, but still what we would call “color blind” in humans (Fig. 10). A third channel of color defines “normal” for most of us, especially if it is calibrated for accuracy (Fig. 11). However, normal human vision is quite poor compared to what can be distinguished by other species and by spectral imaging. Figure 12 shows an enhancement that squeezes the multispectral color range and resolution into what can be seen by the human eye. Ultraviolet appears as blue and infrared appears as red (note the black microfiber background, which does not reflect visible light but does reflect infrared light). Finally, Figure 13 shows a Pseudocolor enhancement which does not attempt to resemble accurate color but rather to highlight, in human-visible contrasts, the contrasts that processing can identify in multispectral data sets.
8 A related issue is bit depth. For any one channel, most screens and the human eye at one moment are limited to eight bits of data, representing 256 degrees of luminosity (brightness). Screens advertised as “high dynamic range” add a few bits. Images at higher bit rates are either a combination of multiple channels (e.g., eight bits of red, eight bits of green, eight bits of blue for a total of twenty-four), or preserve higher precision from mathematical operations that can be rendered later in the more limited range visible to humans.
A third example illustrates the limitations and possibilities of a variety of methods of digitization for purposes of reading erased text from a palimpsest. If the goal is to read letters on a page, the metric is fairly straightforward. The first four degrees of digitization are clearly inadequate for textual recovery. Figure 14, binary color resolution, and Fig. 16 (two-channel color resolution) would not be seriously proposed as a format for digitization of manuscripts, but they do illustrate that color resolution can have multiple degrees. However, many would consider a color image (Fig. 17) to be the gold standard, or at least normal when speaking of what it means to digitize a manuscript. Notably, by the metric of readability it is no better than the monochrome image (Fig. 15) that some would associate with old-fashioned media such as microfilm or plates in critical editions. Legibility of the text does not become possible until a combination of multispectral and texture imaging is applied. Figures 18 and 20 use Extended Spectrum processing to squeeze in contrasts outside the human visible color spectrum. Figure 21 uses Pseudocolor to highlight in sharp contrast the greatest contrasts computer algorithms can detect in the massive multispectral data set. Figures 19–21 use raking light to show the texture. Texture aids legibility when ink slightly corrodes the surface of parchment and leaves its impact even after the ink itself is removed.
Besides illustrating the range of possibilities of what it can mean to digitize a manuscript, these introductory examples preview the three priorities to be discussed in the following sections. The Jubilees Palimpsest, prior to the Jubilees Palimpsest Project, was not accessible to anyone without a travel budget and academic connections. Capturing digital information and sharing it on the Internet are only the first steps toward making it accessible. The difference between the diffuse and raking images anticipates the concern of approximating first-hand experience. As someone who has handled the Jubilees Palimpsest in real life, I would not hesitate to identify Fig. 5 (the raking image) as the truest to first-hand experience of the manuscript. Figure 4, though impeccably accurate in color, seems cartoonish in obscuring the feel of the manuscript, no less so than Fig. 3 (the conventional color image) seems cartoonish in obscuring the color tones. Finally, the benefits of Extended Spectrum and Pseudocolor anticipate the concern that sometimes realistic is not good enough. It can be beneficial to utilize multispectral capture and processing to surpass the natural limitations of the human eye.
The first priority is access. We want scholars and students to be able to investigate manuscripts even without special connections and privilege. Digital technology makes that possible, but not automatic. We can also learn from the mistakes of past digital projects. Many a website, once impressive, will die alone in its own isolated silo, its data and formats never to be carried over into next-generation systems. There are a couple of points here, and they all revolve around the theme that we can achieve sustainable access through standards for interoperability. Consider that information is lost in human communication if language, genres, and conventions are not held in common. What is new here is the importance of machine readability. If we follow conventions that allow machines to aggregate and index the information that will be important to scholars, most of the other considerations of access will fall into place.
One issue of access is permission. Debates about open access often focus on free or not free. Especially in the past, publishers feared that free access would devalue traditional business models. Protectors of cultural heritage feared that third-party commercial exploitation could devalue their holdings. Overall, institutions are increasingly aware that access to digital simulations creates value. Having seen pictures of the Mona Lisa or ceiling of the Sistine Chapel does not make people less interested in seeing the originals. A book or journal that only a few can find, read, and cite does not gain value by virtue of obscurity. Considerations of open access should go beyond cost. Requirements to create accounts and agree to tracking or convoluted privacy statements may deter casual discovery, impede interoperability (such as linking directly to resources without going through a designated portal), and raise concerns of principle in the case of publicly funded projects. No less important is the consideration of how standard a license is. A custom license, no matter how generous in content, creates a barrier to human and machine access. A human may get lost in legalese. A computer has no hope of knowing whether data and metadata can be aggregated into a resource unless a standard license is included in the appropriate metadata field. For example, Creative Commons defines a set of standard licenses, not all of which are particularly generous in detailing what a user may do with the content, but they are all standard and recognizable to anyone who works with permissions on a regular basis. When the uniform resource identifier (URI) of that license is included in the metadata of a webpage or IIIF Presentation manifest, for example, machine as well as human aggregators can make the information accessible to users in new ways. Search engines such as Google will index web pages unless asked not to (for example with a “robots.txt” file), while libraries and many databases will do the opposite. Information may not be included in a database or index without explicit permission, preferably following a machine-readable standard.
If present and future aggregators and search indexes have permission to organize information about manuscripts, then discoverability often falls into place. Discoverability is the fundamental question of does anyone know it exists. Can scholars find it? Some searches and filters are easy. Google works well if you know you are looking for Latin Jubilees. The Leuven Database of Ancient Books works well if you know you are looking for palimpsests at the Biblioteca Ambrosiana. A reasonable but harder question is if you are looking for fifth-century manuscripts written in two columns. What if your goal is not to read the manuscript beginning to end but to trace development of scribal practices across centuries and continents? Open standards and linked data will allow information to be used outside of the originating silo to answer questions different from those of the original designers.
Another important part of access is permanence. Will it be there when you go back to look for it again? If you copy the address bar from the browser, will that take you back to what you were looking at? Will any of it make sense to a human who might want to make a modification? In the case of images of manuscripts, the most important standard is the International Image Interoperability Framework (IIIF) Image API. This lets us store the image once on a public repository, and refer to and access any portion and scale we might want. If I want to collect examples of a particular scribal practice, such as ligatures or nomina sacra, I can store the IIIF Image URL rather than downloading, modifying, and reposting the image. The coordinates are understandable by a human with familiarity with the standard and can be easily modified to get a broader or higher-resolution image. More importantly, we always know where the image came from. Similarly the IIIF Presentation API describes codices and other large collections of images in meaningful and standard ways.9
9 For more on the International Image Interoperability Framework (IIIF) and how it can be useful to scholarship and teaching in biblical studies see, Todd R. Hanneken, “International Image Interoperability Framework (IIIF),” Pre-Publisher Research for Brill’s Textual History of the Bible, accessed 7 January 2020, https://jubilees.stmarytx.edu/2019/brill-thb-iiif.html.
Another concern is not just will the information be there when we go back for it, but when our great-grandchildren go back for it. In some fields permanence can mean only across browser sessions. In biblical studies, working with manuscripts that have been around for millennia, we raise harder questions. Will the information be there for future generations? Longevity is partly a function of commitments from stable institutions, such as major universities. If we project further into the future, stability is not enough. Information survives if it is copied. It is copied if it continues to be useful, and can be copied. The information in a proprietary format, such as a Word Perfect document, has the best chance of survival if it is preserved in a format such as PDF that is open, standard, and can be easily upgraded to whatever replaces it. The current standard does not need to last forever as long as it can be understood and converted by future aggregators and archives.
The final consideration for access is the ease of use of the visualization interface. Users would rank this highly. However, if the standards for interoperability are done right this is the least of the concerns. No one viewer needs to be a permanent solution, and no one viewer needs to have the perfect balance of power and ease that is right for everyone. Once images and collections are defined with IIIF standards, users can choose between several viewers according to personal preference. Mirador (Fig. 22) stands out as being most actively developed, so there is a greater chance that users will already be familiar with it, and a greater chance that power and ease of use will increase in the future. But if a better viewer comes along later, nothing will have to change about how the information is stored.10
10 The analogous example of the relationship between web standards (HTML) and web browsers (Netscape, Firefox, Internet Explorer, Chrome, Safari, Opera) illustrates both the principle that a page should be accessible from any viewer, and also the pitfalls of deviation from standards compliance.
The second priority for digitally-enabled research and teaching is that digital simulations of manuscripts should be able to help us answer the questions we could answer with first-hand experience. When people say there is no substitute for first-hand experience, they don’t mean that the text is more legible, certainly not more than a critical edition. My point is not to argue that a digital experience will ever be the same as an unmediated experience. It may be better in some ways, and worse in others, but always different. We can examine the differences and consider how many of them can be addressed. An ineffable value of unmediated experience will keep museums and libraries in business.11 To imagine the optimal digital simulation, we can focus on the scholarly questions that can be answered with first-hand experience and work from there.
11 It may be helpful to think of the analogy of musical performance. No one will equate having seen a musician perform live with having heard a very good recording of that performance. If an essential part of a concert is the shared experience with friends and strangers, could social media play a role? If the visuals are an essential part, could video play a role? If the freedom to look around is an essential part, could virtual reality play a role? Concert goers (and concert venues) have found value in holographic projections of deceased performers. Any such supplements or enhancements do not devalue the live performance and the effable value of the experience thereof. The question is not whether concert venues (or cultural heritage institutions) can survive digital access and enhancement. The question is whether they can survive without it.
One way to think about this is to picture what we do in a reading room. There is a lot of movement involved. We step back to grasp the overall structure, but then we move closer to examine detail. This means the spatial resolution has to be high enough to allow zoom without pixelation. We also move the object, or our heads, or the light. This is partly our way of correcting for abnormalities in the light that create artificial hues or other false artifacts. By holding a page up to the light we can see holes and scoring lines made to guide the scribe. We can see thin spots and even holes where the ink corroded the parchment. From movement we perceive specularity, how shiny the surface is. Most of all we perceive texture and depth. We track the distorted shape of a letter over distortions in the parchment. We note the hair and flesh sides of the parchment, especially when codicological reconstruction is necessary. We try to read dry-point notation, the hidden notes scribes and readers made to themselves that could only ever be seen from texture.
To these examples from parchment manuscripts, many more could be added when studying objects for which texture was the primary conveyor of meaning. Inscriptions, coins, and cuneiform are major examples from writing, and brush strokes and other techniques can be important in arts and crafts. A diffuse light photograph of an inscription is completely illegible. A good photographer can find the right angle of illumination to make the intended feature visible. If no one angle of light makes all the features visible, or if the photographer cannot anticipate every feature a scholar would want to examine, it becomes important to photograph multiple angles of illumination. The next step is to capture a complete set of angles of illumination. With all this information the data can be processed to record the texture and specularity of each pixel as a function of the light position. This method, called Reflectance Transformation Imaging, can extrapolate light positions and enhance the specularity of the surface.
More importantly, the image becomes interactive, as the user, even through a web browser, can move a virtual light around the object. This brings us back to our image of a scholar examining a manuscript in a reading room and the importance of movement. No single still image is adequate, and even a sum of still images falls short of the experience of motion and interactivity in real time. With interactive texture, we can get a feel for the condition of the folio and answer questions as basic as distinguishing a trace of ink even with the surface from a hole or accretion above the surface. For a student who might not have had the privilege of first-hand experience, it can be moving as well as informative.
The third priority picks up where the second priority leaves off. Sometimes first-hand experience is not enough to tell us everything we might like to know. Our memories are notoriously unreliable when we try to play back in our minds what we saw. Memory is also insufficient for persuading others. Even in the moment, our ability to see what we’re looking at is remarkably limited. Our low color resolution means that browns can be hard to distinguish. This is particularly a problem when we look at brownish parchment with brownish erased ink and brownish secondary ink and brownish reagent. There is much more to light and color than what humans can see naturally. Mantis shrimp, for example, have a much greater range and resolution of color receptivity.12 Every color we see is a combination from three types of color receptor in the eye. When we look at a rainbow we see seven bands. These bands are to color resolution what pixelation is to spatial resolution. With more receptors we would see a smooth gradient from violet to red. We call people color blind if they have only two kinds of color receptors. Shrimp could call us color blind. More usefully, a multispectral imaging system could call a shrimp color blind, resolving fourteen discrete wavelengths.13
12 Note that the existence of color receptors may not simply equate to “perception” as humans understand it. See Thomas W. Cronin and N. Justin Marshall, “A Retina with At Least Ten Spectral Types of Photoreceptors in Mantis Shrimp,” Nature 339 (1989): 137–40, doi: 10.1038/339137a0; Hanne Thoen et al., “A Different Form of Color Vision in Mantis Shrimp,” Science 343 (2014): 411–13, doi: 10.1126/science.1245824; Zaidi Qasim et al., “Evolution of Neural Computations: Mantis Shrimp and Human Color Decoding,” i-Perception 5 (2014): 492–96, doi: 10.1068/i0662sas.
13 Beyond multispectral imaging is hyperspectral imaging, which uses a diffraction grating to distinguish hundreds of wavelengths. It remains to be established whether such a degree of color resolution will benefit cultural heritage research.
Besides color resolution, our vision is also limited in color range. We do not see wavelengths shorter than violet, called ultraviolet, or longer than red, called infrared. Infrared is especially good at distinguishing organic and inorganic pigments. Ultraviolet is also useful because, in addition to reflecting off parchment, it also causes materials to fluoresce. Fluorescence is commonly experienced as the glow of shoelaces in what appears to be a dark room with a blacklight. We have known about the usefulness of infrared and ultraviolet for studying manuscripts long before digital imaging. A film camera can be modified to capture a monochrome photo showing infrared as white. A blacklight in a reading room can allow the eye to see the fluorescence, though not the reflected ultraviolet.
What is new with digital multispectral imaging is that for each pixel in each capture the light coming from that spot is given a numerical value.14 As long as the object and camera remain motionless, many captures can be acquired and the pixel will represent the same spot on the object. Multispectral imaging today might capture fifty images under different conditions. We measure how much light passes through the object at four different wavelengths. We measure how much visible light reflects at ten wavelengths. We measure how much invisible light (ultraviolet and infrared) reflects at six wavelengths. We measure how much light fluoresces in each of six color ranges, stimulated by five wavelengths of ultraviolet. Multispectral imaging doesn’t just take a nice picture, it captures a huge amount of digital data.
14 Digital multispectral imaging was pioneered most substantially by the Archimedes Palimpsest Project. Roger L. Easton and William Noel, “Infinite Possibilities: Ten Years of Study of the Archimedes Palimpsest,” Proceedings of the American Philosophical Society 154 (2010): 50–76.
Sometimes one of the captures is useful, the way an old film infrared photo could be useful. More often it takes additional processing to find meaningful contrasts in that huge collection of data. Fortunately, this is what computers are good at. For each pixel they can look at all the numbers captured under fifty or more conditions and clearly distinguish the brown with one spectral fingerprint from the brown with another spectral fingerprint. The images produced are not intended to represent true color, but to render contrasts invisible to the human eye in contrasts that are visible to the human eye. For a complex folio there may be more contrasts to show than can be shown at once. We should not expect multispectral imaging to produce one definitive image that will show everything one might wish to see. This is especially true if we think of manuscripts as more than just text containers. For this reason it is important for viewers to be able to flicker or fade between many color renderings.
These three priorities are all important to consider when thinking about what it means to digitize manuscripts in a way that will satisfy the needs of scholars today and well into the future. Multispectral data – beyond simple pictures of what the human eye can see – are necessary for erased or damaged manuscripts, or to study non-textual features of scribal culture. Texture and interactivity are necessary to provide conservators, researchers, and students with a sense of the physicality of the artifact as more than a text container. The images will not have the appropriate impact on scholarship if they cannot be accessed, discovered, and studied in a helpful viewer, both today and well into the future.
If we were to consider objects other than manuscripts, we would also have to include structure. A folio can be reasonably reduced to recto and verso with texture but not deep dimensionality on each side. For objects with many sides, or not simply reducible to sides, technologies such as laser-scanning and photogrammetry can capture truly three-dimensional structure. Complete 3D imaging includes both boundary structure of an object and the texture and specularity of each surface on the structure. Thus RTI and laser-scanning are not competing technologies, but complementary aspects of optimal three-dimensional visualization. While work remains to be done on integrating texture imaging with structure modeling, the three priorities discussed above are all fully compatible and integrated today.15 With support from the National Endowment for the Humanities, my own project developed and made public tools for combining Reflectance Transformation Imaging and multispectral imaging. The software also outputs formats conducive to publication using IIIF standards for interoperability and WebRTI for interactivity in any web browser.16
15 For the most promising work on the full integration of 3D structure models and surface texture captured from RTI, see Endres, Digitizing Medieval Manuscripts, and follow @BillEndres on Twitter.
16 Todd R. Hanneken, “The Jubilees Palimpsest Project: Pioneering the Recovery of Illegible Text from Ancient Manuscripts Through New Tools in Digital Archaeology,” The Jubilees Palimpsest Project, accessed 7 January 2020, https://jubilees.stmarytx.edu/; Todd R. Hanneken, “Guide to Creating Spectral RTI Images,” The Jubilees Palimpsest Project, accessed 7 January 2020, https://jubilees.stmarytx.edu/spectralrtiguide/; Todd R. Hanneken and Bryan Haberberger, “SpectralRTI_Toolkit,” GitHub, accessed 26 October 2019, https://github.com/thanneken/SpectralRTI_Toolkit/. The first print publication of the methods and benefits of combining multispectral and reflectance transformation imaging is Todd R. Hanneken, “New Technology for Imaging Unreadable Manuscripts and Other Artifacts: Integrated Spectral Reflectance Transformation Imaging (Spectral RTI),” in Ancient Worlds in a Digital Culture (ed. Claire Clivaz, Paul Dilley, and David Hamidović; Digital Biblical Studies 1; Leiden: Brill, 2016), 180–95.
One last consideration is cost. To date, mostly known high-value and mysterious objects have been imaged with the full set of multispectral and texture imaging. The only real solution to the problem of cost, in my opinion, is to increase efficiency and economy of scale. Once spectral imaging moves from a niche to the standard for conservation-quality imaging, the cost will decrease dramatically. One might think that many objects do not need texture imaging or do not need multispectral imaging, but that list shrinks if we imagine that other researchers may bring different questions to the artifact, particularly questions other than reading the main text. In many cases we don’t know what we can’t see until we try advanced imaging. Dry-point notation and erased text have appeared where not expected.17 One might say that anything is better than nothing, but it could do harm if scholarship is done using a digital simulation that fails to provide the necessary information. Work is also being done on inexpensive options that may not match the quality of a high-end system, but could be used to test many objects to determine candidates for further imaging.18
17 For examples of dry-point notation, see Endres, Digitizing Medieval Manuscripts, 33–46. Mike Phelps of the Early Manuscripts Electronic Library reports that the Sinai Palimpsests Project imaged some folios expecting not to find undertext, yet text was discovered and readable with the aid of multispectral imaging.
18 In 2020 the National Endowment for the Humanities funded a project at Rochester Institute of Technology titled, Low-Cost End-to-End Spectral Imaging System for Historical Document Discovery, accessed 15 June 2020, https://securegrants.neh.gov/publicquery/main.aspx?f=1&gn=PR-268783-20.
Manuscripts and the literature they preserve are only one aspect of a complete study of the ancient world.19 I do not believe, however, that the literary record and study of scribal cultures has been exhausted by the critical editions and digitized collections available today. The study of the most primary of primary sources in biblical literature, the manuscripts themselves, is very different today than twenty years ago. We can expect, or at least hope, that it will be even more different twenty years from now.
19 See, for example, the contribution of Michael Satlow to this volume, chapter 3.
Allen, Garrick V. “Digital Tools for Working with New Testament Manuscripts.” Open Theology 5 (2019): 13–28.
Ceriani, Antonio Maria. Fragmenta latina evangelii S. Lucae, parvae genesis et assuptionis Mosis, Baruch, threni et epistola Jeremiae versionis syricae Pauli telensis cum notis et initio prolegomenon in integram ejusdem versionis editionem. Monumenta Sacra et Profana ex Codicibus praesertim Bibliotheca Ambrosiana 1.1. Milan: Typis et impensis Bibliothecae Ambrosinae, 1861.
Craig-McFeely, Julia. “Recovering Lost Texts: Rebuilding Lost Manuscripts.” Archive Journal (2018). http://www.archivejournal.net/essays/recovering-lost-texts-rebuilding-lost-manuscripts/.
Cronin, Thomas W., and N. Justin Marshall. “A Retina with at least Ten Spectral Types of Photoreceptors in Mantis Shrimp.” Nature 339 (1989): 137–40.
Easton, Roger L., and William Noel. “Infinite Possibilities: Ten Years of Study of the Archimedes Palimpsest.” Proceedings of the American Philosophical Society 154 (2010): 50–76.
Edwards, A.S.G. “The Digital Archive, Scholarly Enquiry, and the Study of Medieval English Manuscripts.” Archive Journal (2018). http://www.archivejournal.net/essays/digital-archive-scholarly-enquiry-and-the-study-of-medieval-english-manuscripts/.
Endres, Bill. Digitizing Medieval Manuscripts: The St. Chad Gospels, Materiality, Recoveries, and Representation in 2D and 3D. Medieval Media Cultures. Leeds: Arc Humanities Press, 2019.
———.“More than Meets the Eye: Going 3D with an Early Medieval Manuscript.” Proceedings of the Digital Humanities Congress 2012. Edited by Clare Mills, Michael Pidd, and Esther Ward. Studies in the Digital Humanities. Sheffield: The Digital Humanities Institute, 2012. https://www.dhi.ac.uk/openbook/chapter/dhc2012-endres.
Green, Johanna M. E. “Digital Manuscripts as Sites of Touch: Using Social Media for ‘Hands-On’ Engagement with Medieval Manuscript Materiality.” Archive Journal (2018). http://www.archivejournal.net/essays/digital-manuscripts-as-sites-of-touch-using-social-media-for-hands-on-engagement-with-medieval-manuscript-materiality/.
Hamidović, David, Claire Clivaz, and Sarah Bowen Savant, eds. Ancient Manuscripts in Digital Culture: Visualisation, Data Mining, Communication. Digital Biblical Studies 3. Leiden: Brill, 2019.
Hanneken, Todd R. “Guide to Creating Spectral RTI Images.” The Jubilees Palimpsest Project, 2019. https://jubilees.stmarytx.edu/spectralrtiguide/.
———. “International Image Interoperability Framework (IIIF).” Pre-Publisher Research for Brill’s Textual History of the Bible, 2019. https://jubilees.stmarytx.edu/2019/brill-thb-iiif.html.
———. “The Jubilees Palimpsest Project: Pioneering the Recovery of Illegible Text from Ancient Manuscripts Through New Tools in Digital Archaeology.” 2019. https://jubilees.stmarytx.edu/.
———. “New Technology for Imaging Unreadable Manuscripts and Other Artifacts: Integrated Spectral Reflectance Transformation Imaging (Spectral RTI).” Pages 180–95 in Ancient Worlds in a Digital Culture. Edited by Claire Clivaz, Paul Dilley, and David Hamidović. Digital Biblical Studies 1. Leiden: Brill, 2016.
Hanneken, Todd R., and Bryan Haberberger. “SpectralRTI_Toolkit.” GitHub, 2019. https://github.com/thanneken/SpectralRTI_Toolkit/.
Hanrahan, Michael, and Bridget Whearty. “Digital Medieval Manuscript Cultures.” Archive Journal (2018). http://www.archivejournal.net/essays/digital-medieval-manuscript-cultures/.
Hunt, Leta, Marilyn Lundberg, and Bruce Zuckerman. “Concrete Abstractions: Ancient Texts as Artifacts and the Future of Their Documentation and Distribution in the Digital Age.” Pages 149–71 in Text Comparison and Digital Creativity. Edited by Wido Th. van Peursen, Ernst D. Thoutenhoofd, and Adriaan van der Weel. Leiden: Brill, 2011.
Landau, Brent, Adeline Harrington, and James C. Henriques. “‘What No Eye Has Seen’: Using a Digital Microscope to Edit Papyrus Fragments of Early Christian Apocryphal Writings.” Pages 50–69 in Ancient Manuscripts in Digital Culture: Visualisation, Data Mining, Communication. Edited by David Hamidović, Claire Clivaz, and Sarah Bowen Savant. Digital Biblical Studies 3. Leiden: Brill, 2019.
Lied, Liv Ingeborg. “Digitization and Manuscripts as Visual Objects: Reflections from a Media Studies Perspective.” Pages 15–29 in Ancient Manuscripts in Digital Culture: Visualisation, Data Mining, Communication. Edited by David Hamidović, Claire Clivaz, and Sarah Bowen Savant. Digital Biblical Studies 3. Leiden: Brill, 2019.
———. “Bible as Notepad: Exploring Annotations and Annotation Practices in Biblical Manuscripts.” Pages 1–9 in Bible as Notepad. Edited by Liv Ingeborg Lied and Matthew Maniaci. Berlin: De Gruyter, 2018.
Lit, L.W.C. van. Among Digitized Manuscripts: Philology, Codicology, Paleography in a Digital World. Handbook of Oriental Studies 137. Leiden: Brill, 2020.
Porter, Dot. “Is This Your Book? What We Call Digitized Manuscripts and Why It Matters.” Dot Porter Digital. Accessed 15 June 2020. http://www.dotporterdigital.org/is-this-your-book-what-digitization-does-to-manuscripts-and-what-we-can-do-about-it/.
Prescott, Andrew, and Lorna Hughes. “Why Do We Digitize? The Case for Slow Digitization.” Archive Journal (2018). http://www.archivejournal.net/essays/why-do-we-digitize-the-case-for-slow-digitization/.
Qasim, Zaidi, Justin Marshall, Hanne Thoen, and Bevil R. Conway. “Evolution of Neural Computations: Mantis Shrimp and Human Color Decoding.” i-Perception 5 (2014): 492–96.
Thoen, Hanne, Martin J. How, Tsyr-Huei Chiou, and Justin Marshall. “A Different Form of Color Vision in Mantis Shrimp.” Science 343 (2014): 411–13.
Todd R. Hanneken, “Three Priorities for Digitally-Enabled Research and Teaching in Manuscripts of Biblical Literature (Prepared for Brill, Digital Biblical Studies).” San Antonio, Texas: St. Mary’s University, 2021.