The objective of this research was to investigate the current state of human color vision modeling and to also address its problems and possibilities. Some existing color vision models were examined from a computational point of view, and the behavior of the models was compared with a human observer in experiments that evaluate the properties of color vision. Also, some dissertations | No 20 | Tuija Jetsu | Modeling color vision Tuija Jetsu Modeling color vision Tuija Jetsu Modeling color vision changes in the anatomical properties of the human vision system, like the cone ratio on the retina, were taken into account in a part of the experiments. The results described in this dissertation strengthen the idea that color vision as a concept is complicated, and that the modeling of it well is a demanding task. Publications of the University of Eastern Finland Dissertations in Forestry and Natural Sciences Publications of the University of Eastern Finland Dissertations in Forestry and Natural Sciences isbn 978-952-61-0257-3 issn 1798-5668 TUIJA JETSU Modeling color vision Publications of the University of Eastern Finland Dissertations in Forestry and Natural Sciences No 20 Academic Dissertation To be presented by permission of the Faculty of Science and Forestry for public examination in the Louhela Auditorium in Science Park, Joensuu, on December 7, 2010, at 12 o’clock noon. School of Computing Kopijyvä Oy Joensuu, 2010 Editors: Prof. Pertti Pasanen, PhD Sinikka Parkkinen, Prof. Kai Peiponen Distribution: University of Eastern Finland Library / Sales of publications P.O. Box 107, FI-80101 Joensuu, Finland tel. +358-50-3058396 http://www.uef.fi/kirjasto ISBN: 978-952-61-0257-3, ISSN: 1798-5668 (printed) ISBN: 978-952-61-0258-0, ISSN: 1798-5676 (PDF) ISSNL: 1798-5668 Author’s address: University of Eastern Finland School of Computing P.O.Box 111 80101 JOENSUU FINLAND email: [email protected] Supervisors: Professor Jussi Parkkinen, Ph.D. University of Eastern Finland School of Computing P.O.Box 111 80101 Joensuu FINLAND email: [email protected] Professor Timo Jääskeläinen, Ph.D. University of Eastern Finland Department of Physics and Mathematics P.O.Box 111 80101 JOENSUU FINLAND email: [email protected] Reviewers: Associate Professor Sérgio Nascimento, Ph.D. University of Minho Department of Physics Campus de Gualtar 4710-057 BRAGA PORTUGAL email: [email protected] Professor Olli Nevalainen, Ph.D. University of Turku Department of Information Technology 20014 TURUN YLIOPISTO FINLAND email: [email protected] Opponent: Senior Research Fellow Alessandro Rizzi, Ph.D. University of Milan Department of Information Technology via Bramante, 65 26013 CREMA ITALY email: [email protected] ABSTRACT The objective of this research was to investigate the current state of human color vision modeling and to also address its problems and possibilities. All the following results strengthen the idea that color vision as a concept is complicated, and that the modeling of it well is a demanding task. First, some existing color vision models were examined from a computational point of view. No model was able to replicate the performance of human color vision fully in every experiment, and our experiments showed that there are large differences in the properties of these models. At least some kind of nonlinearity had to be implemented in order to be able to compensate for the differences between different brightness levels. The nonlinear models also performed significantly better in a color classification task. The errors made by the nonlinear models were similar to the ones human observers also often make, meaning that if the color was not classified into the correct class, it was usually classified into one of the neighboring classes. Another part of our experiments indicated that if the changes in cone ratio would not be compensated for at all in the later stages of the human visual system, the resulting color space would be very different for each individual. A small part of the research was related to the Retinex model and color constancy. Finally, we conducted a color naming experiment by focal colors of different sizes and durations, and measured the reaction time for each stimulus. The results of the color naming experiment showed that the connections between different colored stimuli and the actual color sensation can vary a lot depending on the parameters related to the stimuli. UDC: 004.942, 159.937.51, 519.876.5, 591.185.6, 612.843.31 Keywords (INSPEC Thesaurus): colour vision; visual perception; colour; visible spectra; vision defects; eye; modelling; computers; computer vision Preface I would like to start by thanking my supervisors, Prof. Jussi Parkkinen and Prof. Timo Jääskeläinen, for pointing me to the appropriate direction in the course of my studies and providing me the chance to be a part of Joensuu Color Group. I was given quite a free hand to find my own way, and I definitely learned a lot during these past years. Next I want to thank all the former and current members of Joensuu Color Group for the cooperation in all scientific and notso-scientific matters. I had the great pleasure of sharing ideas and a wide range of different moments with you. The same applies also to students, staff and alumni of the Biological and Physiological Engineering Laboratory at Toyohashi University of Technology, Japan: thank you for welcoming me to your group for six months and introducing the various aspects of Japanese culture to me. I also want to thank Prof. Shigeki Nakauchi separately for the invitation to Japan and all the help during my stay. Kimiyoshi Miyata, Masayuki Ukishima, Mitsuyoshi Tashiro, Ryouhei Suzuki, Naoko Takekawa and the Arai family also deserve thanks for sharing their pieces of the Land of the Rising Sun with me. Arigatou gozaimashita! I appreciate the valuable comments that the reviewers of this thesis, Prof. Olli Nevalainen and Prof. Sergio Nascimento, have kindly provided. Also my peer reviewers, Ville and Ilja, have given me important feedback, and the language review done by Prof. Gregory Watson has helped my work remarkably. The financial support from Tekniikan edistämissäätiö and Finnish Concordia Fund for parts of my post-graduate studies is also gratefully acknowledged. I am most indebted to my family and friends for providing indispensable counterbalance to the world of science during all the years I spent with my studies. It has been good to know that I could turn to you whenever necessary, no matter how far or near from each other we have been. And last, but definitely not least, I am grateful to my dearest Ilja for being always there for me. Thank you for your endless love and support. Joensuu November 4, 2010 Tuija Jetsu "If we knew what it was we were doing, it would not be called research, would it?" – Albert Einstein LIST OF PUBLICATIONS This dissertation consists of an overview part and the following selection of the author’s publications: P1 Jetsu, T., Heikkinen, V., Pogosova, A., Jaaskelainen, T., and Parkkinen, J., "Comparison of color vision models based on spectral color representation", Color Research and Application, Vol. 34, Number 5, pp. 341-350 (2009). P2 Jetsu, T., Heikkinen, V., Pogosova, A., Jaaskelainen, T. and Parkkinen, J., "Cone ratio in color vision models", in the Proceedings of the IEEE 14th International Conference on Image Analysis and Processing Workshops (ICIAP 2007), pp. 179-182, Modena, Italy, September 11-13, 2007. P3 Pogosova, A., Jetsu, T., Heikkinen, V., Hauta-Kasari, M., Jaaskelainen, T. and Parkkinen, J., "Spectral images and the Retinex model", in the Proceedings of the 9th International Symposium on Multispectral Colour Science and Application (MCS07), pp. 80-87, Taipei, Taiwan, May 30-June 1, 2007. P4 Jetsu, T., Essiarab, Y., Heikkinen, V., Jaaskelainen, T. and Parkkinen, J., "Color classification using color vision models", to be published in Color Research and Application. Available online since November 9, 2010. DOI: 10.1002/col.20632 P5 Jetsu, T., Komine, H., Nakauchi, S., and Parkkinen, J., "The effect of stimulus color, size and duration in color naming reaction times", in the Proceedings of the 11th Congress of the International Colour Association (AIC) 2009 (AIC2009), Sydney, Australia, September 27-October 2, 2009. Throughout the overview, these papers will be referred to as [P1][P5]. AUTHOR’S CONTRIBUTION The contributions of the author of this dissertation for the publications [P1]-[P5] can be summarized as follows. In publications [P1], [P2] and [P4] the author was responsible for the implementation or revision of the necessary functions and execution of the computations (excluding the implementation of original Bumbaca & Smith and Ingling & Tsou functions and the original classification algorithm for [P4] , which were done by Yugo Imazumi, Anahit Pogosova and Yasser Essiarab, respectively) and analysis of the results. The author of this dissertation was also the main writer of these three articles. In publication[P3], the author was co-supervising the M.Sc. candidate working with the topic, had implemented the original function used for color space conversions, proofread the manuscript and gave the conference presentation. In publication [P5], the author planned and executed the psychophysical experiments, analyzed the results and was the main writer of the article. Contents 1 INTRODUCTION 1.1 Purpose and Organization of this Dissertation . . . . 1 4 2 MECHANISMS BEHIND COLOR VISION 2.1 The Eye . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.2 The Brain . . . . . . . . . . . . . . . . . . . . . . . . . . 7 11 14 3 COLOR VISION DEFICIENCIES 3.1 Color Vision Tests . . . . . . . . . . . . . . . . . . . . . 3.2 Differences between Individuals . . . . . . . . . . . . 19 22 24 4 MODELING COLOR VISION 4.1 Theories . . . . . . . . . . . . . . . . . . . . . . . . . . 4.2 Models . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 29 31 5 SUMMARY OF THE RESULTS 39 6 CONCLUSIONS 43 REFERENCES 45 1 Introduction Colors are a significant part of our everyday life. They play a major role, for example, in warning signs, marketing, quality control and medical applications. In applications where important decisions must be made based on color, it is necessary to be aware of all the facts that affect color perception. Color sensation is always a sum of at least three factors: the object under inspection, the light source under which the object is examined, and the observer him/herself. Also, the surroundings of the object under consideration may affect the perceived color dramatically. Even though a lot of applications based on accurate color measurements and machine vision have been developed for different purposes (e.g. [1, 22, 26, 50, 55, 60, 61, 67, 76]), in many cases quality judgements are still made by a human employee. People can be trained to make judgements of uniform quality at a certain level, but, nonetheless, the color vision of an individual is always a subjective characteristic. This study aims at examining some parts of this sophisticated system in more detail, especially from a computational point of view. Human color vision is a very complex system: even though there are differences in the anatomical and physiological properties between individuals [34, 66], most people are able to recognize and name the colors on a general level in the same way. Those individuals who make an exception to this common behavior are often suffering from some form of color vision deficiency. An example that is not directly related to color vision, but illustrates well the complexity of the visual processing in the brain, is a case of a patient who completely lacked activity in the visual cortex, but was still able to successfully navigate along a long corridor without bumping into any obstacles [16]. A similar case has also been reported with monkeys [39]. There is also a known case of a patient that has been able to consciously see colors being otherwise virtually blind [95]. Dissertations in Forestry and Natural Sciences No 20 1 Tuija Jetsu: Modeling Color Vision Human color vision is fundamentally trichromatic [49]. This means that on the retina, there are cones that are sensitive to three different wavelength regions. There are, however, a lot of individuals who have some kind of malfunction in one cone type. A common title for all these abnormalities is color vision deficiency (CVD). Color vision deficient people usually have problems either with long or middle wavelength cones. Long wavelength cones receive most of the information from the red end of the visible spectrum, and cones sensitive to middle wavelengths have their peak sensitivity in the green region. A complete lack or malfunction of either of these cone types leads to a condition that is in colloquial language often called red-green color blindness. Such dichromatic or anomalous trichromatic color vision is actually rather common among most mammals [45]. An individual with this kind of condition has problems in differentiating between certain hues of red and green. It is also possible, however very rare, that the short wavelength cones of an individual are malfunctioning, which causes problems mainly with the separation of certain blue and yellow hues [4, 49]. The genetics and the evolution of primate color vision has been researched a lot (e.g. [43–45, 66, 68, 70, 73, 93]). It is known, for example, that Old World primates have normally three types of cone photopigments and the set of their visual pigments is more or less uniform. At the same time, New World primates are more often dichromats and there is more variance in the photopigments [43, 63]. Generally speaking, it seems that trichromatic vision is almost always superior or at least equal in performance when compared to dichromatic. For example, Osorio and Vorobyev [69] have found that for identification tasks, the dichromat’s eye is almost as good as a trichromat’s, but for a trichromat it is easier to detect fruit against leaves. Also, in [68], the authors discuss differences between di- and trichromatic primates, and they state that "it would be interesting to find a natural situation where dichromat monkeys or humans enjoy any advantage over trichromats". In addition to differences in the number of cone types active on the retina causing some kind of color deficiency, there can be vari- 2 Dissertations in Forestry and Natural Sciences No 20 Introduction ation in the anatomical structure of individuals with totally normal color vision. For example, it has been proven with adaptive optics imaging that there are remarkable differences in the cone mosaics between individuals with normal color vision [34, 91]. Also, genetic variations in the sensitivities of the long and middle wavelength cones are known to exist [66], and it is actually genetically possible for human beings to simultaneously have on the retina more than three different cone pigments types [46, 65, 66]. There seem to be at least some indications that the fourth photopigment could also yield to a richer color experience [46]. As discussed above, there are a lot of well-known differences in color vision between individuals. It is also possible that color vision abilities of certain individuals change during the course of time [51]. The effect of different environmental variables on color vision is shown, for example, in a study with monkeys [81], where the color matching performance of a group of infant monkeys, that had been kept after birth in a room illuminated only by randomly changing monochromatic lights almost for one year, was quite different from that of a control group. Some proof of the plasticity of the neural mechanism behind the color perception has also been found in experiments with human adults [64]. The chromatic experience of the test subjects was altered using color filters. During the experiment, there was a shift in color perception, which persisted 1-2 weeks after the filters were no longer used. A more radical example of the adaptivity of the primate visual system was reported at the end of year 2009, when it was shown that it is possible to cure the color blindness of adult primates using gene therapy [59]. The male squirrel monkeys (saimiri sciureus) used as test subjects had been color blind since birth. When a virus containing a human Lopsin was injected into the photoreceptor layer of color blind monkeys, M-cones that were exposed to the L-opsin shifted their spectral sensitivity to respond to long wavelength light. The treated monkeys started to behave in tests in a way that indicated that they had gained trichromatic vision. According to the researchers, this improvement in color vision has remained stable for more than 2 Dissertations in Forestry and Natural Sciences No 20 3 Tuija Jetsu: Modeling Color Vision years. 1.1 PURPOSE AND ORGANIZATION OF THIS DISSERTATION The aspects presented above raise the following questions. How can the known anatomical and physiological variations affect existing color vision models? Is it necessary, or even possible, to model the individual differences of the visual system? Some viewpoints that affect our color perception and different ways for modeling color vision are presented in Figure 1.1. [P5] Psychophysical experiments [P1]-[P4] Computational modeling MODELING COLOR VISION Machine vision Animals (excl. humans) Color vision deficiencies Color naming Color classification Physical properties of a color vision system Learned color classes Aging Lens coloring Individual cone ratios and sensitivities Eye movements Color constancy Cultural differences Biological structure of human color vision system [P2] Visual buffer Shades Intensity Surrounds Figure 1.1: Different aspects of color vision and color vision modeling. The arrows on the left-hand side of the graph show the connections of publications [P1] - [P5] to different topics. A detailed presentation of the biological structure of the human color vision system is shown in Chapter 2 (Figures 2.4 and 2.5). The objective of this research was to investigate the current state of human color vision modeling and to also address its problems and possibilities. The main objective of this dissertation has been to examine the properties of color vision in different ways: • Based on existing models [P1], [P2], [P3], [P4] 4 Dissertations in Forestry and Natural Sciences No 20 Introduction • Based on the latest research of cone distribution in the human eye [P2] • Based on psychophysical experiments [P5] The major contribution of this dissertation is the examination of some existing color vision models from a computational point of view, and comparison of the behavior of the models with a human observer in experiments that evaluate the properties of color vision. Also, some changes in the anatomical properties of the human vision system, like the cone ratio on the retina, is taken into account in a part of the experiments. Based on the findings reported in the publications [P1] - [P5], conclusions are drawn and prospective research possibilities for understanding the properties of color vision in even more detail are suggested. The structure of this dissertation is as follows: After the Introduction in Chapter 1, general principles of color theory and color vision are presented in Chapter 2. Chapter 3 describes the different types of color vision deficiencies and introduces tools for diagnosing them. In addition, a more detailed discussion about differences in color vision between individuals is given. Chapter 4 includes a general description of modeling color vision and details of a couple of known color vision models. Chapter 5 is a summary of the publications included in this dissertation, and, finally, Chapter 6 contains a discussion and the conclusions. Dissertations in Forestry and Natural Sciences No 20 5 Tuija Jetsu: Modeling Color Vision 6 Dissertations in Forestry and Natural Sciences No 20 2 Mechanisms behind Color Vision Human beings interpret certain wavelengths of electromagnetic radiation as visible light (Figure 2.1). Light reflecting from an object and traveling through our visual system causes a color sensation (Figure 2.2). Also, the light illuminating the object can be interpreted to be of a certain color depending on its spectral power distribution. Figure 2.1: The electromagnetic spectrum The most accurate representation for color is the color spectrum S(λ), which represents the intensity of light as a function of wavelength λ. For example, the spectra of natural objects are continuos functions over a defined wavelength range, but in practical applications the spectrum is presented as a set of discrete values, as in Equation 2.1. S(λ) = [S(λ1 ) S(λ2 ) . . . S(λn )] (2.1) A spectrum that only contains information on how an object Dissertations in Forestry and Natural Sciences No 20 7 Tuija Jetsu: Modeling Color Vision interacts with light is called a reflectance spectrum in the case of opaque objects and a transmittance spectrum in the case of transparent objects [92]. When the spectral power distribution L(λ) of a light source and the reflectance or transmittance characteristics of an object are known, the interaction between the light and the material can be calculated as an element-wise product of two vectors using Equation 2.2. Sout (λ) = L(λ) · Sre f l/trans (λ) (2.2) Examples of these spectra in the case of an opaque object are shown in Figure 2.2. In the color vision context, the result of the aforementioned interaction reaches the human eye and, after being processed in the color vision system, causes color sensation. Figure 2.2: Factors affecting color sensation Even though the n-dimensional color spectrum is the most accurate representation for color, very often in practical applications the color is represented in a lower-dimensional color space. This reduction in the dimensionality of the color space sometimes causes a problem, in that multiple colors from the original color space are mapped onto a single color in the target space. This happens, for example, if the color spectra of two objects are fundamentally different, but when viewed by a particular observer under a certain 8 Dissertations in Forestry and Natural Sciences No 20 Mechanisms behind Color Vision illumination the colors look the same. This phenomenon is called metamerism [92]. Digital devices have their own 3-dimensional color spaces in which the color is represented as a combination of three primary colors. Most commonly in use are different RGB color spaces where each color is expressed as proportions of red, green and blue primaries. Also, the human color vision is based on information received through receptors sensitive to three different wavelength areas. The mathematical model for calculating the responses for a detected signal in a certain color space is: ci = Z λ Sout (λ)si (λ)dλ, (2.3) where i ∈ [1, n], n indicating the dimensionality of the target color space, Sout (λ) is the light reflecting from or transmitted through an object under observation, si (λ) is the i th sensitivity function of the observer, and ci is the value of the i th coordinate in the target color space. For example, in the case of an RGB camera n = 3, the sensitivity functions of the camera s1 (λ), s2 (λ), s3 (λ) are defined by the manufacturer and the responses c1 , c2 , c3 are commonly known as color coordinates R, G, B. An example of the dimensionality reduction described above in the case of a human observer is shown in Figure 2.3, where the light reflecting from an object is processed through the cones in the eye. In the case of the human observer, the sensitivity functions si (λ) are usually denoted as l (λ), m(λ), s(λ), and the responses ci as L, M, S. The sensitivity functions and the responses are related to the three types of cone cells in the human eye that are sensitive to long, middle and short wavelengths of the visible light. The event in Figure 2.3 is only the very first phase in the complicated process that finally leads to color perception. Kaiser and Boynton in their book "Human Color Vision" [49] have very thoroughly explained these facts and also other important properties of color vision that will be briefly mentioned in this chapter. A good reference for this topic is also Goldstein’s Sensation and Perception [27]. Dissertations in Forestry and Natural Sciences No 20 9 Tuija Jetsu: Modeling Color Vision l(λ) m(λ) s(λ) 400 450 500 550 Wavelength [nm] 600 650 400 700 (a) Light reflecting from an object (see also Figure 2.1) S 450 500 550 Wavelength (nm) 600 650 700 (b) Relative cone sensitivities of an observer M L (c) Responses of cones (b) to stimulus (a) Figure 2.3: The first stage of human color vision 10 Dissertations in Forestry and Natural Sciences No 20 Mechanisms behind Color Vision 2.1 THE EYE When light enters the eye, it first travels through its optical part ending up at the retina at the back of the eye. The general structure of a human eye is illustrated in Figure 2.4 [38]. The retina is a very complex organ and a part of the central nervous system [27, 49]. On the retina, there are two types of light-sensitive cells: rods and cones. Rods are active in low illumination conditions, whereas cones function when more light is available. Cones are mainly responsible for color vision. There are three types of cone cells in the human retina, which are sensitive to short, middle and long wavelengths of the visible spectrum. There are also a number of other types of cells in the retina that further transfer the signals from photoreceptors to the optic nerve and lateral geniculate nucleus (LGN). The different layers in the retina are shown in Figure 2.5 [37]. Figure 2.4: A schematic diagram of the human eye [38] The distribution of photoreceptor cells varies in different retinal locations as shown in Figure 2.6 [27, 47, 49, 71]. For example, the central foveal part of the retina, which is mainly responsible for visual fixation, is completely lacking rods. There are also differ- Dissertations in Forestry and Natural Sciences No 20 11 Tuija Jetsu: Modeling Color Vision Figure 2.5: A schematic diagram of the retina [37] 12 Dissertations in Forestry and Natural Sciences No 20 Mechanisms behind Color Vision 180 CONES 160 RODS 140 120 100 OPTIC DISC RECEPTOR DENSITY (mm-2 x 103) ences between the cones found in the fovea and the other parts of the retina: foveal cones are thinner and more closely packed than anywhere else. The retina is less than half as thick in the fovea as in the remainder of the eye, but even so the foveal cones are longer than cones in the other parts of the retina. Further away from the central fovea, the cones become fatter and rods start to appear. Outside the fovea, the cones are a lot fatter than the rods, which means that they also occupy more space. At the margin of so-called foveal pit there are already many more rods than cones per unit area (see Figure 2.6). 80 60 40 20 0 70 60 TEMPORAL 50 40 30 20 10 0 10 20 30 40 FOVEA 50 60 70 80 90 NASAL ECCENTRICITY (degrees) Figure 2.6: The distribution of rods and cones on a human retina (image based on [71]) Photoreceptor cells are connected in the outer plexiform level of the retina to bipolar and horizontal cells. The bodies of the bipolar and horizontal cells, as well as amacrine cells, lie in a region of the retina called the inner nuclear layer. Bipolar and horizontal cells further transmit the signal to interplexiform cells, which are also located in the inner nuclear layer. The cells in the inner nuclear layer are connected to ganglion cells in the inner plexiform layer. From ganglion cells nerve fibers conduct the signal to the optic nerve [49, 96]. The retina contains over one hundred million photoreceptor cells, but there are only one million ganglion cells that send information to the brain [96]. This is a clear sign of the fact that the visual signal Dissertations in Forestry and Natural Sciences No 20 13 Tuija Jetsu: Modeling Color Vision is already processed at least on some level at the retina. An abbreviated description of the connections relevant for color vision at the retina according to [49] is given in Summary 1. 1. Light is captured by cones 2. Any given cone is in contact with 2-4 horizontal cells - Horizontal cells tie groups of receptors together 3. Cones are also connected to bipolar cells - Midget bipolars are chromatically selective - Diffuse bipolars carry luminosity signals - Blue cone bipolars synapse with short wavelength sensitive receptors 4. Bipolar cells synapse with amacrine cells - Amacrine cells send processes horizontally in a layer between bipolar and ganglion cells - The relation of amacrine cells to color vision is not clear 5. Interplexiform cells send signals from the inner to the outer plexiform system - May take part in some sort of ’feedback’ system 6. Ganglion cells connect the retina to the optic nerve - Two types of ganglion cells: M-cells and P-cells Summary 1: Signal processing on the retina 2.2 THE BRAIN After leaving the retinal ganglion cells, the visual signals continue their way to the brain through optic nerve fibers [27, 49]. The path- 14 Dissertations in Forestry and Natural Sciences No 20 Mechanisms behind Color Vision way in the brain is shown in Figure 2.7, and Summary 2 gives a concise description of the different connections. About half of the optic nerve fibers from each eye cross the midline of the head at the optic chiasm. After the chiasm, about 80 percent of the optic nerve connects to the lateral geniculate nucleus (LGN) of the thalamus. There is one lateral geniculate nucleus on each side of the brain, and each LGN receives input from both eyes. In addition, the LGN also receives signals from the brain stem and visual cortex. It is not totally clear yet what kinds of roles these other signals play, but this complex construction shows that various things can influence the information sent to the LGN. It has been suggested that the major function of the LGN would not be to modify the response of neurons, but to regulate neural information coming from the retina to the visual cortex. This regularization can be seen when we examine the signals arriving at and leaving the LGN: for every 10 nerve impulses that reach the LGN from the retina, only about 4 leave the LGN for the cortex [7, 27]. The LGN consists of six layers that can be divided into two different parts: the top four layers are called parvocellular pathways and the bottom two layers magnocellular pathways. Distinction between magno- and parvocellular pahways already occurs at the ganglion cell level, and even though the precise distinction between these pathways is still under investigation, it has been suggested that the magnocellular pathways deliver the main part of all luminance-related signals, whereas the parvocellular layers are responsible for carrying the signals that result in color perception.Research by Schiller et. al. [75] shows that monkeys with lesions in the parvocellular layer lost their ability to detect color, which is a clear indication that the parvocellular layer plays a role in the color vision process. Most of the neural fibers connect from the LGN to the primary visual cortex (V1). The visual cortex provides a complex and a greatly distorted map of the retinal image. V1 also seems to be the place where the information from the two eyes is brought together [49]. There is a lot of research (e.g. [14,21,28]) that shows that on the cor- Dissertations in Forestry and Natural Sciences No 20 15 Tuija Jetsu: Modeling Color Vision tex there are a number of types of opponent cells that are excited by wavelengths at one end of the visible spectrum and inhibited by wavelengths at the other end of the spectrum. Opponent cells can also be found in the LGN [17]. A thorough summary of the color-coding in the different parts of the human color vision system has been done by Conway [13]. Opponent cells behave in a way that offers a foundation for the opponent-process theory of color vision [33]. 1. Signals from the retinal ganglion cells continue to the optic nerve 2. After crossing in the optic chiasma, ganglion cell signals reach the LGN - M-cells synapse in layers 1 & 2: magnocellular layers (luminance signals) - P-cells synapse in layers 3, 4, 5 & 6: parvocellular layers (chromatic signals) 3. A LGN neuron also receives information from brain stem and visual cortex - opponent cells on the LGN 4. LGN transfers information to the visual cortex - opponent cells on the cortex Summary 2: Signal processing in the brain 16 Dissertations in Forestry and Natural Sciences No 20 Mechanisms behind Color Vision Figure 2.7: The visual pathway of the human vision system Dissertations in Forestry and Natural Sciences No 20 17 Tuija Jetsu: Modeling Color Vision 18 Dissertations in Forestry and Natural Sciences No 20 3 Color Vision Deficiencies Even though most people have normal trichromatic color vision, about 8 % of males and less than 1 % of females have some level of color vision deficiency (CVD) [11]. The most severe version is a total lack of one or more types of cone cells in the eye. Dichromacy is a condition where one of three cone cell types is missing completely. If two (long- and middle-wavelength) or all types of cone cells are missing, the defect is called monochromacy, and the color vision of the subject is limited to black, white and shades of gray. Instead of a total loss of a certain cone type, it is also possible that the sensitivity of a cone type has been shifted towards the sensitivity of another type (anomalous trichromacy). The most common form of color vision deficiency is red-green color blindness, which results from the absence of either the long or middle wavelength sensitive visual photopigments [4]. Red-green blind subjects, as the name implies, have problems with differentiating between red and green hues. This type of color vision deficiency can be divided into two sub-categories: protan and deutan defects, depending on the type of cones that are not working properly. A protan defect can more accurately be defined as protanopia if the long-wavelength cones are completely missing, and protanomaly if there has been a shift in pigment absorption to shorter wavelengths. A deutan defect can similarly be defined as deuteranopia if the middle-wavelength cones are completely missing, and deuteranomaly if there has been a shift to longer wavelengths. Because the red-green color vision deficiency is a typical case of X-linked recessive inheritance, this form of color deficiency is more common with men than with women. See Table 3.1 for more details. A considerably rarer case of color vision deficiency is blueyellow or tritan color deficiency. Like protan and deutan defects, tritan defect can also have forms of tritanopia or tritanomaly, describing either a total or partial loss of short-wavelength cone pig- Dissertations in Forestry and Natural Sciences No 20 19 Tuija Jetsu: Modeling Color Vision Table 3.1: Prevalence of different types of color deficiency in men and women [4, 12] Prevalence in men (%) in women (%) Type of deficiency Protanopia Protanomalous trichromatism Deuteranopia Deuteranomalous trichromatism Tritanopia Tritanomalous trichromatism 1 1 1 5 0.0001 0.002 0.01 0.03 0.01 0.35 0.0001 0.002 ment. In the case of tritanomaly, the pigment absorption of shortwavelength cones is not shifted as in protanomaly and deuteranomaly but rather the pigment is partly missing [4, 49]. Tritan defects are inherited autosomally, so the probability of inheriting a tritan defect is equal for men and women. See Table 3.1 for more details. Even though protan and deutan color vision deficiencies are generally referred to as red-green deficiencies, protan and deutan subjects only have problems in differentiating certain hues of red and green. The confused colors lie in a CIE 1931 x,y chromaticity diagram on so-called confusion lines that converge at a single point, the confusion point (Figure 3.1) [92]. The same principle holds also for tritan deficiency. Color vision deficiencies are also common among other primates, especially among New World Monkeys [43,44]. For example, in the species of squirrel monkeys (Saimiri sciureus), some females have trichromatic color vision, whereas males are, in general, redgreen color blind. Until now, color vision deficiency has been considered to be an incurable condition. It was however shown by a group of researchers at the end of 2009 [59] that by using gene ther- 20 Dissertations in Forestry and Natural Sciences No 20 Color Vision Deficiencies (a) Protan confusion lines (b) Deutan confusion lines Figure 3.1: Examples of confusion lines for protan and deutan color vision deficiencies in a CIE xy chromaticity diagram Dissertations in Forestry and Natural Sciences No 20 21 Tuija Jetsu: Modeling Color Vision apy it is possible to cure color blindness in adult monkeys that had been color blind since birth. The experiments were conducted using a group of male squirrel monkeys, which were known to be redgreen color blind. In the experiments, a virus carrying the opsin for the third cone pigment type was added to the dichromatic retinas of the monkeys, providing a receptoral basis for trichromatic color vision. The researchers report that the treated monkeys’ improvement in color vision has remained stable for more than 2 years. This is a remarkable result that also proves the plasticity of the primate visual system in the sense that the rest of the visual system is able to adapt to the addition of the third receptor type. 3.1 COLOR VISION TESTS There are various kinds of tests for recognizing the different types of color vision defects. A comprehensive description of different tests can be found, for example, from the book Diagnosis of Defective Colour Vision by Jennifer Birch [4], which has also been used as a general reference throughout this chapter. Table 3.2 shows the suitability of color vision tests for different purposes. Screening tests are used to discover whether or not a person has a color vision deficiency. Grading tests aim at defining the severity of the deficiency. Classifying tests are used to identify the type of the deficiency (protan, deutan, tritan) and diagnostic tests to differentiate between dichromats and anomalous trichromats. There are also numerous tests that measure occupational suitability rather than really define the type of the subject’s color vision deficiency. Commonly used tests in clinical practice include arrangement tests, like Farnsworth-Munsell 100-Hue test and Farnsworth D15 test [23, 24], pseudoisochromatic plates (American Optical Society (HRR) plates, Ishihara plates [32, 42]), anomaloscopes, like Nagel anomaloscope [90] and lantern tests, like Holmes-Wright lanterns [35]. A spectral anomaloscope (Figure 3.2(b)) is a standard reference test for determining normal or abnormal red-green color vision and for diagnosing the exact type of red-green color deficiency. In 22 Dissertations in Forestry and Natural Sciences No 20 Color Vision Deficiencies Table 3.2: Suitability of color vision tests for different tasks according to J. Birch [4] Numbering used in the table: 0 (not suitable) - 3 (excellent suitability) Task A: Precise colour matching (Spectral anomaloscopes) Task B: Identification of figure (Pseudoisochromatic plates) Task C: Arrangement of hues in sequence (Hue discrimination) Task D: Colour naming (Lanterns) Task A Task B Task C Task D Screening (identifying) 3 3 0 1 Classifying (protan, deutan and tritan) 3 2 2 0 Grading (severity) 3 Depends on plate series 2 1 Diagnosis (dichromat/ anomalous trichromat) 3 0 0 0 Occupational suitability 0 0 3 3 Visual task Function anomaloscope testing, the subject is shown a circle that consists of two halves, test and target stimuli. The subject is asked to manipulate the red/green mixture ratio and the yellow luminance of the test stimulus by using two control wheels until the test stimulus matches the target stimulus in both color and brightness. Four separate matches are made. Pseudoisochromatic plates (Figure 3.2(c)) are designed in a way that individual elements of the plates are spots or patches of color which vary in size and lightness. The design exploits isochromatic color confusions so that elements in the plates can be seen by people with normal color vision but cannot be seen by color deficient Dissertations in Forestry and Natural Sciences No 20 23 Tuija Jetsu: Modeling Color Vision people. It is possible to design plates so that figures either vanish, appear or transform when the results of normal color vision subjects and color deficient subjects are compared. Arrangement, i.e. hue discrimination, tests (Figure 3.2(a)) are usually meant to be used for identifying people with significant color deficiency, who are likely to experience practical difficulties in specific occupations. Arrangement tests consist of color samples that the subject arranges in a natural order according to hue, lightness or saturation. Based on the errors made during the process, it is usually possible to define the type and severity of the color deficiency. Lantern tests (Figure 3.2(d)) are often used when testing people interested in careers in maritime, military, aviation and transport services. In these fields, recognition of colored light signals correctly is considered to be important for safety. Colors are either shown in pairs or singly in order to demonstrate the different kinds of light signals and the subject has to name the color(s) present. It should, though, be kept in mind that color naming is not an ideal method for identifying color deficiency, because when dealing with only small number of colors, it is possible to get reasonable results also with lucky guesses. 3.2 DIFFERENCES BETWEEN INDIVIDUALS A lot of research has been carried out in an attempt to explain the differences in color vision between individuals (for example [2, 3, 19, 34, 36, 46, 51–53, 58, 65, 74, 86, 91], just to mention a few more recent papers). Because color vision deficiency is linked to the Xchromosome, it is genetically possible for women to be carriers of the color deficiency gene without being color vision deficient themselves. Findings in the field of molecular genetics have revealed that instead of three retinal visual pigments, for the female it is actually genetically possible to have four different photopigments on the retina [19,52,65]. The effect of the fourth photopigment on color vision has not really been noticed in the conventional color vision 24 Dissertations in Forestry and Natural Sciences No 20 Color Vision Deficiencies (a) Farnsworth-Munsell 100-Hue test colors (hue arrangement) (b) The anomaloscope principle (precise color matching) (c) A vanishing pseudoisochromatic plate (figure identification) (d) Test lantern light combinations (color naming) Figure 3.2: Outlines of different color vision tests Dissertations in Forestry and Natural Sciences No 20 25 Tuija Jetsu: Modeling Color Vision tests, and it is yet partly unknown how it really affects color vision. Jameson et.al. [46] have found that women with four-photopigment genotypes perceive significantly more chromatic appearances than either male or female trichromat controls. Bimler et.al. [3] have also examined the differences in color experience between trichromat male and female subjects and concluded that when differentiating between colors, males placed significantly less weight on a red-green axis, and more on lightness. However, they soundly state that the differences in behavior can be caused by a number of reasons, ranging from retinal performance to patterns of socialization. On the other hand, Hood et.al. [36] report that the chromatic discrimination along a red-green axis was impaired in the case of carriers of deutan deficiencies but was normal in the case of carriers of protan deficiencies. Also, results from Bimler et.al. [2] support the fact that the color space of heterozygous women would be compressed in a red-green dimension. Because of a low number of subjects, they were unable to provide reasonable separate results for protan and deutan carriers. In addition to individual differences in sensor photopigments, there are also large inter-subject variations in the distribution of cone cells in the retina. The estimates of the relative numbers of cone cells sensitive to long (L) wavelengths and middle (M) wavelengths depend a lot on the experimental method in use [53]. A recently developed technique for measuring cone distribution from a living eye involves high-resolution adaptive-optics imaging combined with retinal densitometry [34, 74, 91]. Also an adaptive-optics scanning laser ophthalmoscope has been used to measure the packing of the cones on the retina [9, 10]. Kremers et.al. [53] mention in their summary article of different methods for defining the cone distribution that the L/M cone ratio in normal eyes has previously been found to vary between 10:1 and 1:3. Large individual variation is also shown in the results of Roorda and Williams [74,91] and Hofer et.al. [34], where the ratio of L to M cones varied from 1.1:1 to 16.5:1 within normal subjects. Hofer et.al. also found a protan carrier with normal color vision who had an even more extreme 26 Dissertations in Forestry and Natural Sciences No 20 Color Vision Deficiencies L:M ratio (0.37:1). All subjects in these two experiments had nearly identical S-cone densities. In the case of color vision deficient subjects, it has also been shown by adaptive-optics imaging [6] that in some cases there is nothing in the place of the deficient cone type, and in other cases cones have been replaced by another type. Instead of being congenital, it is also possible that a color vision defect is acquired at some point in life. Some medical conditions, like cortical or retinal lesions, glaucoma, diabetes and intracranial injury or prolonged use of certain therapeutic drugs, can all cause changes in color vision [4]. Color vision also changes with age, and the different effects of aging with respect to color vision have been summarized in [88]. It is known for example that the wavelength discrimination abilities often decrease when aging, especially in areas related to long and middle wavelengths causing a tritan-like color deficiency (e.g. [77]). Also, a general loss of sensitivity in color vision during aging is a known fact [89]. Werner [88] also mentions in his summary other possible age-related causes for changes in color vision, like the decreasing transmittance of the optical media in the eye, neural changes in the receptors (loss of foveal cones or photopigment density), and the effects of aging upon the higher neural pathways. However, it should be kept in mind that the age-related changes in visual functions may be compensated for, to some extent, by the plasticity of the adult vision system (e.g. [64]). Dissertations in Forestry and Natural Sciences No 20 27 Tuija Jetsu: Modeling Color Vision 28 Dissertations in Forestry and Natural Sciences No 20 4 Modeling Color Vision There are at least two different ways to start building a theory or a model for human color vision [82]. Research in psychophysics and physiology is based on assumptions that there are certain relations between color experiences and physiological states and events. Psychophysics investigates which kinds of responses subjects have to well-defined physical stimuli, and physiology attempts to define correlations between these responses and the neural structures of the human visual system. Computational research, on the other hand, aims to explain different phenomena of color vision, at a distinctly different level from those of psychophysics and physiology. For example, the computational approach has been used to explain the approximate color constancy property of human color vision [56, 57]. Color related tasks that at first sight seem to be rather straightforward for a human being, can be computationally quite demanding. A human observer can, for example easily recognize and categorize colors under various illuminations [31], and also take, with ease, into account other factors than just color when the task is to identify an object. Modeling this kind of behavior is a challenging task, because, for example, the boundaries between different color classes are generally not linear [8], and categorization results vary between observers (e.g. [36, 54]). 4.1 THEORIES The first theories for color vision were already developed over 200 years ago. The principle of trichromatic color vision was originally presented in 1802 by Thomas Young [94], and the theory, nowadays known as Young–Helmholtz trichromatic theory, was further developed by Hermann von Helmholtz [83]. The basic idea behind this theory was that in the eye there are three types of photoreceptors Dissertations in Forestry and Natural Sciences No 20 29 Tuija Jetsu: Modeling Color Vision that are sensitive to different wavelengths of visible light. Signals from these photoreceptors then produced a color perception when further processed by the brain. Even though the trichromatic theory is able to explain a part of the behavior of human color vision, there are still some aspects that it cannot cover. For example, why in the case of color deficiency are there always problems with certain pairs of colors, red-green or blue-yellow instead of some single colors? And why under normal conditions [15] is there no such color as reddish green or bluish yellow? Ewald Hering developed a different opponent process theory [33] to explain this kind of phenomena. He stated that instead of three, there are actually four different primaries that appear in pairs as red versus green and blue versus yellow. According to Hering, the color processing system was based on three main components that would respond in two opposite directions to signal red vs. green, blue vs. yellow and black vs. white [72]. He believed that this kind of processing already happens in the receptor level. Zone theories for color vision bring together the trichromatic and opponent theories. The properties of both theories are combined into two separate but sequential zones which describe the process of the visual stimulus arriving at the retina. The first versions of this type of combined theory was suggested by M¸ller in 1930 [62] followed by Judd in 1949 [48]. In 1957, Leo Hurvich and Dorothea Jameson [40] provided quantative data for color opponency and proposed a precise testable formulation for a theory based on two sequential stages of color processing [72]. In addition to trichromatic and zone theories, there are also other theories with different approaches that try to explain the properties of color vision. One of the well-known theories is the Retinex theory introduced by Land in 1964 [56] and the further developed by Land and McCann [57]. The Retinex theory attempts to model color constancy, one of the fundamental features of human color vision. Color constancy can be defined as an ability to maintain the color of an object even if the illumination conditions and/or the surrounding colors of the object change. Even though the hu- 30 Dissertations in Forestry and Natural Sciences No 20 Modeling Color Vision man visual system is not able to preserve color constancy perfectly, it still outperforms artificial simulations of the visual system. The term Retinex is a combination of the words retina and cortex. This illustrates Land’s idea about retinal-cortical systems that independently process the spatial information from a visible scene. The systems are assumed to be sensitive to short, middle and long wavelengths, and each system forms a separate image of the world. According to Land’s theory, images from different systems are compared with each other. The information from the entire visible scene is used to eliminate the effect of the unknown and not necessarily uniform illumination, leading to approximation of color constancy. 4.2 MODELS Models for color vision rest on the assumptions made in theories for color vision [92]. Usually the assumptions must be somehow simplified in order to make the models useful for practical applications. For example, when modeling the sensitivities of the human visual system, a CIE standard observer (Figure 4.1) or a transformation of it is used. There are also a number of different cone sensitivity functions available for modeling the first phase of the human vision system, for example from Smith & Pokorny (extended later by DeMarco, Pokorny and Smith) [20, 78], Vos & Walraven [84, 85, 87] and Stockman & Sharpe [79, 80]. One quite common limitation of color vision models is that the processing of the color information is based on a single pixel, which does not accurately describe the real color vision system. The parameters of models are usually defined based on the results of different psychophysical experiments, for example replicating the behavior of subjects in discrimination or classification (e.g. [5, 30, 41]). It is also possible to start the modeling from a physiological point of view ( [18]) or to use a computational approach ( [25, 56]). As we examine some of the existing color vision models, we can see that the basic structure of most models follows the well-known color vision theories described in the previous section. Dissertations in Forestry and Natural Sciences No 20 31 Tuija Jetsu: Modeling Color Vision 1.8 x(λ) y(λ) z(λ) 1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 0 400 500 600 700 Wavelength (nm) Figure 4.1: CIE 1931 XYZ color matching functions Ingling and Tsou [41] have formulated a simple one-opponent stage vector space model for color vision. The calculation of the opponent stage responses of the Ingling and Tsou model is done in two steps. The first step is to multiply the incoming signal by Smith and Pokorny cone fundamentals in order to get cone responses L, M and S. After that, opponent stage responses r − g, b − y, and Vλ (red-green, blue-yellow and achromatic channel, respectively) are calculated simply by summing up cone responses. Ingling and Tsou present in their model two different formula sets, one for darkand one for light-adapted conditions (threshold and suprathreshold forms, see Equations 4.1 and 4.2, respectively). 1.2 −1.6 0 r−g L b − y = 0.048 −0.039 −0.042 M 0.6 0.4 0 Vλ S r−g 1.2 −1.6 0.4 L b − y = 0.24 0.105 −0.7 M Vλ 0.6 0.4 0 S (4.1) (4.2) Bumbaca and Smith [5] have developed a computer vision system, which would take advantage of the color vision discrimination capabilities of the human color vision. Bumbaca and Smith’s model starts by multiplying the incoming signal by Smith and Pokorny 32 Dissertations in Forestry and Natural Sciences No 20 Modeling Color Vision cone fundamentals in order to get cone responses L, M, and S. After that, a logarithm of L, M and S signals is taken in order to simulate the nonlinear response of cones L∗ , M ∗ , and S∗ Equations 4.34.5). Finally, nonlinear cone responses are summed in order to form achromatic and chromatic channels A, C1 , and C2 (achromatic, redgreen and blue-yellow channel, respectively - see Equation 4.6). L∗ = log L (4.3) M ∗ = log M (4.4) S ∗ = log S A a 0 0 α β 0 L∗ C1 = 0 u1 0 1 −1 0 M ∗ S∗ C2 0 0 u2 1 0 −1 (4.5) (4.6) Parameters a, u1 and u2 of the Bumbaca and Smith model can be adjusted, for example, so that the just-noticeable difference in perception in the AC1 C2 space is a sphere of radius 1. The values for the parameters in this case are a(= 22.6), u1 (= 41.6) and u2 (= 10.5). α(= 0.7186) and β(= 0.2814) are scaling parameters related to the model’s abilities to estimate V (λ) curve. De Valois and De Valois [18] have developed a Multi-Stage Color Model, which is mainly based on the physiological properties of the human visual system. The model is based on the assumption that the cones in the eye have a fixed ratio of 10:5:1 for long-, middle-, and short-wavelength cones, respectively. De Valois and De Valois introduced in their model two possibilities for receptive field behavior: discrete and indiscriminate versions. In the discrete version, cells with a L or M cone center are assumedly not affected by S cones in the surroundings. The indiscriminate version sums together all kinds of cells in the receptive field surroundings. The modeling begins by multiplying the incoming signal by Smith and Pokorny cone fundamentals in order to obtain cone responses L, Dissertations in Forestry and Natural Sciences No 20 33 Tuija Jetsu: Modeling Color Vision M and S. After that, cone opponency signals LO , MO , and SO are calculated by using the receptive field theory (Equation 4.7): • Subtract surrounding signals from the signal at the center of receptive field. • Weight the signal in the center by 16 (sum of assumed ratios). • Total weight for the surrounding signals is also 16, using ratio 10:5:1 for L, M and S signals, respectively. Finally, the responses from second stage are summed up to obtain perceptual opponency signals RG, BY, and A i.e. red-green, blueyellow, and achromatic channels (Equation 4.8). The assumed ratio 10:5:1 is modified at this stage to 10:5:2, thus giving more weight to short-wavelength signals. LO MO = SO RG BY = A 6 −5 −1 L (4.7) −10 11 −1 M −10 −5 15 S +1 −1 +1 10 0 0 LO −1 +1 +1 0 5 0 MO +1 +1 +1 0 0 2 SO 90 −115 +25 L = −130 (4.8) 95 35 M −10 −5 15 S The stages of the Ingling & Tsou, Bumbaca & Smith and De Valois & De Valois color vision models are presented in a flow chart shown in Figure 4.2. The history of Guth’s ATD model includes various versions and modifications. In ATD95 [29], Guth has summarized all his previous work, and also extended the model further [30]. His ATD model has two opponent stages, and the model parameters have been tuned to meet certain conditions defined by experimental results. Calculations in Guth’s ATD model begin by defining the responses for L, M, and S channels from an input signal by using 34 Dissertations in Forestry and Natural Sciences No 20 Modeling Color Vision Figure 4.2: The processing steps in Ingling & Tsou, Bumbaca & Smith and De Valois & De Valois color vision models Dissertations in Forestry and Natural Sciences No 20 35 Tuija Jetsu: Modeling Color Vision modified Smith & Pokorny Equations 4.9-4.11. With these functions, the sensitivity in longer wavelengths is slightly enhanced, the responses are made nonlinear and constant noise is added to each receptor response. Also, gain control for the receptor responses is introduced (Equation 4.12). The final responses for different two opponent A1 T1 D1 and A2 T2 D2 are calculated through a twophase process that includes calculations for initial responses (Equations 4.13 and 4.14) and compression of those (Equation 4.15). A2 , T2 and D2 at the final stage of the model describe the achromatic, red-green and blue-yellow channels, respectively. L = [0.66(0.2435X + 0.8524Y − 0.0516Z )]0.70 + 0.024 (4.9) M = [1.0(−0.3954X + 1.1642Y + 0.0837Z )]0.70 + 0.036(4.10) S = [0.43(0.04Y + 0.06225Z )]0.70 + 0.31 Rg = R σ , σ+R where R ∈ { L, M, S} and σ = 300. A1i 3.57 2.64 0 Lg 0 Mg T1i = 7.18 −6.21 D1i Sg −0.70 0.085 1.00 A2i 0.09 0 0 A1i 0.43 0.76 T1i T2i = 0 0 0 1.00 D2i D1i Rj = R ji , 200 + | R ji | (4.11) (4.12) (4.13) (4.14) (4.15) where R ∈ { A, T, D } and j ∈ {1, 2}. A flow chart of Guth’s ATD model is shown in Figure 4.3. 36 Dissertations in Forestry and Natural Sciences No 20 Modeling Color Vision Figure 4.3: Guth’s ATD model Dissertations in Forestry and Natural Sciences No 20 37 Tuija Jetsu: Modeling Color Vision 38 Dissertations in Forestry and Natural Sciences No 20 5 Summary of the Results It is known that there are already individual differences in the detection phase of the human color vision system, for example in the spatial configuration or spectral sensitivities of the cone cells in the eye [34, 66]. The increasing amount of knowledge about human color vision properties has raised a need to re-evaluate the existing color vision model. We have started this work with the following publications. The relationship of each publication to certain aspects of color vision is shown in Figure 5.1. ? Color perception Color naming General properties of the human color vision system [P1] Comparison of color vision models based on spectral color representation Color classification Color naming Color constancy [P4] Color classification using color vision models [P3] Spectral images and the Retinex model [P5] The effect of stimulus color, size and duration in color naming reaction times [P2] Cone ratio in color vision models Figure 5.1: Publications In publication [P1] (Comparison of Color Vision Models Based on Spectral Color Representation), we re-evaluate four existing color vision models and consider questions raised by recent break-throughs in retinal imaging. Many color vision models are based on an as- Dissertations in Forestry and Natural Sciences No 20 39 Tuija Jetsu: Modeling Color Vision sumption of the standard observer, and usually there is no consideration regarding how the individual properties of different observers could be taken into account. For example, the retinal mosaic or the cone sensitivities can vary a lot between observers, which can be taken into account by starting the color vision process from the spectral origin. The main interest in this article was to examine how different color vision models behave when compared to corresponding human results. The evaluation presented in this paper gives us more knowledge about the essential properties of the models. The performance of the models in the Farnsworth-Munsell 100 Hue color vision test, the wavelength discrimination power of each model, and the color spaces spanned by the models were examined. Guth’s complex nonlinear model was found to be able to approximate the color vision properties over a wide range of luminances, but also the lot simpler Ingling and Tsou’s linear model with a single opponent stage was able to give adequate results. However, no model was able to replicate the performance of human color vision fully in every experiment, and our experiments show that there are large differences in the properties of these models. In publication [P2] (Cone Ratio in Color Vision Models), we considered how the changes of the cone ratio in the retina would affect color vision models. The basis of our analysis lies in a Multi-Stage Color Model by de Valois and de Valois (1993), and we show how changes in cone ratio affect the different stages of this model. The behavior of the Multi-Stage Color Model was tested with different cone ratios: 10:5:1, 18:5:1, 3:6:1, 12:1:1 and 1:1:1. The changes in cone ratio were implemented as changes in the weighting of the responses at the first stage of the model. For the Farnsworth-Munsell 100 Hue color vision test, ratio 3:6:1 best preserved the organization of the test colors in the opponent color space. Ratios 12:1:1 and 1:1:1 differed most from the others. This article shows that if the changes in cone ratio would not be compensated for at all in the later stages of the human visual system, the resulting color space 40 Dissertations in Forestry and Natural Sciences No 20 Summary of the Results would be very different for each individual. In publication [P3] (Spectral images and the Retinex model), the color constancy performance of the Retinex algorithm in different color spaces was reviewed.The Retinex algorithm has earlier been applied mainly to grayscale or RGB images, but in this paper we consider different ways of applying the Retinex model to spectral images. The use of spectral images as the starting point for the model enables one, for example, more accurate examination of illumination or observer changes. First, we tested how the Retinex preserves colors when the spectral power distribution of the ambient light changes. To examine this, the algorithm was applied to images in four different color spaces: spectral, L channel of the L*a*b*, LMS, and sRGB. The color constancy between different illuminants was best preserved by using the spectral color space, and the poorest performance was reached by using the sRGB space. When examining the behavior of the Retinex model in a case where the surround of an area of a scene changes, the results in RGB and spectral spaces are similar (contrary to the first experiment) and closer to the real world color perception than the results in other color spaces. In general, it was noted that the output of the Retinex algorithm for all color spaces requires careful selection of the postprocessing method. In publication [P4] (Color classification using color vision models), we look at the color vision topic from a classification point of view. Instead of detecting and analyzing colors exactly in the same way, we have all just learned to classify colors in a certain way, which seems to lead almost always to the same result independent of the individual differences in the color vision system. The color classification abilities of color vision models, considered also in [P1], were examined by using a simple subspace classification method on Munsell Matte Collection color samples. The output of the MultiStage Color Model by De Valois and De Valois was a very poor starting point for color classification, and with the output of Ingling and Tsou model the color classes were somewhat overlapping. The Dissertations in Forestry and Natural Sciences No 20 41 Tuija Jetsu: Modeling Color Vision two nonlinear models, Bumbaca and Smith’s and Guth’s models, performed significantly better in this classification task. The errors made by the two latter models were similar to the ones human observers also often make, meaning that if the color was not classified into the correct class, it was usually classified into one of the neighboring classes. In publication [P5] (The effect of stimulus color, size and duration in color naming reaction times), we examine the differences in color naming reaction times between subjects with normal and deficient color vision. Color deficient people use, in many cases, color names in a similar manner as people with normal color vision do. This means that the individual differences at the detection level of a color vision system are somehow compensated for at the later levels. In order to examine how different parameters affect the color naming process, we conducted a color naming experiment by using modified Berlin and Kay (1969) focal colors of different sizes and durations, and measured the reaction time for each stimulus. Some differences were found between normal and color vision deficient subjects. It was found that among the three examined parameters, color, size and duration, most differences in reaction times between color vision deficient subjects and subjects with normal color vision were due to the color of the stimuli. Color vision deficient (protan and deutan) subjects were clearly slower to react to red and green colors than to blue and yellow, whereas there were no remarkable differences in the reaction times for different colors with subjects having normal color vision. There was one deutan subject who consistently named red colors as green. In addition, subjects with normal color vision named very small blue stimuli as green. Also, the size of the stimuli had an effect on the reaction times for some subjects, and size and duration both affected the misclassification rate of stimuli. 42 Dissertations in Forestry and Natural Sciences No 20 6 Conclusions As almost always when modeling natural phenomena, when modeling color vision the following questions also easily arise. Should the model be universal or specific just for a certain application? At what level of accuracy should the model be implemented? Is it even possible to create a universal model? Understanding the behavior of human color vision requires knowledge from various fields of science. It makes no sense to claim that the overview presented here would be all-embracing, because there are countless possibilities for implementing the properties of human color vision. This dissertation and the related articles have been written with an intention to contemplate the properties of human color vision from a slightly different point of view. It was found out in [P1] that none of the examined models were able to replicate the behavior of human color vision perfectly in all experiments. At least some kind of nonlinearity had to be implemented in order to be able to compensate for the differences between different brightness levels. Even though the performance of the Bumbaca and Smith model was the poorest with the tasks given in [P1], the model performed well in the color classification task in [P4]. This is a good example of a model that performs well in a specific task for which it has been originally designed, in this case the performance being motivated by a computer vision application. Guth’s ATD model performed well in almost all given tasks, but from the ATD model it is not as easy to separate all the stages of the biological color vision system as it is, for example, in the De Valois and De Valois model. As models are based on different ideas, they also perform differently in given tasks. Based on the results of [P2], we can speculate that if the only thing changing anatomically in the color vision system between individuals was the cone ratio on the retina, the personal color space of each individual would be quite different from others. Of course Dissertations in Forestry and Natural Sciences No 20 43 Tuija Jetsu: Modeling Color Vision it is quite a radical simplification of the process if only the cone ratio in the model is changed, and this does not tell the whole truth of what actually happens in the human color vision. When people have different cone distribution on the retina, the further neural connections related to color vision are most probably formulated in a different way, too. The actual spatial arrangement of the cones was not considered as a part of this dissertation, but it is also one interesting research topic related to color vision modeling. Color constancy is one important property of the human color vision system, but it is not too easy to model, as was seen in [P3]. Also the connections between different colored stimuli and the actual color sensation can vary a lot depending on the parameters related to the stimuli, as was shown in the experiments in [P5]. The largest differences in color-related issues are typically seen between subjects with normal and deficient color vision, but there are also individual differences within each group. All these results strengthen the idea that color vision as a concept is complicated, and that the modeling of it well is a demanding task. The adaptive behavior of the color vision system is important from the modeling point of view: in order to be able to replicate the color vision accurately, a model must also have dynamic properties, like possibilities for spatial and temporal processing. It is very likely that no model can take into account every single aspect of color vision, but by combining the best properties of each model it is possible to find a more universal approach. 44 Dissertations in Forestry and Natural Sciences No 20 Bibliography [1] C. Balas, V. Papadakis, N. Papadakis, A. Papadakis, E. Vazgiouraki, and G. Themelis. A novel hyper-spectral imaging apparatus for the non-destructive analysis of objects of artistic and historic value. Journal of Cultural Heritage, 4(Supplement 1):330–337, 2003. [2] D. Bimler and J. Kirkland. Colour-space distortion in women who are heterozygous for colour deficiency. Vision Research, 49:536–543, 2009. [3] D. L. Bimler, J. Kirkland, and K. A. Jameson. Quantifying variations in personal color spaces: Are there sex differences in color vision? Color Research & Application, 29(2):128–134, 2004. [4] J. Birch. Diagnosis of Defective Colour Vision, 2nd Ed. Butterworth-Heinemann, Boston, 2001. [5] F. Bumbaca and K. C. Smith. Design and implementation of a colour vision model for computer vision applications. Computer Vision, Graphics, and Image Processing, 39(2):226 – 245, 1987. [6] J. Carroll, M. Neitz, H. Hofer, J. Neitz, and D. R. Williams. Functional photoreceptor loss revealed with adaptive optics: An alternate cause of color blindness. PNAS, 101(22):8461– 8466, 2004. [7] V. Casagrande and T. Norton. Lateral geniculate nucleus: A review of its physiology and function. In J. Cronly-Dillon and A. G. Leventha, editors, Vision and visual dysfunction: The neural basis of visual function, volume 4, pages 41–84. Macmillan, London, 1991. [8] E. J. Chichilnisky and B. A. Wandell. Trichromatic opponent color classification. Vision Research, 39:3444–3458, 1999. Dissertations in Forestry and Natural Sciences No 20 45 Tuija Jetsu: Modeling Color Vision [9] T. Y. Chui, H. Song, and S. A. Burns. Adaptive-optics imaging of human cone photoreceptor distribution. J. Opt. Soc. Am. A, 25(12):3021–3029, 2008. [10] T. Y. P. Chui, H. Song, and S. A. Burns. Individual variations in human cone photoreceptor packing density: variations with refractive error. Invest. Ophthalmol. Vis. Sci., 49(10):4679–4687, 2008. [11] B. Cole. Assessment of inherited colour vision defects in clinical practice. Clinical and Experimental Optometry, 90:157–175., 2007. [12] B. L. Cole. The handicap of abnormal colour vision. Clinical and Experimental Optometry, 87(4-5):258–275, 2004. [13] B. R. Conway. Color vision, cones, and color-coding in the cortex. Neuroscientist, 15(3):274–290, 2009. [14] B. R. Conway and M. S. Livingstone. Spatial and temporal properties of cone signals in alert macaque primary visual cortex. J. Neurosci., 26(42):10826–10846, 2006. [15] H. D. Crane and T. P. Piantanida. On seeing reddish green and yellowish blue. Science, 221:1078–1080, 1983. [16] B. de Gelder, M. Tamietto, G. van Boxtel, R. Goebel, A. Sahraie, J. van den Stock, B. M. Stienen, L. Weiskrantz, and A. Pegna. Intact navigation skills after bilateral loss of striate cortex. Current Biology, 18(24):R1128–R1129, 2008. [17] R. L. De Valois. Color vision mechanisms in the monkey. The Journal of General Physiology, 43(6):115–128, 1960. [18] R. L. De Valois and K. K. De Valois. A multi-stage color model. Vision Research, 33(8):1053–1065, 1993. [19] S. S. Deeb and A. G. Motulsky. Molecular genetics of human color vision. Behavior Genetics, 26:195–207, 1996. 46 Dissertations in Forestry and Natural Sciences No 20 Bibliography [20] P. DeMarco, J. Pokorny, and V. C. Smith. Full-spectrum cone sensitivity functions for X-chromosome-linked anomalous trichromats. J. Opt. Soc. Am. A, 9:1465–1476, 1992. [21] A. M. Derrington, J. Krauskopf, and P. Lennie. Chromatic mechanisms in lateral geniculate nucleus of macaque. J Physiol., 357:241–265, 1984. [22] M. Eng, P. Martin, and C. Bhagwandin. The analysis of metameric blue fibers and their forensic significance. Journal of Forensic Sciences, 54(4):841–845, 2009. [23] D. Farnsworth. The Farnsworth-Munsell 100-hue and dichotomous tests for color vision. J. Opt. Soc. Am., 33(10):568–574, 1943. [24] D. Farnsworth. The Farnsworth dichotomous test for color blindness panel D-15. Technical report, Psychological Corporation, New York, 1947. [25] B. Funt, F. Ciurea, and J. McCann. Retinex in Matlab(TM). J. Electron. Imaging, 13(1):48–57, 2004. [26] P. Fält, J. Hiltunen, M. Hauta-Kasari, I. Sorri, V. Kalesnykiene, and H. Uusitalo. Extending diabetic retinopathy imaging from color to spectra. In Proceedings of the 16th Scandinavian Conference on Image Analysis, pages 149–158, Oslo, Norway, 2009. Springer-Verlag. [27] E. B. Goldstein. Sensation & Perception. Brooks/Cole, Pacific Grove (CA), 5 edition, 1999. [28] P. Gouras. Cortical mechanisms of colour vision. In P. Gouras, editor, Vision and visual dysfunction: The perception of colour, pages 179–197. Macmillan, London, 1991. [29] S. L. Guth. Further applications of the ATD model for color vision. Proceedings of SPIE, 2414(1):12–26, 1995. Also in IS&T’s Recent Progress in Color Science, Karen Braun and Reiner Dissertations in Forestry and Natural Sciences No 20 47 Tuija Jetsu: Modeling Color Vision Eschbach, Eds. Society for Imaging Science and Technology, Springfield, USA, 1997, pp. 177-185. [30] S. L. Guth. The constancy myth, the vocabulary of color perception, and the ATD04 model. Proceedings of SPIE, 5292:1–14, 2004. [31] T. Hansen, M. Giesel, and K. R. Gegenfurtner. Investigating human chromatic discrimination of natural objects. In CGIV 2006 – Third European Conference on Color in Graphics, Imaging and Vision, pages 119–124, Leeds, UK, 2006. [32] L. Hardy, G. Rand, and M. Rittler. The H.R.R. polychromatic plates. J. Opt. Soc. Am., 44:509–523, 1954. [33] E. Hering. Zur Lehre vom Lichtsinne. Carl Gerolds Sohn, Hamburg, 1878. English translation: Outlines of a theory of the light sense (translated by Hurvich, L.M. & Jameson, D.). Harvard University Press, Cambridge, Mass., USA, 1964. [34] H. Hofer, J. Carroll, J. Neitz, M. Neitz, and D. R. Williams. Organization of the human trichromatic cone mosaic. J. Neurosci., 25(42):9669–9679, 2005. [35] J. Holmes and W. Wright. A new colour-perception lantern. Color Research & Application, 7:82–88, 1982. [36] S. Hood, J. Mollon, L. Purves, and G. Jordan. Color discrimination in carriers of color deficiency. Vision Research, 46(18):2894– 2900, 2006. [37] http://commons.wikimedia.org (User:Chrkl). retina diagram (2010). Basis for the [38] http://commons.wikimedia.org (User:Rhcastilhos). Eye diagram (2010). [39] N. K. Humphrey. Vision in a monkey without striate cortex: a case study. Perception, 3(3):241–255, 1974. 48 Dissertations in Forestry and Natural Sciences No 20 Bibliography [40] L. Hurvich and D. Jameson. An opponent-process theory of color vision. Psychol Rev, 64:384–404, 1957. [41] C. R. Ingling, Jr. and B. H.-P. Tsou. Orthogonal combination of the three visual channels. Vision Research, 17(9):1075–1082, 1977. [42] S. Ishihara. The series of plates designed as a test for colourblindness. Kanehara Shuppan Co., Ltd., Tokyo, 1976. [43] G. H. Jacobs. Primate photopigments and primate color vision. PNAS, 93(2):577–581, 1996. [44] G. H. Jacobs. A perspective on color vision in platyrrhine monkeys. Vision Research, 38(21):3307–3313, 1998. [45] G. H. Jacobs and M. P. Rowe. Evolution of vertebrate colour vision. Clinical and Experimental Optometry, 87(4-5):206–216, 2004. [46] K. A. Jameson, S. M. Highnote, and L. M. Wasserman. Richer color experience in observers with multiple photopigment opsin genes. Psychonomic Bulletin & Review, 8:244–261, 2001. [47] J. B. Jonas, U. Schneider, and G. O. H. Naumann. Count and density of human retinal photoreceptors. Graefe’s Archive for Clinical and Experimental Ophthalmology, 230(6):505–510, 1992. [48] D. Judd. Response functions for types of vision according to the Müller theory. Journal of Research of the National Bureau of Standards, 42:1–16, 1949. [49] P. K. Kaiser and R. M. Boynton. Human Color Vision (Second Edition). Optical Society of America, Washington, DC, 1996. [50] H. Kauppinen. Development of a Color Machine Vision Method for Wood Surface Inspection. PhD thesis, Oulun Yliopisto, 1999. [51] K. Knoblauch, F. Vital-Durand, and J. L. Barbur. Variation of chromatic sensitivity across the life span. Vision Research, 41(1):23–36, 2001. Dissertations in Forestry and Natural Sciences No 20 49 Tuija Jetsu: Modeling Color Vision [52] T. W. Kraft, J. Neitz, and M. Neitz. Spectra of human L cones. Vision Research, 38:3663– 3670, 1998. [53] J. Kremers, H. P. N. Scholl, H. Knau, T. T. J. M. Berendschot, T. Usui, and L. T. Sharpe. L/M cone ratios in human trichromats assessed by psychophysics, electroretinography, and retinal densitometry. Journal of the Optical Society of America A, 17:517–526, 2000. [54] R. G. Kuehni. Variability in unique hue selection: A surprising phenomenon. Color Research & Application, 29(2):158–162, 2004. [55] S. Kukkonen, H. Kalviainen, and J. Parkkinen. Color features for quality control in ceramic tile industry. Opt. Eng., 40(2):170– 177, 2001. [56] E. H. Land. The Retinex. Am. Scientist, 52:247–264, 1964. [57] E. H. Land and J. J. McCann. Lightness and Retinex theory. J. Opt. Soc. Am., 61:1–11, 1971. [58] M. S. Loop, J. F. Shows, S. C. Mangel, and T. K. Kuyk. Colour thresholds in dichromats and normals. Vision Research, 43(9):983–992, 2003. [59] K. Mancuso, W. W. Hauswirth, Q. Li, T. B. Connor, J. A. Kuchenbecker, M. C. Mauck, J. Neitz, and M. Neitz. Gene therapy for red-green colour blindness in adult primates. Nature, 461:784–787, 2009. [60] B. Martinkauppi, E. Doronina, J. Piironen, T. Jaaskelainen, and J. Parkkinen. Novel system for semiautomatic image segmentation of arctic charr. J. Electron. Imaging, 16(3):033012–8, 2007. [61] P. M. Mehl, Y.-R. Chen, M. S. Kim, and D. E. Chan. Development of hyperspectral imaging technique for the detection of apple surface defects and contaminations. Journal of Food Engineering, 61(1):67–81, 2004. 50 Dissertations in Forestry and Natural Sciences No 20 Bibliography [62] G. Müller. Über die Farbenempfindungen. Zeitschrift für Psychologie und Physiologie der Sinnesorgane, 17/18:1–430/435–647, 1930. [63] J. Nathans. The evolution and physiology of human color vision: Insights from molecular genetic studies of visual pigments. Neuron, 24(2):299–312, 1999. [64] J. Neitz, J. Carroll, Y. Yamauchi, M. Neitz, and D. R. Williams. Color perception is mediated by a plastic neural mechanism that is adjustable in adults. Neuron, 35(4):783–792, 2002. [65] J. Neitz, M. Neitz, and G. H. Jacobs. More than three different cone pigments among people with normal color vision. Vision Research, 33:117–122, 1993. [66] M. Neitz and J. Neitz. Molecular genetics of color vision and color vision defects. Arch Ophthalmol, 118(5):691–700, 2000. [67] M. Okuyama, N. Yokoyama, D. Nakao, N. Tsumura, and Y. Miyake. Accurate mapping pigmentations in human skin by spatio-temporal modulation of light source in the multispectral imaging. In PICS, pages 272–277, 2003. [68] D. Osorio, A. C. Smith, M. Vorobyev, and H. M. BuchananSmith. Detection of fruit and the selection of primate visual pigments for color vision. The American Naturalist, 164(6):696– 708, 2004. [69] D. Osorio and M. Vorobyev. Colour vision as an adaptation to frugivory in primates. Proceedings. Biological Sciences / The Royal Society, 263(1370):593–599, 1996. PMID: 8677259. [70] D. Osorio and M. Vorobyev. A review of the evolution of animal colour vision and visual communication signals. Vision Research, 48(20):2042–2051, 2008. [71] G. Osterberg. Topography of the layer of rods and cones in the human retina. Acta Ophthalmol., Suppl., 13(6):1–102, 1935. Dissertations in Forestry and Natural Sciences No 20 51 Tuija Jetsu: Modeling Color Vision [72] S. E. Palmer. Vision Science: Photons to Phenomenology. MIT Press, Cambridge, 1999. [73] B. C. Regan, C. Julliot, B. Simmen, F. Vienot, P. CharlesDominique, and J. D. Mollon. Fruits, foliage and the evolution of primate colour vision. Philosophical Transactions: Biological Sciences,, 356(1407):229–283, 2001. [74] A. Roorda and D. R. Williams. The arrangement of the three cone classes in the living human eye. Nature, 397(6719):520– 522, 1999. [75] P. H. Schiller, N. K. Logothetis, and E. R. Charles. Functions of the colour-opponent and broad-band channels of the visual system. Nature, 343(6253):68–70, 1990. [76] M. Sharifzaded, P. S. Bernstein, and W. Gellermann. Nonmydriatic fluorescence-based quantitative imaging of human macular pigment distributions. J. Opt. Soc. Am. A, 23:2373– 2387, 2006. [77] K. Shinomori, B. E. Schefrin, and J. S. Werner. Age-related changes in wavelength discrimination. J. Opt. Soc. Am. A, 18:310–318, 2001. [78] V. C. Smith and J. Pokorny. Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm. Vision Research, 15(2):161–171, 1975. [79] A. Stockman and L. T. Sharpe. The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype. Vision Research, 40:1711–1737, 2000. [80] A. Stockman, L. T. Sharpe, and C. Fach. The spectral sensitivity of the human short-wavelength sensitive cones derived from thresholds and color matches. Vision Research, 39(17):2901– 2927, 1999. 52 Dissertations in Forestry and Natural Sciences No 20 Bibliography [81] Y. Sugita. Experience in early infancy is indispensable for color perception. Current Biology, 14(14):1267–1271, 2004. [82] E. Thompson. Colour Vision: A Study in Cognitive Science and the Philosophy of Perception. Routledge Press, London/New York, 1995. [83] H. von Helmholz. Handbuch der Physiologischen Optik. Voss, Hamburg, 1867. English translation: Handbook of physiological optics (translated by Southall, J.P.C.). Optical Society of America, Rochester, N.Y., 1924. [84] J. J. Vos. Colorimetric and photometric properties of a 2◦ fundamental observer. Color Research & Application, 3(3):125–128, 1978. [85] J. J. Vos and P. L. Walraven. On the derivation of the foveal receptor primaries. Vision Research, 11:799–818, 1971. [86] T. Wachtler, U. Dohrmann, and R. Hertel. Modeling color percepts of dichromats. Vision Research, 44(24):2843–2855, 2004. [87] P. Walraven. A closer look at the tritanopic convergence point. Vision Research, 14(12):1339–1343, IN4, 1974. [88] A. Werner, A. Bayer, G. Schwarz, E. Zrenner, and W. Paulus. Effects of ageing on postreceptoral short-wavelength gain control: Transient tritanopia increases with age. Vision Research, 50(17):1641–1648, 2010. [89] J. S. Werner and V. G. Steele. Sensitivity of human foveal color mechanisms throughout the life span. J. Opt. Soc. Am. A, 5(12):2122–2130, 1988. [90] C. H. Williams. Nagel’s anomaloscope for testing color vision. Trans Am Ophthalmol Soc, 14(1):161–165, 1915. [91] D. R. Williams and A. Roorda. The trichromatic cone mosaic in the human eye. In K. R. Gegenfurtner and L. T.Sharpe, Dissertations in Forestry and Natural Sciences No 20 53 Tuija Jetsu: Modeling Color Vision editors, Color Vision: From Genes to Perception, pages 113–122. Cambridge University Press, UK, 1999. [92] G. Wyszecki and W. S. Stiles. Color science : concepts and methods, quantitative data and formulae (2nd edition). John Wiley & Sons, Inc., USA, 2000. [93] S. Yokoyama and F. Radlwimmer. The "five-sites" rule and the evolution of red and green color vision in mammals. Mol Biol Evol, 15(5):560–567, 1998. [94] T. Young. On the theory of light and colours. Philosophical transactions of the Royal Society of London, 92:12–48, 1802. [95] S. Zeki, S. Aglioti, D. McKeefry, and G. Berlucchi. The neurological basis of conscious color perception in a blind patient. PNAS, 96(24):14124–14129, 1999. [96] H. Zollinger. Color: A Multidisciplinary Approach. Verlag Helvetica Chimica Acta / Wilet-VCH, Zurich / Weinheim, 1999. 54 Dissertations in Forestry and Natural Sciences No 20 The objective of this research was to investigate the current state of human color vision modeling and to also address its problems and possibilities. Some existing color vision models were examined from a computational point of view, and the behavior of the models was compared with a human observer in experiments that evaluate the properties of color vision. Also, some dissertations | No 20 | Tuija Jetsu | Modeling color vision Tuija Jetsu Modeling color vision Tuija Jetsu Modeling color vision changes in the anatomical properties of the human vision system, like the cone ratio on the retina, were taken into account in a part of the experiments. The results described in this dissertation strengthen the idea that color vision as a concept is complicated, and that the modeling of it well is a demanding task. Publications of the University of Eastern Finland Dissertations in Forestry and Natural Sciences Publications of the University of Eastern Finland Dissertations in Forestry and Natural Sciences isbn 978-952-61-0257-3 issn 1798-5668
© Copyright 2026 Paperzz