| 1 |
.. SPDX-License-Identifier: GFDL-1.1-no-invariants-or-later |
| 2 |
.. c:namespace:: V4L |
| 3 |
|
| 4 |
.. _colorspaces: |
| 5 |
|
| 6 |
*********** |
| 7 |
Colorspaces |
| 8 |
*********** |
| 9 |
|
| 10 |
'Color' is a very complex concept and depends on physics, chemistry and |
| 11 |
biology. Just because you have three numbers that describe the 'red', |
| 12 |
'green' and 'blue' components of the color of a pixel does not mean that |
| 13 |
you can accurately display that color. A colorspace defines what it |
| 14 |
actually *means* to have an RGB value of e.g. (255, 0, 0). That is, |
| 15 |
which color should be reproduced on the screen in a perfectly calibrated |
| 16 |
environment. |
| 17 |
|
| 18 |
In order to do that we first need to have a good definition of color, |
| 19 |
i.e. some way to uniquely and unambiguously define a color so that |
| 20 |
someone else can reproduce it. Human color vision is trichromatic since |
| 21 |
the human eye has color receptors that are sensitive to three different |
| 22 |
wavelengths of light. Hence the need to use three numbers to describe |
| 23 |
color. Be glad you are not a mantis shrimp as those are sensitive to 12 |
| 24 |
different wavelengths, so instead of RGB we would be using the |
| 25 |
ABCDEFGHIJKL colorspace... |
| 26 |
|
| 27 |
Color exists only in the eye and brain and is the result of how strongly |
| 28 |
color receptors are stimulated. This is based on the Spectral Power |
| 29 |
Distribution (SPD) which is a graph showing the intensity (radiant |
| 30 |
power) of the light at wavelengths covering the visible spectrum as it |
| 31 |
enters the eye. The science of colorimetry is about the relationship |
| 32 |
between the SPD and color as perceived by the human brain. |
| 33 |
|
| 34 |
Since the human eye has only three color receptors it is perfectly |
| 35 |
possible that different SPDs will result in the same stimulation of |
| 36 |
those receptors and are perceived as the same color, even though the SPD |
| 37 |
of the light is different. |
| 38 |
|
| 39 |
In the 1920s experiments were devised to determine the relationship |
| 40 |
between SPDs and the perceived color and that resulted in the CIE 1931 |
| 41 |
standard that defines spectral weighting functions that model the |
| 42 |
perception of color. Specifically that standard defines functions that |
| 43 |
can take an SPD and calculate the stimulus for each color receptor. |
| 44 |
After some further mathematical transforms these stimuli are known as |
| 45 |
the *CIE XYZ tristimulus* values and these X, Y and Z values describe a |
| 46 |
color as perceived by a human unambiguously. These X, Y and Z values are |
| 47 |
all in the range [0…1]. |
| 48 |
|
| 49 |
The Y value in the CIE XYZ colorspace corresponds to luminance. Often |
| 50 |
the CIE XYZ colorspace is transformed to the normalized CIE xyY |
| 51 |
colorspace: |
| 52 |
|
| 53 |
x = X / (X + Y + Z) |
| 54 |
|
| 55 |
y = Y / (X + Y + Z) |
| 56 |
|
| 57 |
The x and y values are the chromaticity coordinates and can be used to |
| 58 |
define a color without the luminance component Y. It is very confusing |
| 59 |
to have such similar names for these colorspaces. Just be aware that if |
| 60 |
colors are specified with lower case 'x' and 'y', then the CIE xyY |
| 61 |
colorspace is used. Upper case 'X' and 'Y' refer to the CIE XYZ |
| 62 |
colorspace. Also, y has nothing to do with luminance. Together x and y |
| 63 |
specify a color, and Y the luminance. That is really all you need to |
| 64 |
remember from a practical point of view. At the end of this section you |
| 65 |
will find reading resources that go into much more detail if you are |
| 66 |
interested. |
| 67 |
|
| 68 |
A monitor or TV will reproduce colors by emitting light at three |
| 69 |
different wavelengths, the combination of which will stimulate the color |
| 70 |
receptors in the eye and thus cause the perception of color. |
| 71 |
Historically these wavelengths were defined by the red, green and blue |
| 72 |
phosphors used in the displays. These *color primaries* are part of what |
| 73 |
defines a colorspace. |
| 74 |
|
| 75 |
Different display devices will have different primaries and some |
| 76 |
primaries are more suitable for some display technologies than others. |
| 77 |
This has resulted in a variety of colorspaces that are used for |
| 78 |
different display technologies or uses. To define a colorspace you need |
| 79 |
to define the three color primaries (these are typically defined as x, y |
| 80 |
chromaticity coordinates from the CIE xyY colorspace) but also the white |
| 81 |
reference: that is the color obtained when all three primaries are at |
| 82 |
maximum power. This determines the relative power or energy of the |
| 83 |
primaries. This is usually chosen to be close to daylight which has been |
| 84 |
defined as the CIE D65 Illuminant. |
| 85 |
|
| 86 |
To recapitulate: the CIE XYZ colorspace uniquely identifies colors. |
| 87 |
Other colorspaces are defined by three chromaticity coordinates defined |
| 88 |
in the CIE xyY colorspace. Based on those a 3x3 matrix can be |
| 89 |
constructed that transforms CIE XYZ colors to colors in the new |
| 90 |
colorspace. |
| 91 |
|
| 92 |
Both the CIE XYZ and the RGB colorspace that are derived from the |
| 93 |
specific chromaticity primaries are linear colorspaces. But neither the |
| 94 |
eye, nor display technology is linear. Doubling the values of all |
| 95 |
components in the linear colorspace will not be perceived as twice the |
| 96 |
intensity of the color. So each colorspace also defines a transfer |
| 97 |
function that takes a linear color component value and transforms it to |
| 98 |
the non-linear component value, which is a closer match to the |
| 99 |
non-linear performance of both the eye and displays. Linear component |
| 100 |
values are denoted RGB, non-linear are denoted as R'G'B'. In general |
| 101 |
colors used in graphics are all R'G'B', except in openGL which uses |
| 102 |
linear RGB. Special care should be taken when dealing with openGL to |
| 103 |
provide linear RGB colors or to use the built-in openGL support to apply |
| 104 |
the inverse transfer function. |
| 105 |
|
| 106 |
The final piece that defines a colorspace is a function that transforms |
| 107 |
non-linear R'G'B' to non-linear Y'CbCr. This function is determined by |
| 108 |
the so-called luma coefficients. There may be multiple possible Y'CbCr |
| 109 |
encodings allowed for the same colorspace. Many encodings of color |
| 110 |
prefer to use luma (Y') and chroma (CbCr) instead of R'G'B'. Since the |
| 111 |
human eye is more sensitive to differences in luminance than in color |
| 112 |
this encoding allows one to reduce the amount of color information |
| 113 |
compared to the luma data. Note that the luma (Y') is unrelated to the Y |
| 114 |
in the CIE XYZ colorspace. Also note that Y'CbCr is often called YCbCr |
| 115 |
or YUV even though these are strictly speaking wrong. |
| 116 |
|
| 117 |
Sometimes people confuse Y'CbCr as being a colorspace. This is not |
| 118 |
correct, it is just an encoding of an R'G'B' color into luma and chroma |
| 119 |
values. The underlying colorspace that is associated with the R'G'B' |
| 120 |
color is also associated with the Y'CbCr color. |
| 121 |
|
| 122 |
The final step is how the RGB, R'G'B' or Y'CbCr values are quantized. |
| 123 |
The CIE XYZ colorspace where X, Y and Z are in the range [0…1] describes |
| 124 |
all colors that humans can perceive, but the transform to another |
| 125 |
colorspace will produce colors that are outside the [0…1] range. Once |
| 126 |
clamped to the [0…1] range those colors can no longer be reproduced in |
| 127 |
that colorspace. This clamping is what reduces the extent or gamut of |
| 128 |
the colorspace. How the range of [0…1] is translated to integer values |
| 129 |
in the range of [0…255] (or higher, depending on the color depth) is |
| 130 |
called the quantization. This is *not* part of the colorspace |
| 131 |
definition. In practice RGB or R'G'B' values are full range, i.e. they |
| 132 |
use the full [0…255] range. Y'CbCr values on the other hand are limited |
| 133 |
range with Y' using [16…235] and Cb and Cr using [16…240]. |
| 134 |
|
| 135 |
Unfortunately, in some cases limited range RGB is also used where the |
| 136 |
components use the range [16…235]. And full range Y'CbCr also exists |
| 137 |
using the [0…255] range. |
| 138 |
|
| 139 |
In order to correctly interpret a color you need to know the |
| 140 |
quantization range, whether it is R'G'B' or Y'CbCr, the used Y'CbCr |
| 141 |
encoding and the colorspace. From that information you can calculate the |
| 142 |
corresponding CIE XYZ color and map that again to whatever colorspace |
| 143 |
your display device uses. |
| 144 |
|
| 145 |
The colorspace definition itself consists of the three chromaticity |
| 146 |
primaries, the white reference chromaticity, a transfer function and the |
| 147 |
luma coefficients needed to transform R'G'B' to Y'CbCr. While some |
| 148 |
colorspace standards correctly define all four, quite often the |
| 149 |
colorspace standard only defines some, and you have to rely on other |
| 150 |
standards for the missing pieces. The fact that colorspaces are often a |
| 151 |
mix of different standards also led to very confusing naming conventions |
| 152 |
where the name of a standard was used to name a colorspace when in fact |
| 153 |
that standard was part of various other colorspaces as well. |
| 154 |
|
| 155 |
If you want to read more about colors and colorspaces, then the |
| 156 |
following resources are useful: :ref:`poynton` is a good practical |
| 157 |
book for video engineers, :ref:`colimg` has a much broader scope and |
| 158 |
describes many more aspects of color (physics, chemistry, biology, |
| 159 |
etc.). The |
| 160 |
`http://www.brucelindbloom.com <http://www.brucelindbloom.com>`__ |
| 161 |
website is an excellent resource, especially with respect to the |
| 162 |
mathematics behind colorspace conversions. The wikipedia |
| 163 |
`CIE 1931 colorspace <http://en.wikipedia.org/wiki/CIE_1931_color_space#CIE_xy_chromaticity_diagram_and_the_CIE_xyY_color_space>`__ |
| 164 |
article is also very useful. |