How much color do displays really need? Part 4: Content Delivery

In the previous post in this series, I made the case for displays with hybrid, custom color gamuts as a great way to deliver coverage of Pointer’s gamut as well as the most important broadcast standards. We can build the hardware today to support these large color gamuts so its seems like a great solution but there is a catch: nobody is broadcasting or distributing these large color gamuts today. So, are we going to have to wait for broadcasters and content creators to slowly catchup, much like we did with HDTV?

What content delivery looks like today

Content is captured and viewed in a wide variety of gamuts across a range of different devices but only broadcast in one gamut.

Content is captured and viewed in a wide variety of gamuts across a range of different devices but only broadcast in one gamut.

Today, content creators are actually shooting in a wide variety of color spaces ranging from RAW to rec.709 to Adobe 1998. They are then forced to cram all of these different sources into the lowest common denominator rec.709 standard for broadcast or distribution. That same content is then displayed on devices with a range of different gamut capabilities from tablets that only cover about 70% of rec.709 to HDTVs that do meet the spec to OLED devices that oversaturate the content.

There’s a lot of diversity on both the capture and display sides and a clear bottleneck in the middle in the form of broadcast and distribution channels.

Adhering to broadcast standards is no longer sufficient to guarantee a good experience for consumers because there’s already too much diversity on the display side alone to rely on one standard. You just can’t be sure that consumers are actually looking at your content on a rec.709-capable device. We’re also losing a lot of the value that creators are capturing and could, in many cases, be delivered to end viewers who have the devices to show it.

How do we get around broadcast standards?

What content delivery looks like tomorrow

The first thing to note is that the internet is democratizing broadcast and distribution channels. With the web we can deliver whatever we want, whenever we want. Some players in the industry, notably Sony, are already doing this with 4K content. If there’s no content available and you believe in 4K resolution, you just deliver your own content directly to your customers.

Wide color gamut displays combined with good quality color management and the web as a broadcast platform will allow content to accurately be displayed in the correct color gamut.

Wide color gamut displays combined with good color management and the web as a broadcast platform will allow content to accurately be displayed in the original color gamut.

Still, this leaves us with some potential experience problems. If the right display gamut is not matched to the right content the results will be no different and that’s why color management is key. There are several companies working on color management solutions and certification programs for devices that will make it possible for wide color gamut displays to handle a variety of incoming gamuts. Using metadata, for example, a wide color gamut display can be alerted to the presence of Adobe RGB content and then remap that content on the fly to assure that it is displayed accurately on that specific panel.

With great color management, we can maximize the gamut on the display side and pull through the best possible gamut for the device we are looking at. In this way, we can deliver always accurate content that meets the designers intent, wether artistic or commercial.

How much color gamut do displays really need? Part 3: Existing color gamut standards

Last week I looked at the three “P’s” of human color perception– physical, physiological and psychological– as a way to help define a color gamut for the ideal display. Based on real world examples from art and commerce, I concluded that the range of colors found in nature, as measured by Pointer, provided the best fit with our two design goals which were an accurate and exciting, immersive experience.

This week, I’d like to get a little more practical and take a look at existing color gamut standards to see what we might realistically be able to achieve today.

What fits best?

Color gamut of 4,000 surface colors found in nature as measured by Pointer in 1980 against the color gamut of the iPhone 5.

Color gamut of 4,000 surface colors found in nature as measured by Pointer in 1980 against the color gamut of the iPhone 5.

The first thing you’ll notice about Pointer’s gamut (pictured above again) is that it’s a pretty odd, squiggly shape. This means it is going to be difficult to cover efficiently with a three primary system that mixes just red, green and blue to create all the colors we see, like the LCD found in the iPhone. In order to cover Pointer’s with just those three colors, we’d need to make them extremely saturated. There are proposed standards that take this  approach, such as rec.2020, but since they are not practical to implement today from a technology standpoint I’ve decided to ignore them for this discussion.

For the near future, we’ll need to rely on just three colors to get the job done, so what can we do now? Let’s look at two popular wide color gamut standards: Adobe 1998 and DCI-P3:

Current wide color gamut standards Adobe RGB 1998, commonly used by pro photographers and designers, and DCI-P3, used in digital cinema, compared to Pointer's gamut in CIE 1976

Current wide color gamut standards Adobe RGB 1998, commonly used by pro photographers and designers, and DCI-P3, used in digital cinema, compared to Pointer’s gamut in CIE 1976

Let’s start with Adobe 1998. Many people are familiar with this color gamut since it is found as an option on many consumer cameras and it is popular among creative professionals. It certainly covers a significantly wider range of colors than the HDTV broadcast standard with a very deep green point. The rich cyans that we talked about in the movie “The Ring” would look great in Adobe 1998. But, we’re not getting any more of those exciting reds and oranges. In fact, Adobe’s red point is identical to the HDTV broadcast standard.

What about DCI-P3 then? Designed to match the color gamut of color film and used in cinemas all over the world, DCI-P3 has a very wide gamut. The reds are particularly deep and, of course, all of the colors from the movies we looked at are covered. Still, it’s missing a lot of the deep greens found in Adobe 1998 and only just fits the green Pantone color of the year. So DCI-P3 is not quite perfect either.

What about a hybrid, custom gamut? 

What if we combined the green from Adobe with the red from DCI-P3 and their shared blue point? We’d end up with pretty good, high 90’s percentage coverage of Pointer’s gamut, coverage of all of the existing HDTV broadcast content, full coverage of cinema content from Hollywood and a superior ecommerce experience with most of the colors from the natural world covered.

Hybrid color gamut standard that combines the green point from Adobe 1998 with the deep red of DCI-P3

Hybrid color gamut standard that combines the green point from Adobe 1998 with the deep red of DCI-P3

Looks pretty great and we can make displays now that cover this color gamut with today’s technology. But how would it work on the content side? Would we need to get together and agree on this new standard and then wait for years while it is slowly adopted by content creators and display makers?

Next week

Next week we’ll look at how content delivery might evolve to support gamuts like this without the need for major changes to broadcast standards.

DisplayWeek 2013: Color is back

Just back from a great DisplayWeek in Vancouver. Finally had a chance to recover, go through my notes and process everything I saw at the show. Most of the big story lines will be pretty familiar to anyone who followed last years show: TV’s are still getting bigger, OLED TV is still right around the corner, 4K is starting to ship and mobile displays are getting both sharper and more efficient.

DisplayWeek wasn’t all old news though. In fact, just like CES, this year everyone seemed to be talking about color performance. At the annual Display Industry Awards, honors in several categories went to wide gamut display technologies including the Best In Show and Component of the Year awards. And, on the show floor, major manufacturers like 3M, Samsung and LG dedicated significant booth space to wide color gamut or color management technologies.

3M's Quantum Dot Enhancement Film demo at DisplayWeek 2013. Bottom display is using quantum dots to achieve a wide color gamut.

3M’s Quantum Dot Enhancement Film (QDEF) demo at DisplayWeek 2013. Bottom display is using quantum dots to achieve a wider color gamut than OLED at higher brightness and lower cost.

3M demoed several wide color gamut LCDs  based on the Quantum Dot Enhancement Film (QDEF) technology that they are partnering with Nanosys to manufacture. Ranging from smartphone all the way up to 55″ TVs in size, these devices were all showing a wider color gamut than OLED with an especially deep red. This seems like a lot of color but 3M says that in developing their Perceptual Quality Metric (PQM), a new analysis tool aimed at helping display makers model how different performance characteristics will affect end user experience, they found that color saturation positively affected the perception of quality.

In Samsung’s neighboring booth, I found a series of comparison demos designed to show that wide color gamut displays can be both accurate and pleasing to the eye. Each demo featured a camera feeding a live image of several colored objects to both standard and wide color gamut displays. In each case the wide gamut display was able to more accurately recreate the color of the objects in front of the camera. They also showed off the new color management capability of their flagship Galaxy S4 smartphone that allows the device to accurately display rec.709 content without oversaturation- something the previous generation S3 struggled with.

Samsung demonstrating the value of wide gamut displays by showing some common colors that fall outside the rec.709 broadcast gamut standard in a series of demos at DisplayWeek 2013

Samsung demonstrating the value of wide gamut displays by showing some common colors that fall outside the rec.709 broadcast gamut standard in a series of demos at DisplayWeek 2013

Finally, at LG’s booth, we saw a new LCD color filter design that allows them to cover the Adobe RGB color gamut used by photographers and print professionals.

With all of this buzz, it looks like we’ll start to see wide color gamut displays start to move into the mainstream in ever larger screen sizes over the next half of this year and into 2014.

ITU agrees on HEVC h.265 codec

h-265-logo,Q-D-349573-3The ITU announced today that it’s members have agreed upon a new high efficiency video codec. Dubbed HEVC H.265, the new format is designed to improve on and ultimately replace the current king of all codecs, H.264/MPEG-4 AVC which covers 80% of internet video today.

So far, a lot of attention has been given to the codec’s ability to deliver the same quality video as 264 with only half the bandwidth. That kind of efficiency improvement is a big deal– it could reduce strain on networks and bring high-resolution 4K content delivery over the internet closer to reality.

h265 vs h264 quality comparisonThere are also some important changes for color in the new spec. Recent drafts by the ITU’s Joint Collaborative Team on Video Coding (JCT-VC) have added support for wider color gamuts like Adobe RGB 1998 and 12-bit video. This paves the way for fantastic looking color as wide gamut-capable hardware starts to become more widely available.

Color of the year for 2013 falls outside sRGB gamut

Pantone Emerald 17-5641

Pantone recently announced their color of the year for 2013, a deep shade of emerald green that they call “Emerald 17-5641.” It’s a great color but there’s a catch- most displays cannot accurately show it.

Based on data from Pantone’s website, I was able to plot the color in CIE 1931 (xy). As you can see in the chart below, Pantone’s color is well outside the sRGB/rec.709 color gamut standard used by most HDTVs, the new iPad/iPhone and many desktop monitors. These devices will be stuck showing a version of Pantone’s emerald green that’s less saturated and probably a bit more yellow than the real thing.

Pantone Emerald 17-5641 vs sRGB, Adobe RGB 1998 and DCI-P3 color gamuts in CIE 1931

This is a perfect example of a popular real-world color that falls outside of the sRGB/rec.709 gamut. Unless you have a monitor that’s able to show wider color gamuts, like the DCI-P3 or Adobe RGB standards, you are missing out on a great color.

The case for wide-gamut in your photography workflow, even if you are exporting to sRGB

This is a great, exhaustive tutorial on managing color gamut for photographers by color expert Andrew Rodney. He does a great job making the case for working in wide gamut color spaces like Pro Photo, especially when capturing in RAW. Using smaller gamuts like sRGB throws away useful color data that printers and more and more displays can recreate.

Color Space Confusion

For many who are new to the world of display measurement, the prevalence of two distinct, but often-interchanged color spaces can be a source of confusion. Since my recent post about the color performance of Apple’s new iPad, a number of people have asked about this topic, so I thought it would be worth a closer look.

In the world of displays and color images, there exists a variety of separate standards for mapping color, CIE 1931 and CIE 1976 being the most popular among them. Despite its age, CIE 1931, named for the year of its adoption, remains a well-worn and familiar shorthand throughout the display industry. As a marketer of high color gamut display components, I can tell you from firsthand experience that CIE 1931 is the primary language of our customers. When a customer tells me that their current display “can do 72% of NTSC,” they implicitly mean 72% of NTSC 1953 color gamut as mapped against CIE 1931.

However, from the SID International Committee for Display Metrology’s (ICDM) recent, authoritative Display Measurement Standard:

“…we strongly encourage people to abandon the use of the 1931 CIE color diagram for determining the color gamut… The 1976 CIE (u’,v’) color diagram should be used instead. Unfortunately, many continue to use the (x,y) chromaticity values and the 1931 diagram for gamut areas.”

So why are there two standards, and why are we trying to declare one of them obsolete? Let me explain.

What is a color space?

First, a little background on color spaces and how they work.

While there are a number of different types of color spaces, we are specifically interested in chromaticity diagrams, which only measure color quality, independent of other factors like luminance. A color space is a uniform representation of visible light. It maps the all of the colors visible to the human eye onto an x-y grid and assigns them measureable values. This allows us to make uniform measurements and comparisons between colors, and offers certainty that images look the same from display to display when used to create color gamut standards.

In 1931, the Commission internationale de l’éclairage or CIE (International Commission on Illumination in English) defined the most commonly used color space. Here’s a look at the anatomy of the CIE 1931 color space:

What makes a good color space?

An effective color space should map with reasonable accuracy and consistancy to the human perception of color. Content creators want to be sure that the color they see on their display is the same color you see on your display.

This is where the CIE 1931 standard falls apart. Based on the work of David MacAdam in the 1940’s, we learn that the variance in percieved color, when mapped in the CIE 1931 color space, is not linear from color to color. In other words, if you show a group of people the same green, then map what they see against the CIE 1931 color space, they will report seeing a wide decprepancy of different hues of green. However, if you show the same group a blue image, there will be much more agreement on what color blue they are seeing.  This uneveness creates problems when trying to make uniform measurements with CIE 1931.

The result of MacAdam’s work is visualized by the MacAdam Elipses.  Each elipse represents the range of colors respondents reported seeing when shown a single color, which was the dot in the center of each elipse:

A better standard

It was not until 1976 that the CIE was able to settle on a significantly more linear color space. If we reproduce MacAdam’s work using the new standard, variations in percieve color are minimalized and the MacAdam’s Elipses mapped on a 1976 CIE diagram appear much more evenly sized and circular, as opposed to oblong. This makes color comparisons using CIE 1976 significantly more meaningful.

The difference of the CIE 1976 color space, particularly in blue and green, is immediately apparent. As an example, lets look at the color gamut measurements of the iPad 2 and new iPad we used in an earlier article. Both charts do a reasonably good job of conveying the new iPad’s increased gamut coverage at all three primaries. But, the 1976 chart captures the dramatic perceptual difference in blue (from aqua to deep blue) that you actually see when looking at the displays side by side:

The increased gamut of the new iPad is worth testing. Next time you find yourself in an Apple store, grab an iPad 2, hold it alongside a new iPad, Google up a color bar image and see the difference for yourself.

So, why do we still use CIE 1931 at all?  The only real answer is that old habits die hard.  The industry has relied on CIE 1931 since its inception, and change is coming slowly.

Fortunately, CIE 1931’s grip is loosening over time. The ICDM’s new measurement standard should eventually force all remaining stragglers to switch over to the more accurate 1976 standard. Until then, you can familiarize yourself with a decent color space conversion calculator, such as the handy converter we built just for this purpose:

Apple’s new iPad display; what does 44% more color get you?

Last Friday Apple released an updated version of one of their hottest products, called simply “the new iPad.” Central to the update is a brand new display featuring significantly more resolution and color saturation. Since the resolution bit has been covered to death by others and we’re interested in color here we thought we’d take a closer look at Apple’s color saturation claims.

Our new iPad arrived on Friday and since then we’ve submitted it to several tests using our Photo Research PR 655 Spectroradiometer.

Using the new iPad, particularly next to an “iPad 2,” the reds and greens are noticeably better, but the blues in particular are quite striking. It actually makes the blue on the iPad 2 seem more ‘aqua’ than pure blue. The color data bears this out.  According to our measurements, Apple has significantly increased the saturation in all three primaries, most notably in blue:

The key color claim that Apple made on stage at the iPad announcement was that the new iPad has 44% more color saturation.  What they mean by that of course depends on the context.  There are a couple of different color measurement standards that Apple could be gauging the performance of the new iPad against such as CIE 1931 or CIE 1976.

An easy way to think about these standards is a bit like the temperature measures that we are all familiar with, Celsius and Fahrenheit, in that they are different ways communicating the same information. Saying, “it’s 5 degrees warmer today” means something very different to users of each system and its much the same way with color spaces, only we’re talking about measuring how the eye perceives color, not how warm it is outside.

We should also note that when people in the display industry talk about color saturation as a percentage, it is common practice to refer to a color gamut standard within a CIE color space. There are many color gamut standards in use today including: NTSC, sRGB, Adobe RGB 1998, DCI-P3, and rec 709. Each of these standards is a subset of a CIE color space. They are typically used by content creators to ensure the compatibility of their work from device to device. For example, if I create an image in Adobe RGB, I would like to display it on a screen that can show all of the colors in Adobe RGB in order to make sure it accurately reproduces all the colors in my original shot.

Based on our measurements it looks like Apple is referring to the NTSC gamut within a color space. But which color space do they mean?

A 44% improvement within the CIE 1931 color space would give the new iPad the equivalent of the sRGB standard used by HDTV broadcasts, Blu-Ray and much of the web. Given the significance of achieving that standard, some thought Apple must have been trying to say “sRGB” without confusing consumers by describing the meaning of various color standards.

According to our data, this is not the case. The new iPad only manages about 26% more saturation over the iPad 2 when measured against the CIE 1931 NTSC color space. However, the unit we measured showed a 48% increase in saturation when measured in the CIE 1976 color space, so that must be Apples frame of reference.

Measurements and standards aside, the new display looks great. The improvement in color performance will greatly enhance the user experience, and as we discussed yesterday, show’s what Apple is betting on for the functionality of future devices.

In our next post we will explain exactly how Apple achieved this improved color performance and look at ways they can improve the next generation.