advertisement
 
 Print    Email     Bookmark     Share

DxO sheds light on camera sensor performance

By Stephen Shankland

DxO Labs, a French company with deep experience measuring a camera's technical performance, has launched a Web site called DxOMark.com. This features detailed information on the performance of the image sensors at the heart of many higher-end digital cameras.

Many Web sites and magazines measure camera image quality with varying degrees of rigor, typically examining either the JPEG that the camera produces or a processed version of the camera's RAW data. With its DxOMark Sensor measurement, DxO takes a new approach by judging the sensor performance based on the unprocessed RAW image file from higher-end cameras such as dSLRs.

That's significant because RAW images typically must go through a conversion process called demosaicing before they're useful for viewing. Most digital cameras capture only a single color--red, green or blue--for each sensor pixel. Demosaicing fills in the gaps in this colored checkerboard pattern so each pixel gets all three color components, but this processing stage can disguise sensor performance.


Nikon's D90 sensor beats out the one in Canon's 50D, judged on the basis of the raw files it produces. (Credit: DxO Labs)

New tests coming
More measurements are coming, added Nicolas Touchard, vice president of Marketing for DxO Labs' image quality evaluation business. First to arrive, in two or three weeks, will come measurements for medium-format digital camera sensors from companies including Hasselblad, Mamiya, Phase One and Leaf. Then will come more high-end compact "bridge" cameras.

The latter measurement will go beyond most lens tests by showing how well each lens works on each camera rather than one or two reference models. DxO takes that approach because lenses behave differently and different cameras have varying attributes such as the geometry of the microlenses that helps each sensor pixel gather more light, Touchard said.

DxO makes a business out of detailed measurements of camera performance, selling the data to camera and chip companies and incorporating it into its own DxO Optics Pro RAW-processing software for photographers. So why give some of the data away for free on a Web site? One word: Publicity. "It's a marketing program to communicate to the public as well as to the industry our expertise in measuring cameras," Touchard said. The DxOMark Sensor benchmark measures a sensor's color depth (useful for studio photographers), high-ISO performance (useful for photojournalists), and dynamic range (useful for landscape photographers) which is the span between dark and bright. DxO rolls the three parameters up into a composite DxOMark Sensor score, but provides other detailed measurements for each camera as well. (DxO also offers detailed descriptions of the three DxOMark sensor components.)

DxOMark Sensor doesn't measure many camera attributes--durability, autofocus, video and live-view modes, battery life, LCD quality, weatherproofing, user interface--and doesn't pretend it does. Indeed, that's part of the reason for the later benchmarks for image processing and optics that the company envisions.

Intrigue
But even in its limited form, the tests are interesting. For example, the full-frame 12-megapixel sensors in Nikon's top-end D3 and D700 models currently rule the roost, beating out the full-frame sensors in Canon's top-tier 21-megapixel EOS 1Ds Mark III and Sony's high-end 24-megapixel Alpha A900. The D3 has a score of 80.6, the D700 80.5, the 1Ds Mark III 80.3, and the A900 78.9. Those differences are relatively narrow.

More interesting, perhaps, is the difference in performance lower down the line. With a score of 72.6, the sensor in Nikon's new 12-megapixel D90 is head and shoulders over the Canon 50D's 15-megapixel sensor which scored 62.9, even though the D90 is a bit cheaper. Indeed, the D90's sensor scored sixth out of 50 cameras measured.

Sensor results can be compared in two different ways: "Screen", where performance is compared pixel by pixel, and "print", which compares the sensor's full-size images. In the print mode, to compensate for different sensor sizes and resolutions, the DxOMark sensor test normalizes results mathematically to the equivalent of an 8-megapixel image.

Smaller pixels suffer from more noise which shows up as speckles in the image. But having more pixels also improves the amount of information in an image, so high-resolution sensors get an edge in the "print" measurements. For example, the Canon 50D makes up some of the ground for the Nikon D90 when viewed in "print" mode to consider the whole image.

Also worth a look
Also interesting at the site are a couple explanations, one about "the paradoxical evolution of sensor signal-to-noise ratio over time" and another that argues that "". (Dust off your logarithms and statistical analysis for the latter.)

The diversity of camera sensor designs shines through in DxO's measurements. The SuperCCD sensors used in Fujifilm's SLRs, for example, use two sensors for each photo's pixel to increase the dynamic range of the images. That design shines through when it comes to dynamic range: The Fujifilm FinePix S5 Pro spans a range of 13.5 stops compared with 11.5 for the Nikon D200 and 12 for the Nikon D300. However, the Fujifilm camera's sensor pixels are larger, reducing resolution.

And there's still no result for the Sony Alpha A700, which performs some image processing on the sensor before the RAW image is created. "It's not really raw. I'd say it's medium raw," Touchard said.

A final note: DxO provides some fodder for enthusiasts who prefer to shoot RAW images instead of JPEGs. That's because demosaicing algorithms get better over time, so more information can be recovered with newer software.

"For example, over the past two years, DxO Optics Pro RAW conversion (with its noise-reducing algorithm) showed a gain of 4 decibels signal-to-noise ratio, a much larger improvement than that achieved for sensor technology," DxO said (For reference, 4 decibels is about a 1-1/3 stop in exposure.) "These advances in RAW conversion algorithms will continue, underscoring the advantages of shooting in RAW, as RAW images can always be reprocessed with every new release of a RAW converter."

DxO's data is fun to pore through and should be helpful for those considering upgrades or new purchases. Just don't let the technical analysis get in the way of taking pictures.


Tags: Sensor, Image, Sony Corp., Camera, Pixel

 

 

    Talkback
There are currently no comments for this story.
To post comments, you need to become a member. It's FREE.
advertisement