Take a look at this photo I shot at Yosemite National Park last summer.  Click on this image to zoom in, or use your mouse wheel or the + and – buttons.  Pan by simply dragging the image with your mouse.  Click the home button to restore the view or click the right-most button to expand the image to the full browser window. Can you find the two climbers approaching the summit of El Capitan?

It’s really easy to create your own zoomable photos.  It’s free and it doesn’t require you to sign up for anything.  All you need is the URL to your web image.  (The photo above comes from my Flickr stream.)  Paste the URL at seadragon.com and click one button.  Depending on the resolution of your image, it may take a moment or two to create the zoomable version.  You can then copy the link to the zoomable viewer page for your image on seadragon.com and share it on Twitter, your Facebook status, or anywhere else you choose.  Or, you can do what I did for the photo above and copy a one-line script that lets you embed the zoomable viewer on your own web page, blog posting, eBay advertisement, or other web destination.  

The Seadragon viewer isn’t your average zoomable viewer; it includes some cool new technology that delivers stunning performance but still makes it accessible to virtually everyone.  If you have Silverlight installed (and if you don’t, you should), the viewer uses Silverlight Deep Zoom to deliver a buttery-smooth full screen zooming experience.  But even if you don’t have Silverlight, the viewer will still operate using our Seadragon Ajax technology.  The appearance and features are identical, but the performance will be a bit slower than with Silverlight Deep Zoom.  This new dual-mode viewer makes sharing high quality, full resolution images easier than ever, without turning away any of your potential audience.

Now you can easily share your full resolution digital photos and provide a seamless, easy-to-use and flexible viewing experience for everyone.  Rather than just showing a static low resolution preview, that same preview can magically transform into the full resolution image.  And all of this happens without the pain of waiting for long downloads and slow Internet response time.  You can dramatically improve the way you share your individual photos on the web.

For more information, including some behind the scenes details, read the blog post at www.livelabs.com as well as this blog post from inside the Seadragon team.  Or just visit www.seadragon.com and try it out for yourself!

As I’ve discussed in previous blog posts here, JPEG XR is the standardized incarnation of HD Photo, an innovative new format for digital photos developed at Microsoft, and first shipped in  Windows Vista.  There are a few minor differences between HD Photo and JPEG XR; these changes were the result of some excellent work by the JPEG Committee that helped insure the highest possible quality for the approved standard.

JPEG XR offers some dramatic benefits when compared to the original JPEG file format that we all know and love:

• Better compression – JPEG XR offers improved efficiency compared to JPEG, and the type of compression artifacts are often less objectionable than the typical JPEG compression artifacts.  JPEG XR offers a very wide range of compression levels, including perceptively lossless or mathematically lossless compression.  Regardless of your requirements, JPEG XR probably offers a compression option that’s ideal for that scenario.
  
• More image formats – JPEG XR supports 8bpc (bits per channel), 16bpc and 32bpc, as well as several special bit depth formats.  Pixel values can be stored as either integers, scaled fixed point numbers or full floating point values; this provides full support for numerous high dynamic range (HDR) imaging scenarios, as well as support for wide gamut color spaces.  In addition to 3-channel RGB, JPEG XR supports monochrome, CMYK and n-channel formats up to 16 independent channels.  many of these formats also support an alpha channel.   This wide range of image formats allows for dramatically better image quality and allows this single new file format to effectively replace many previous formats that were required for specific scenarios.
  
• Advanced decoding features – JPEG XR provides progressive decoding, allowing lower resolution previews or specific cropped areas to be displayed without the need to decode the entire image.  Additionally, JPEG XR images can be cropped, rotated, flipped and resized (within certain constraints) without ever needing to decode and then re-encode the image.  That means these operations are much, much faster and no additional image quality is lost due to the additional encoding steps.

The many innovations delivered in JPEG XR originated from over ten years of research and development at Microsoft.  And through our participation as a member of the JPEG Committee, we’ve been able to deliver additional improvements and create an International standard available to everyone.

So the next question everyone asks is “when will it be available in a camera?”  Since I don’t work for a camera company, I can’t answer that question.  But I’m pleased and proud that because JPEG XR is now a free International standard, there’s very little standing in the way of making that happen!

(Updated 7/30/09 to correct the IEC logo.)

The JPEG XR Technical Spec Work is Done

The headline for this blog post is the headline of the press release from the most recent meeting of the Joint Photographic Expert’s Group (JPEG) Committee.  The JPEG XR standard has advanced to Draft International standard balloting.  Basically, that means the specification is frozen for implementers; there will not be any more technical changes.  The press release goes on to say that International Standardization is expected to be completed this year.  Woohoo!

Here’s the excerpt from the press release discussing JPEG XR:

JPEG XR is a new compression format supporting high dynamic range and promises to bring a new level of successful user experience to users of digital cameras. JPEG XR advanced to draft international standard balloting at the San Francisco meeting, entering the final phases of standardization and freezing the specification for implementers. The committee expects the JPEG XR International Standard (IS) to be published later this year. The JPEG committee is hosting a meeting to provide a special preview of the standard and discuss possible approaches to raw file compression. JPEG XR offers the potential to give cost and compression benefits to users producing high-quality, high dynamic-range images.

The complete press release from the meeting is here:  https://jpeg.org/newsrel24.html

This is really exciting news!  As most followers of this blog know, JPEG XR is based directly on HD Photo, the new photography file format that Microsoft introduced with the launch of Windows Vista.  JPEG XR offers some great benefits for photographers compared to JPEG, or other file formats.  It’s great to see this technology is now being embraced as an International standard.  I expect this will dramatically accelerate its adoption in cameras and digital photography software and services.

On a Personal Note… The Return of Bill’s Blog

This blog is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.

HD Photo plug-ins for Adobe® Photoshop® CS2 and CS3 have been officially released for both Windows and OSX.  They're available now from the Microsoft Download Center. 

Here are the separate downloads for Windows and OSX.

The Windows version is supported on Windows XP and Windows Vista, and works with Photoshop CS2 and CS3.  While not officially supported, it will also work with limited features with older versions of Photoshop and with Photoshop Elements.  The included README file has details.

The OSX version works with both 10.4 (Tiger) and 10.5 (Leopard), and supports Photoshop CS2 and CS3. 

The features supported on Windows and OSX are identical.  The files created with either version are fully compatible with each other and with Windows Vista, Windows Live Photo Gallery, the HD Photo Device Porting Kit, and several other applications that support HD Photo.

I previously posted information about the features provided in the plug-in and an overview of the encoder parameters and what they do.  Take a look at previous blog entries here and here.  I also gave a presentation at WinHEC 2007 about HD Photo Best Practices.  While targeted primarily for hardware developers, the presentation contains a lot of information that may be useful for Photoshop users that want to best optimize their encoder parameters.  You can find a copy of the presentation here:  WinHEC 2007: HD Photo Implementation Guidelines.

If you've been using the beta version released last summer, you won't find anything new here (other than the removal of the expiration date and the absence of BETA in the name.)  All the changes we've made since the last beta are under the covers, fixing a couple minor bugs, addressing several theoretical security vulnerabilities and generally bringing the code up to current Microsoft standards for released software.  But on the surface, the released plug-ins look and act identical to the most recent betas.  Don't forget that the BETA versions will expire on December 31st, so you should definitely download and install these new released versions.

Once again, I'd like to acknowledge and thank Pegasus Imaging Systems for their participation in the development of these plug-ins.

What is Red?

This sounds like a simple question, but it's actually very hard to answer accurately within today's digital photography ecosystem.  In most cases, we use a standardized definition (typically the sRGB color profile) and rely on all the components of the ecosystem to understand this standard and act accordingly.  By doing so, we accept some significant limitations, because sRGB was designed to be a "least common denominator, specifying a subset of the total visible color spectrum that could reasonably be managed by all components in an ecosystem.  The diagram shows the sRGB color space in reference to the entire visible color spectrum.  More specifically, sRGB was defined to specify colors based on how CRT monitors work, maximizing the probability that images distributed across multiple systems would still appear with the correct colors without a lot of special software or circuitry to adjust colors for proper appearance on standard computer displays.

sRGB is an "output referred" color space, designed to match the color performance and gamma of a CRT monitor under typical home or office viewing conditions.  Since it's impractical to expect the vast majority of users to measure the actual color profile of their computer monitor, sRGB provided a normalized reference standard.  Monitor makers build monitors that will ideally match the sRGB standard, and image devices and applications encode images based on the sRGB color profile to help insure that colors will appear correctly.

So, for the vast majority of computer users, the sRGB color profile defines "what is red?" along with the other primary colors (blue and green) and the color temperature of white (6500K).  This is the color space that is the standard in all JPEG files, and the default color space for most other image file formats.  Because the sRGB color space is based on the capabilities of an output device (a computer screen), it's an output referred color space.

(sRGB gamut diagram courtesy of Wikipedia.)

SIDE NOTE:  What's a little ironic is that today, most computer displays are LCD's, not CRT monitors.  LCD's have a very different color characteristic and gamma than CRT's.  However, every LCD display includes circuitry to accept an input signal (either digital or analog) as if it was a CRT monitor, and convert that sRGB content to the monitors own specific output referred color space.  It's a huge disadvantage to use sRGB as the intermediate color space, but since this is still the universal standard, LCD display manufacturers have little choice.

A Camera Sensor's View of Red

When a typical digital camera captures an image, some of the light that falls on the sensor goes through a red filter and hits a photo sensor cell designed to measure the luminance of this red wavelength light.  (There are separate color filters for blue and green.)  So, every camera sensor has it's own definition of red based on the specific characteristics of the sensor and color filter. 

(Bayer pattern sensor diagram courtesy of Wikipedia.)

SIDE NOTE: The X3 sensor technology from Foveon handles this in a very different way, but we'll save that discussion for another day.  Though the capture method is different, the fundamental color space principals are the same.

The camera's definition of red is based on it's own specific color profile, and is referred to as an "input referred" (or sometimes "camera referred") color space.  The numerical value that represents red in this color space is based on how the camera sensor works, not on how we ultimately want to view the color red.  In fact, the camera's "input referred" color space is independent of specific lighting conditions; these conditions must be taken into account as part of the processing of the input referred image information to accurately reproduce colors. 

Imagine that you take multiple pictures of the same shiny red apple under different lighting conditions -- florescent, incandescent, etc...

Ok, let's not image it; let's try it out.  I rummaged around in my refrigerator and found an aging apple.  So, while it's not the most photogenic piece of fruit, it will serve to demonstrate what we're talking about.  Here's an example of two different versions of "red" based on photos taken under different lighting conditions:

Because of these different light sources, the camera will measure different values for the red color of the apple.  However, as far as we're concerned, the apple is always the same red color, regardless of the lighting conditions.  So, the input referred color information from the camera sensor must be converted  based on the lighting conditions to the output referred color space that will be used to view the different photos of the apple on a computer display.

Fortunately, cameras do this for us; we typically refer to this process as white balance.  In most cases, it's automatic; the camera finds something in the scene it believes to be white and adjusts the various color channels accordingly.  Or the photographer may choose to manually select the white balance setting, either based on a pre-defined reference value or by manually measuring a white reference.  Regardless of the process, this is one of the essential steps to convert images from the input referred color space of the camera sensor to the output referred sRGB color space that is the standard for JPEG files.

Many digital cameras (including virtually all DSLR's and many advanced point-and-shoot cameras) provide an option to save images in a RAW file format.  This RAW format contains the actual measured sensor data in the format as captured by the sensor, and is therefore an input referred representation of the image content.  Since the definition of colors in a camera's input referred color space is based on the specific characteristics of the camera's sensor system, RAW files are always unique to a specific make and model of camera.  By capturing and preserving the RAW sensor data, a photographer can prevent the camera from discarding information from the camera's input referred color space when it is converted to the output referred sRGB color space of a JPEG file.  The photographer is reserving the right to make their own decisions on what information to discard by manually processing the RAW image file to produce the desired output referred image to view or print.

Something Between Input and Output

With everything we've discussed so far, we still haven't done a very good job of answering the (presumably) simple question we started with: what is red?

The typical digital camera shooting JPEG photos relies on two different definitions.  The camera's input referred color space provides a definition of red based on the characteristics of the camera's sensor.  The camera uses white balance information to convert this to sRGB, an output referred color space based on the typical characteristics of a CRT monitor. 

Using an input referred color space will result in different color values to represent the red apple based on the device and the lighting.  Using an output referred color space will result in different color values to represent the red apple based on the specific output device (for example, a display vs. a printer.)  But what we really want is a numerical value that is specific to the color of the red apple, regardless of the input or output conditions!

The solution lies in the use of an intermediate color space that is not defined based on specific input or output devices.  A "scene referred" color space defines colors in a meaningful way to us, based on standard reference of the actual colors contained in an image.  A scene referred color space typically has a very wide color gamut, since it's purpose is to accurately describe the full palette of colors that could appear within the scene, regardless of what device was used to capture the image, or how the image will ultimately be rendered.  A scene referred color space provides the best and most accurate definition of "what is red?".

In most cases (unless we take explicit steps to do otherwise with tools that enable this capability) we simply use the output referred sRGB color space as this intermediate color space for manipulating the image.  While this makes things very simple (avoiding the need to then convert to an output referred color space for display to the screen or sharing the photo), it forces us to accept the limited color gamut of sRGB. 

Adobe® Photoshop® refers to this intermediate scene-referred color space as the "working space".  By default, most Photoshop users have the working space set to sRGB, again for simplicity.  However, Photoshop offers several different color profiles specifically designed to be a better working space than sRGB. 

"Adobe RGB" is a working space that provides a slightly wider gamut than sRGB, with more color spectrum that is appropriate for printers.  (Remember, sRGB is defined based on the characteristics of display monitors.)  But Adobe RGB still limits the color gamut so it can be effectively used with 8bpc images.  If the gamut is defined too large, then with 8bpc values, the steps between each of the 256 unique color values become apparent, creating unwanted image artifacts.

By using 16bpc unsigned integers, a larger color gamut for the scene referred color space is possible.  Adobe Photoshop provides the "Adobe Pro Photo RGB" color profile specifically for this purpose.  It provides a much better working space for editing digital photos, but requires the user to manually convert to sRGB to create a final JPEG output file.

The latest trend for serious digital photographers are RAW workflow image processing applications, including Adobe® Lightroom® or Apple® Aperture™.  With these applications, the photographer works directly with the RAW file until the final image is rendered for display or printing.  In actuality, it's impossible to work directly with the RAW file for image processing because its not even an image yet.  It must first be de-mosaiced from the source Bayer pattern format and transformed from the unique input referred color space for the particular camera.  Otherwise, the same color editing operation would produce different results based on the camera used.  These applications have their own internal wide gamut scene referred intermediate working color space where all image processing operations are performed.  The process of converting from the RAW image to this intermediate scene referred color space is performed automatically every time a RAW file is accessed, with no need for the user to be involved, or even know that it's happening.

Go Ahead, Let Yourself Float

With Windows Vista (and HD Photo), Microsoft has introduced comprehensive support for the scRGB scene referred color profile.  Unlike other color profiles that rely on unsigned integers to represent the color values, scRGB uses floating point numerical values.  (scRGB can also used fixed point representation, which is simply a method of using signed integer numbers to represent fractional values.)  The idea behind scRGB is not to redefine the color space, but to simply remove it's boundary limitations.

A color space is defined by the specific color values of it's primary colors (red, green and blue for the color spaces we're discussing) and the color temperature that defines white.  As we've discussed, the vast majority of digital images use the sRGB color space as a universal reference that maximizes color compatibility across applications, platforms and devices, but in doing so, defines rather harsh limits.

scRGB uses the same color primaries and white point as sRGB, but uses fixed point or floating point numbers to allow color values that are beyond the gamut limits defined by these primaries.  This provides a color space that is fully compatible with the well-established sRGB standard, but removes restrictions imposed by using unsigned integer numerical values.  Conversion between sRGB and scRGB is simply a matter of changing numerical formats; no complex color value transformations are required.  scRGB offers all the ease and simplicity of sRGB, but removes it's limitations.  This makes it the ideal intermediate scene referred working space for digital photography.  A (virtually) unlimited color gamut and dynamic range is available to preserve all image content, but the same file can be treated as if it's a standard sRGB image for display and sharing using a simple numerical conversion to unsigned integer values. 

Don't Forget the Gamma

Another aspect of the definition of a color profile is the gamma.  This specifies the linearity (or more specifically, the non-linearity) of the transform from input luminance levels to output numerical values.  it's an important component when using only 8bpc to represent color values, but it also represents another compromise based on technical limitations.

Let's suppose that you take a photo of a white object and carefully set you exposure so the resulting 8bpc sRGB image file has a value of 255 in all channels to represent this white color.  Then you changed your lighting (or your camera exposure controls) to take another photo that was 1/2 the brightness of the original white reference photo.  You might expect that the resulting 8bpc sRGB image file would show a value of around 128 in all channels for this 1/2 brightness gray image.  You would be wrong.

Most color profiles employ a non-linear gamma curve to the luminance levels of all channels to redistribute the 256 unique values to produce better visual results.  In the case of sRGB, this also mimics how a CRT monitor works.

For sRGB, the 1/2 brightness gray image will result in a numerical value of around 186, not the midpoint value of 128.  This is based on an sRGB gamma of approximately 2.2.  (The actual gamma calculation for the sRGB color profile is a little more complex, but we can use a value of 2.2 for an approximation for our purposes.)  This means that the sRGB profile uses 186 steps to represent the lower half of the luminance spectrum, and only 69 steps (255-186) to represent the upper half of the luminance spectrum.  sRGB defines a non-linear luminance curve to provide more detailed information in the darker or shadow areas at the expense of the brighter or highlight areas.  Since we're far more likely to see visual differences between each of the 255 total luminance steps, this non-linear representations significantly reduces the chance of seeing those artifacts.

While this is great for efficiently using only 8bpc to represent color values, it distorts the numerical representation of color and impacts the proper calculation of color values for image processing.  For example, if an application tries to combine two 1/2 luminance images to create a full luminance image, adding the two sRGB values together will result in a total that is much greater than the correct full luminance value.  Likewise, simply dividing an sRGB luminance value by two will produce a result that is much darker than the correct 1/2 luminance image level.

Many imaging applications simply ignore this problem and provide the appropriate user interface controls to allow the user to visually manipulate the image independent of the numerical values.  (Move a slider until you see the brightness level you want.)  In other cases, applications "do the right thing" by first converting non-linear color profile content to linear values (using higher precision numerical formats) to perform image processing mathematics, then convert the result back to the desired non-linear color profile.

The scRGB color profile is designed to always be used with higher precision (typically 16bpc or 32bpc) fixed or floating point numerical formats, and therefore it's not necessary to use a gamma correction to compensate for the limitations of 8bpc formats.  The scRGB color profile has a gamma of 1.0, meaning that there is a linear relationship between scene illumination the encoded numerical value.  Going back to our example, The numerical value for the gray image that was 1/2 the exposure level of the reference white image would result in a numerical scRGB color space value that was 1/2 the value for the reference white level.

Camera sensors are linear response devices.  LCD displays are linear response devices.  The correct method for performing image processing mathematics is to use a linear representation.  It makes far more sense to store image information using a linear luminance values rather than distorting them with a gamma curve designed to compensate for the limitations of a particular numerical format or device.  By not restricting ourselves to the limitations of an 8bpc format, we can dramatically simplify and improve end-to-end photo manipulation and processing.

Big Changes Takes Time

The scRGB color space and HDR/WG image formats will dramatically change the way most digital imaging is performed.  The vast majority of imaging software, devices and services are currently based on the use of unsigned integer, gamma adjusted, sRGB image formats.  It's going to take some time for all these components in the digital photography ecosystem to migrate to this improved methodology.

Adobe Photoshop CS3 (and CS2) are the current leaders in this space.  These newer versions of Photoshop support 32bpc mode, using floating point values and what Adobe calls the "Linear RGB" color profile.  This is the equivalent of scRGB, and using Photoshop CS3 (or CS2), it's possible to create, edit and save HDR/WG scRGB compatible images.  With the HD Photo plug-in for Adobe Photoshop, you can use HD Photo to efficiently store these HDR/WG images in a variety of fixed or floating point numerical formats.

But we still have a long way to go.  There are still lots of issues and limitations in using HDR/WG image formats.

• Photoshop CS3 only offers a subset of image adjustments and filters when using 32-bit mode.  Many Photoshop functions have not been enhanced to handle HDR/WG content.

• Photoshop CS3 doesn't allow color profile conversion in 32-bit mode, making it very problematic to move between other scene referred color profiles (such as Pro Photo RGB) and scRGB.

• There are no RAW conversion applications or utilities (including the Adobe Camera RAW module in Photoshop CS3) that allow input referred RAW files to be converted directly to a scene referred scRGB (or Linear RGB) color space.

• Adobe Photoshop allows 32bpc floating point content to be stored in a TIFF file, but few other applications can understand floating point TIFF files.  The Macintosh OS X operating system has support for HDR/WG color spaces as part of Core Image, and even provides support for 32bpc floating point TIFF files.  However Core Image interprets these files differently; it assumes the use of the sRGB color profile and that the floating point HDR/WG image data is gamma adjusted.  Photoshop stores these TIFF files in an scRGB compatible linear gamma format.  The result is that the image looks dramatically different when opened in Photoshop vs. the Mac OS X viewer.

• Most other photo and imaging applications have no support at all for HDR/WG pixel formats and expect all images are stored using unsigned integer values.  Many applications further assume that the precision is always limited to 8bpc and that the color space is always sRGB.  While there are applications adding support for HD Photo, in many cases, they only support limited pixel formats and have no support for HDR/WG content or image processing capabilities.

That said, we have to start somewhere and I'm very pleased to see the progress that's been made so far.  There are enough pieces in place that you can work with these formats today, albeit with some caveats and limitations.  I'm really excited about the progress being made to create the new JPEG XR standard, based on HD Photo.  When this standard is finalized it will go a long way to "legitimize" HDR/WG image formats and the associated application support, and will provide the needed reference to motivate the development of compatible software, devices, services and platforms that take full advantage of the powerful capabilities provided by HDR/WG image formats and the scRGB color space.

HD Photo and the new imaging infrastructure in Windows Vista represent the leading edge of this next generation of digital photography.  In the near future, it will be a whole lot easier to more accurately answer the simple question "what is red?".  It's going to be very cool to watch all of this develop in the months ahead.  Get ready for some exciting changes!

There is an updated beta for Windows Vista and Windows XP, plus a new beta for both Intel and PPC Macs running OS X.

In addition to the direct links above, you can always find the various HD Photo downloads by going to the Microsoft Download Center at https://www.microsoft.com/downloads and searching for "HD Photo".

What's New?

Based on a lot of really good customer feedback, we've redesigned the encoder options dialog box, separating the basic and advanced controls in two separate modes.  This is more consistent with similar dialogs in Photoshop, allows the dialog to be  smaller, and makes it a less confusing.  We also did some other re-arranging and general clean-up of the dialog user interface, with better consistency among related controls.  The pixel format control will now only offer the pixel formats that are compatible with the current image mode in Photoshop.  You can save to any of the supported HD Photo pixel formats, but you may first have to convert to the correct image mode from within Photoshop.  The encoder options dialog also remembers it's state, so it will re-open in the same mode and with the same settings as the last time it was opened within the session.

The (default) basic mode of the encoder dialog is simple and straightforward.  The only controls are the quality setting and an explicit option for lossless mode.  Setting the quality setting to 1.0 is the same selecting the Lossless option.

Clicking the "Advanced Mode" button switches the dialog to a different set of encoder controls.  Rather than the more simplistic Quality setting in Basic mode, the Advanced mode provides full control over all the detailed encoder settings.  These settings are fully documented in the included ReadMe file, and we've talked about them in a previous post on this blog.

We also implemented a major architectural overhaul of the underlying codec and memory management.  These changes significantly reduce the memory requirement to encode and decode an image, improving performance and allowing support for much larger images without encountering memory limits.  This was a fairly major change, and the main reason why it's taken us longer than we planned to ship this beta.

The tiling options in the previous beta did not really operate correctly and that's been fixed.  We fixed a bug when saving to an HD Photo file from a RAW file that was opened in Photoshop from Lightroom.  There were a handful of other more obscure bugs that have also been fixed.

The Setup program has also been completely overhauled.  It will now automatically locate the installation of Photoshop CS2 or CS3 and install the plug-in directly to the appropriate directory.  If you have both versions, it will be installed in both places.  It also creates an entry under the Programs menu to provide easier access to the ReadMe documentation file and the End User License Agreement (EULA.)

Did You say Mac?

Yes!  As promised, we're now releasing a version of the HD Photo plug-in for Photoshop running on OS X.  This supports both Photoshop CS2 and CS3 running on OS X 10.4 (Tiger.)  It supports either version of Photoshop on both Intel and PPC Mac systems.

The Mac version is functionally identical to the Windows version.  It supports all the same pixel formats, encoder options and file format features as the Windows version.

The encoder options dialog is functionally identical to the Windows versions, with all the same options and controls.

One very cool feature with the Mac version is support for thumbnails in the OS X finder.  OS X doesn't currently HD Photo as a native format.  However, whenever Photoshop writes and HD Photo file, it also creates a thumbnail on the resource fork in a compatible format for OS X.  The result is great looking thumbnails for HD Photo files in Finder.  Very cool!

The Mac installation package is a disk image containing the documentation and separate installers for both Photoshop CS2 and CS3.  Run the appropriate installer for your version.  It will only install if it finds the compatible version of Adobe Photoshop.

Still a Beta?

Yes, these updated releases are still officially in BETA mode.  We believe that these are the final versions, but because we made some significant changes and this is the first public release of the Macintosh version, we elected to keep them in BETA mode for this release.  We're continuing to do additional testing, and as always, we welcome any comments, issues, bug reports or other feedback.  We're also very interested to hear if you run into any problems installing the plug-in on either Windows or Mac OS X.  You can post your feedback via this blog, or send it to the "hdphoto" email name at microsoft.com.

We're very excited to be able to release these updated plug-ins, especially with the addition of support for Mac OS X.  Have fun and let us hear your comments.

This is a pretty exciting day for all of us working on HD Photo.  Today, the Joint Photographic Expert's Group (JPEG) announced a new work item for the standardization of a HD Photo as a new file format called JPEG XR (XR is short for "extended range".)  You can read the full details in the Microsoft press release here and the JPEG press release here.  (Go ahead and check it out; we'll wait here.)

Wow!  Our group at Microsoft's Core Media Processing Team has been working on HD Photo for over five years.  The underlying compression technology is based on work from Microsoft Research that goes back even farther than that.  Since our first public disclosures about "Windows Media Photo" (the original name of HD Photo), our goal has been to develop the ultimate successor to JPEG as the format of choice for all digital photography.  We also announced earlier this year that we were committed to standardizing HD Photo as an open format.  With today's announcements, we're moving a lot closer to both of those goals.

An Illustrious History

For as long as digital photography has existed, digital photos have been defined by the technology created by the JPEG Committee, and it has become the most widely used standard in the world.  Simply put, digital photography would have never been possible without the work of Joint Photographic Experts Group and their JPEG image compression technology. 

Over the years, the JPEG format has become ubiquitous.  Every application, device or service that is in any way related to digital photography recognizes and/or produces this format.  JPEG is digital photography.

But for all the value the original JPEG format delivers, it's starting to show its age.  Limitations of the JPEG file format are hindering the ability to innovate new features and quality improvements in digital photography.  There have been multiple approaches to work around these limitations, but we need significant improvements to the industry standard photo format to enable new opportunities for innovation and market growth.

JPEG 2000 introduced several excellent innovations, but it largely addresses requirements beyond the role of the original JPEG format.  So, while JPEG 2000 is making some valuable contributions in other areas of digital imaging, this advanced format doesn't directly address the key requirements for consumer and professional digital photography.

A New Format for Digital Photography

From the beginning, Microsoft designed HD Photo to meet the specific needs of end-to-end consumer and professional digital photography, and address the current limitations of the original JPEG format.  HD Photo offers new pixel formats to retain higher image quality, great new progressive decoding features for more powerful image access and manipulation, and significant compression improvements to improve quality, reduce file sizes and enable better performance.

The use of the original JPEG format for digital photography has been limited to 24-bit images; each pixel is made up of three colors (red, green and blue), each stored as an 8-bit value.  This allows 256 different values for each color, or 16.8 million possible colors.  While that sounds like a lot, it significantly limits the ability to create the highest quality images.  Camera sensors typically capture up to 68.7 billion colors, so when saving as a JPEG file, a lot of information has to go.  Additionally, during any image editing operation, a much greater range of colors is required to preserve information that would otherwise exceed the finite limits of the color range.  Once data is lost beyond these limits, it can't be recovered in the future.

HD Photo offers a wide range of pixel formats at 8, 16 or 32 bits per channel including high dynamic range wide gamut formats using fixed point or floating point representations.  HD Photo offers options that eliminate the quality limitations of the original JPEG format's lone 24-bit pixel values.  This previous blog post shows just one example of the capabilities enabled by HD Photo's new pixel formats.

HD Photo's progressive decoding architecture makes it possible to efficiently decode a the image at a lower resolution, reduced quality, or a selected region by processing only a portion of the entire compressed file.  Progressive decoding enables a whole bunch of very cool features.  The Photosynth Technology Preview from Microsoft Live Labs is an excellent example of the new class of applications powered by progressive decoding.  Photosynth is discussed in some detail in a previous blog post here.  HD Photo also helps power Virtual Earth 3D and Microsoft Lab's HD View Giga-pixel Image Viewer.

HD Photo delivers state of the art image compression, offering up to twice the compression efficiency of original JPEG format (providing the same quality in half the file size) as well as higher quality lossy compression that scales all the way to mathematically lossless compression.  This makes it possible to use higher bit depth pixel formats for better image quality while retaining similar file sizes.  Better compression also allows for much smaller files using traditional 8-bit pixel formats.  Smaller files can be saved and transferred faster, providing longer device battery life and an improved user experience.  HD Photo delivers this improved compression using a high performance algorithm that is equally at home on low cost, low power devices or high end multi-core PC's.

An Open Standard

The path towards standardizing HD Photo began earlier this year, and now becomes public with today's announcement from the JPEG Committee.  This is one more step in an ongoing process towards our stated objectives for standardization.  Our goal is that HD Photo becomes JPEG XR, an open standard under the complete control of the JPEG Committee, with royalty-free rights to all required patents granted by Microsoft.  Microsoft is actively participating with the JPEG Committee to produce a complete and detailed technical specification enabling anyone to create implementations in any programming language, on any platform and under a wide variety of business models.  We're excited to be contributing to the next great standard for digital photography, enabling a whole new level of feature and technology innovation, improving photo quality and creating exciting new applications and services.  It's our sincere hope that that today's announcement will help accelerate the process of making HD Photo (JPEG XR) as ubiquitous as JPEG is today. 

Bill Crow
HD Photo Program Manager

This is a Big Change!

Most imaging applications aren't designed to understand high dynamic range, wide gamut pixel formats.  There are some specialized tools, used primarily by the visual effects world, that work with high dynamic range formats.  Adobe Photoshop CS3 (and CS2) supports high dynamic range wide gamut editing using the 32-bit editing mode.  You probably never realized that Windows Vista Photo Gallery - the simple, easy-to-use photo tools built into Windows Vista - also supports high dynamic range wide gamut editing.  That's right, Photo Gallery.

Let's walk through an example, using the Beta of the new Windows Live Photo Gallery.  This new update for Windows Vista Photo Gallery is coming soon, with some really cool new features (Big Hint: It now has "Live" in it's name), and it will also be available (with HD Photo support!) on Windows XP.  You can check out this post on the Microsoft PhotoBlog for more details on all the cool new features. 

This example works the same way using Windows Vista Photo Gallery, available today in all versions of Windows Vista.  (I've included links below to the source photos so you can try this out for yourself.)  I chose the new Windows Live Photo Gallery because they've added a really cool exposure histogram control, which will help us better illustrate what's going on.

Doing it Old School

Here's an 8-bit sRGB JPEG file, opened in Windows Live Photo Gallery.  This photo definitely has some problems.

It appears that either the camera or some automatic image adjustment program made an overall exposure adjustment decision based on an average scene illumination level.  The painted wall on the left, the dark background on the right and Anthony's dark clothes all biased this average exposure setting, causing his face and the balloons to be over exposed.  Let's zoom in on that area and select the Exposure adjustment controls under Photo Gallery's "Fix" tools. 

The histogram clearly shows the over exposure problem.  There is a large percentage of image content that is clipped at the upper limit of the exposure range.

We can try to fix the photo using the Brightness control to reduce the effect of the over exposure.

While this reduces the blinding brilliance of the image, we weren't able to recover any of the color or detail in Anthony's face, or in the balloons.  That topmost yellow balloon is still clipped to the limit in the red and green channels, resulting in a flat, featureless yellow surface for the entire balloon.   Again, the histogram clearly shows what's going on here.  Any image data that may have existed in this highlight area was clipped to the upper limit of the numerical range when it was encoded in an 8-bit JPEG file.  The Brightness adjustment reduced the levels, but all channels are still clipped at a fixed limit.  All this adjustment did was reduce the level of that clipped limit.  We haven't done that much to rescue the details and color in this over exposed photo. 

This problem isn't unique to JPEG.  We'd have the exact same results with any image format that uses unsigned integers (0-255 for 8-bit or 0-65535 for 16-bit) to encode the data, including TIFF, PNG, or even HD Photo if using an unsigned integer mode.

Once More, with HD Photo

Now let's load the same photo as stored in a 16-bit fixed point scRGB HD Photo file.  As you can see below, the displayed visible range of the image is the same as the JPEG image, so the initial appearance looks identical.  We can also see that even though this is a 16-bit image, the file size is about the same as the equivalent 8-bit JPEG image.

We're starting with the same apparent over exposure problem.  Let's go through the same editing process and see how things differ when using a high dynamic range, wide gamut pixel format.  First, we'll zoom in on the same over exposed area and open the Exposure tools under the "Fix" menu.

Note that the histogram for this version of the photo looks a bit different.  There appears to be a lower percentage of image content near the upper limit of the displayed exposure range, and there doesn't appear to be that same "pile" of image content pressed up against that upper histogram limit.  that's because there's a bunch of content in this image that's not currently displayed in this histogram.  The histogram only shows the visual range, but the HD Photo file includes image content that is outside of the current visual range.  There's more data that was captured by the sensor, but when the image exposure was adjusted based on the overall average level, this additional data wasn't clipped within the 16-bit fixed point scRGB HD Photo file, even though it appears to be clipped in the current display view.  Let's perform the same Brightness adjustment and see how things are very different when editing high dynamic range, wide gamut images.  We'll actually make a larger adjustment change because we're working with a larger range of exposure values.

Wow!  That's a big difference!  The histogram clearly shows that there was a bunch of image content that we weren't seeing in the original version, but in a high dynamic range wide gamut format, it wasn't clipped to the upper limit of the visible exposure range.  When we adjusted the Brightness, this content came back into the visual range; there is no hard clipping visible at the upper end of the exposure range.  The visible difference in the image is dramatic.  We were able to recover a great deal of color and detail in Anthony's face and the over exposed balloons.  Now we can see that the upper yellow balloon is actually translucent; all that detail was completely lost when the initial exposure decisions caused the highlights to clip at the upper end of the visual exposure range.  Now that we've undone most of the over-exposure damage, we could continue on and tweak the contrast, shadows and highlights as desired.

Comparing the Results

Here's a comparison of the two different results based on only the exposure adjustments from above.  You can really see the differences in Anthony's face and shirt, as well as the yellow balloons.  We can retain most of the desirable scene brightness while still recovering the lost highlight color and details.

This is just one example of the improved editing capabilities that are possible using high dynamic range wide gamut image formats (and editing applications that support these formats.)  This capability is here today for HD Photo using Windows Vista Photo Gallery, with expanded features and support for Windows XP coming later this summer in Windows Live Photo Gallery.  

High Dynamic Range Wide Gamut editing is also supported in Adobe Photoshop CS3 (and CS2.)   You can download the free plug-in to add HD Photo support to Adobe Photoshop on Windows Vista and Windows XP, and version for OS X (both PPC and Intel) is coming very soon.  Hopefully we'll see more imaging applications add support for high dynamic range wide gamut formats in the near future.  The new Windows graphics infrastructure, combined with HD Photo, can enable a whole new world of image processing innovation.

Your Turn

Here are links to the actual JPEG and HD Photo files I used for this example.  (They're low resolution images so they can download faster.)  Simply right-click and "Save As..."

AnthonyS.jpg      AnthonyS.wdp

Open these in the Windows Vista Photo Gallery editor and try this for yourself.  Better yet, ask you buddy to try to fix the JPEG version, then you show how it's done using the HD Photo version.  Have fun!

In addition to these two sessions, we'll also be showing some HD Photo demonstrations as part of the Microsoft Pavilion in the conference exhibit area.  I'll be hosting those demos so be sure to stop by and say hello.

I'll also be presenting sessions on HD Photo and hosting demonstrations at WinHEC 2007 Taiwan June 13th-14th, and then continuing on to WinHEC 2007 Japan June 18th-19th.  I'm looking forward to meeting you there and sharing in an interactive discussion about HD Photo.

My presentations at WinHEC last years was the first signficant public discussion of HD Photo (then known as Windows Media Photo) and we generated a tremendous amount of attention and interest.  Since then we've shipped the 1.0 version of the HD Photo Device Porting Kit, Windows Vista, .NET Frameworks 3.0, Windows Imaging Component, and the beta of the Windows HD Photo Plug-in for Adobe® Photoshop® software, all with support for HD Photo.  I'm looking forward to some equally interesting discussions this year.

See you there!

So what exactly is Expression Design?  In the words of the product team:

Expression Design is a professional illustration and graphic design tool that lets you build compelling elements for both Web and desktop application user interfaces.

Unleash your creativity with innovative vector drawing tools and non-destructive effects that you can apply to either vector or imported bitmapped images. Apply both hard-edged and organic strokes while maintaining the flexibility of vector paths. Expression Design has been built from the ground up for designers by designers.

Take a look at the Expression web site for lots more details on Expression Design and the other applications in the new Expression Suite family.

Expression Design offers HD Photo (actually called Windows Media Photo, as it is referred to throughout Windows) via the Open..., Import..., Save, Save As..., Export... and Export as Image File... commands.  Here's the encoder options dialog that Expression Design displays when exporting or saving an HD Photo file:

Expression Design works exclusively with 8bpc RGB images, with our without alpha channels.  HD Photo files of any pixel format may be opened, and if required they will be converted to Design's 8bpc RGB working format.  On save or export, files may be saved in either 24bpp RGB or 32bpp RGBA modes.

Expression Design is a powerful new application that can handle a wide range of image creation and editing tasks, and integrates with the other applications in Microsoft Expression Suite.  It's another great tool for working with HD Photo files.  Check out the free Beta 2 download and 180-day evaluation license.

Have fun!

Bill Crow