Reading and Writing Image Files with the OpenEXR Library

Document Purpose and Audience

This document shows how to write C++ code that reads and writes OpenEXR 2.0 image files.

The text assumes that the reader is familiar with OpenEXR terms like “channel”, “attribute”, “data window” or “deep data”. For an explanation of those terms see the Technical Introduction to OpenEXR document.

The OpenEXR source distribution contains a subdirectory, OpenEXRExamples, with most of the code examples below. A Makefile is also provided, so that the examples can easily be compiled and run.

A description of the file structure and format is provided in OpenEXR File Layout.

Scan Line Based and Tiled OpenEXR files

In an OpenEXR file, pixel data can be stored either as scan lines or as tiles. Files that store pixels as tiles can also store multi-resolution images. For each of the two storage formats (scan line or tile-based), the OpenEXR library supports two reading and writing interfaces:

  1. The first, fully general, interface allows access to arbitrary channels, and supports many different in-memory pixel data layouts.

  2. The second interface is easier to use, but limits access to 16-bit (HALF) RGBA (red, green, blue, alpha) channels, and provides fewer options for laying out pixels in memory.

The interfaces for reading and writing OpenEXR files are implemented in the following eight C++ classes:

tiles

scan lines

scan lines and tiles

arbitrary channels

TiledInputFile

InputFile

TiledOutputFile

OutputFile

RGBA only

TiledRgbaInputFile

RgbaInputFile

TiledRgbaOutputFile

RgbaOutputFile

The classes for reading scan line based images (InputFile and RgbaInputFile) can also be used to read tiled image files. This way, programs that do not need support for tiled or multi-resolution images can always use the rather straightforward scan line interfaces, without worrying about complications related to tiling and multiple resolutions. When a multi-resolution file is read via a scan line interface, only the highest-resolution version of the image is accessible.

Multi-Part and Deep Data

The procedure for writing multi-part and deep data files is similar to writing scan line and tile. Though there is no simplified interface, such as the RGBA-only interface.

This table describes the significant differences between writing single-part scan line and tile files and writing multi-part and deep data files.

Feature

scan line and tile

Multi-part and deep data

Channel names may be reserved

Some channel names are reserved in practice, but were never formally defined.

Channel name “sample count” is reserved for a pixel sample count slice in frame buffer.

Note: The name “sample count” (all lowercase) is subject to change.

Multiple parts

Single-part format is intended for storing a single multichannel image

Multi-part files support multiple independent parts. This allows storing multiple views in the same file for stereo images, storing multiple resolutions in different parts. It is possible to include one or more scan line, tile, deep scan line or deep tile format images within a multi-part file.

Custom data formats can also be used to store additional parts, but this is outside the scope of this document.

Backwards-compatible low-level io available

The new formats share the same abstract low-level IO as OpenEXR 1.7. It is therefore possible to use the same libraries to implement low level IO to read both formats.

Using the RGBA-only Interface for Scan Line Based Files

Writing an RGBA Image File

Writing a simple RGBA image file is fairly straightforward:

1void
2writeRgba1 (const char fileName[], const Rgba* pixels, int width, int height)
3{
4    RgbaOutputFile file (fileName, width, height, WRITE_RGBA); // 1
5    file.setFrameBuffer (pixels, 1, width);                    // 2
6    file.writePixels (height);                                 // 3
7}

Construction of an RgbaOutputFile object, on line 4, creates an OpenEXR header, sets the header’s attributes, opens the file with the specified name, and stores the header in the file. The header’s display window and data window are both set to (0,0) - (width-1, height-1). The channel list contains four channels, R, G, B, and A, of type half.

Line 5 specifies how the pixel data are laid out in memory. In our example, the pixels pointer is assumed to point to the beginning of an array of width*height pixels. The pixels are represented as Rgba structs, which are defined like this:

1struct Rgba
2{
3    half r; // red
4    half g; // green
5    half b; // blue
6    half a; // alpha (opacity)
7};

The elements of our array are arranged so that the pixels of each scan line are contiguous in memory. The setFrameBuffer() function takes three arguments, base, xStride, and ystride. To find the address of pixel (x,y), the RgbaOutputFile object computes

base + x * xStride + y * yStride.

In this case, base, xStride and yStride are set to pixels, 1, and width, respectively, indicating that pixel (x,y) can be found at memory address

pixels + 1 * x + width * y.

The call to writePixels(), on line 6, copies the image’s pixels from memory to the file. The argument to writePixels(), height, specifies how many scan lines worth of data are copied.

Finally, returning from function writeRgba1() destroys the local RgbaOutputFile object, thereby closing the file.

Why do we have to tell the writePixels() function how many scan lines we want to write? Shouldn’t the RgbaOutputFile object be able to derive the number of scan lines from the data window? The OpenEXR library doesn’t require writing all scan lines with a single writePixels() call. Many programs want to write scan lines individually, or in small blocks. For example, rendering computer-generated images can take a significant amount of time, and many rendering programs want to store each scan line in the image file as soon as all of the pixels for that scan line are available. This way, users can look at a partial image before rendering is finished. The OpenEXR library allows writing the scan lines in top-to-bottom or bottom-to-top direction. The direction is defined by the file header’s line order attribute (INCREASING_Y or DECREASING_Y). By default, scan lines are written top to bottom (INCREASING_Y).

You may have noticed that in the example above, there are no explicit checks to verify that writing the file actually succeeded. If the OpenEXR library detects an error, it throws a C++ exception instead of returning a C-style error code. With exceptions, error handling tends to be easier to get right than with error return values. For instance, a program that calls our writeRgba1() function can handle all possible error conditions with a single try/catch block:

1try
2{
3    writeRgba1 (fileName, pixels, width, height);
4}
5catch (const std::exception &exc)
6{
7    std::cerr << exc.what() << std::endl;
8}

Writing a Cropped RGBA Image

Now we are going to store a cropped image in a file. For this example, we assume that we have a frame buffer that is large enough to hold an image with width by height pixels, but only part of the frame buffer contains valid data. In the file’s header, the size of the whole image is indicated by the display window, (0,0) - (width-1, height-1), and the data window specifies the region for which valid pixel data exist. Only the pixels in the data window are stored in the file.

 1void
 2writeRgba2 (
 3    const char   fileName[],
 4    const Rgba*  pixels,
 5    int          width,
 6    int          height,
 7    const Box2i& dataWindow)
 8{
 9    Box2i          displayWindow (V2i (0, 0), V2i (width - 1, height - 1));
10    RgbaOutputFile file (fileName, displayWindow, dataWindow, WRITE_RGBA);
11    file.setFrameBuffer (pixels, 1, width);
12    file.writePixels (dataWindow.max.y - dataWindow.min.y + 1);
13}

The code above is similar to that in Writing an RGBA Image File, where the whole image was stored in the file. Two things are different, however: When the RgbaOutputFile object is created, the data window and the display window are explicitly specified rather than being derived from the image’s width and height. The number of scan lines stored in the file by writePixels() is equal to the height of the data window instead of the height of the whole image. Since we are using the default INCREASING_Y direction for storing the scan lines in the file, writePixels() starts at the top of the data window, at y coordinate dataWindow.min.y, and proceeds toward the bottom, at y coordinate dataWindow.max.y.

Even though we are storing only part of the image in the file, the frame buffer is still large enough to hold the whole image. In order to save memory, a smaller frame buffer could have been allocated, just big enough to hold the contents of the data window. Assuming that the pixels were still stored in contiguous scan lines, with the pixels pointer pointing to the pixel at the upper left corner of the data window, at coordinates (dataWindow.min.x, dataWindow.min.y), the arguments to the setFrameBuffer() call would have to be to be changed as follows:

1int dwWidth = dataWindow.max.x - dataWindow.min.x + 1;
2file.setFrameBuffer (pixels - dataWindow.min.x - dataWindow.min.y * dwWidth, 1, dwWidth);

With these settings, evaluation of

base + x * xStride + y * yStride

for pixel (dataWindow.min.x, dataWindow.min.y) produces

 1 pixels - dataWindow.min.x - dataWindow.min.y * dwWidth
 2    + dataWindow.min.x * 1
 3    + dataWindow.min.y * dwWidth
 4
 5 = pixels -
 6     - dataWindow.min.x
 7     - dataWindow.min.y * (dataWindow.max.x - dataWindow.min.x + 1)
 8     + dataWindow.min.x
 9     + dataWindow.min.y * (dataWindow.max.x - dataWindow.min.x + 1)
10 = pixels,

which is exactly what we want. Similarly, calculating the addresses for pixels (dataWindow.min.x+1, dataWindow.min.y) and (dataWindow.min.x, dataWindow.min.y+1) yields pixels+1* and *pixels+dwWidth, respectively.

Storing Custom Attributes

We will now to store an image in a file, and we will add two extra attributes to the image file header: a string, called comments, and a 4×4 matrix, called cameraTransform.

 1void
 2writeRgba3 (
 3    const char  fileName[],
 4    const Rgba* pixels,
 5    int         width,
 6    int         height,
 7    const char  comments[],
 8    const M44f& cameraTransform)
 9{
10    Header header (width, height);
11
12    header.insert ("comments", StringAttribute (comments));
13    header.insert ("cameraTransform", M44fAttribute (cameraTransform));
14
15    RgbaOutputFile file (fileName, header, WRITE_RGBA);
16    file.setFrameBuffer (pixels, 1, width);
17    file.writePixels (height);
18}

The setFrameBuffer() and writePixels() calls are the same as in the previous examples, but construction of the RgbaOutputFile object is different. The constructors in the previous examples automatically created a header on the fly, and immediately stored it in the file. Here we explicitly create a header and add our own attributes to it. When we create the RgbaOutputFile object, we tell the constructor to use our header instead of creating its own.

In order to make it easier to exchange data between programs written by different people, the OpenEXR library defines a set of standard attributes for commonly used data, such as colorimetric information, time and place where an image was recorded, or the owner of an image file’s content. For the current list of standard attributes, see the header file ImfStandardAttributes.h. The list is expected to grow over time as OpenEXR users identify new types of data they would like to represent in a standard format. If you need to store some piece of information in an OpenEXR file header, it is probably a good idea to check if a suitable standard attribute exists, before you define a new attribute.

Reading an RGBA Image File

Reading an RGBA image is almost as easy as writing one:

 1void
 2readRgba1 (
 3    const char fileName[], Array2D<Rgba>& pixels, int& width, int& height)
 4{
 5    RgbaInputFile file (fileName);
 6    Box2i         dw = file.dataWindow ();
 7
 8    width  = dw.max.x - dw.min.x + 1;
 9    height = dw.max.y - dw.min.y + 1;
10    pixels.resizeErase (height, width);
11
12    file.setFrameBuffer (&pixels[0][0] - dw.min.x - dw.min.y * width, 1, width);
13    file.readPixels (dw.min.y, dw.max.y);
14}

Constructing an RgbaInputFile object, passing the name of the file to the constructor, opens the file and reads the file’s header.

After asking the RgbaInputFile object for the file’s data window, we allocate a buffer for the pixels. For convenience, we use the OpenEXR library’s Array2D class template (the call to resizeErase() does the actual allocation). The number of scan lines in the buffer is equal to the height of the data window, and the number of pixels per scan line is equal to the width of the data window. The pixels are represented as Rgba structs.

Note that we ignore the display window in this example; in a program that wanted to place the pixels in the data window correctly in an overall image, the display window would have to be taken into account.

Just as for writing a file, calling setFrameBuffer() tells the RgbaInputFile object how to access individual pixels in the buffer. (See also Writing a Cropped RGBA Image.)

Calling readPixels() copies the pixel data from the file into the buffer. If one or more of the R, G, B, and A channels are missing in the file, the corresponding field in the pixels is filled with an appropriate default value. The default value for R, G and B is 0.0, or black; the default value for A is 1.0, or opaque.

Finally, returning from function readRgba1() destroys the local RgbaInputFile object, thereby closing the file.

Unlike the RgbaOutputFile's writePixels() method, readPixels() has two arguments. Calling readPixels(y1,y2) copies the pixels for all scan lines with y coordinates from y1 to y2 into the frame buffer. This allows access to the the scan lines in any order. The image can be read all at once, one scan line at a time, or in small blocks of a few scan lines. It is also possible to skip parts of the image.

Note that even though random access is possible, reading the scan lines in the same order as they were written, is more efficient. Random access to the file requires seek operations, which tend to be slow. Calling the RgbaInputFile’s lineOrder() method returns the order in which the scan lines in the file were written (INCREASING_Y or DECREASING_Y). If successive calls to readPixels() access the scan lines in the right order, the OpenEXR library reads the file as fast as possible, without seek operations.

Reading an RGBA Image File in Chunks

The following shows how to read an RGBA image in blocks of a few scan lines. This is useful for programs that want to process high-resolution images without allocating enough memory to hold the complete image. These programs typically read a few scan lines worth of pixels into a memory buffer, process the pixels, and store them in another file. The buffer is then re-used for the next set of scan lines. Image operations like color-correction or compositing (“A over B”) are very easy to do incrementally this way. With clever buffering of a few extra scan lines, incremental versions of operations that require access to neighboring pixels, like blurring or sharpening, are also possible.

 1void
 2readRgba2 (const char fileName[])
 3{
 4    RgbaInputFile file (fileName);
 5    Box2i         dw = file.dataWindow ();
 6
 7    int           width  = dw.max.x - dw.min.x + 1;
 8    Array2D<Rgba> pixels (10, width);
 9
10    while (dw.min.y <= dw.max.y)
11    {
12        file.setFrameBuffer (
13            &pixels[0][0] - dw.min.x - dw.min.y * width, 1, width);
14
15        file.readPixels (dw.min.y, min (dw.min.y + 9, dw.max.y));
16
17        // processPixels (pixels)
18
19        dw.min.y += 10;
20    }
21}

Again, we open the file and read the file header by constructing an RgbaInputFile object. Then we allocate a memory buffer that is just large enough to hold ten complete scan lines. We call readPixels() to copy the pixels from the file into our buffer, ten scan lines at a time. Since we want to re-use the buffer for every block of ten scan lines, we have to call setFramebuffer() before each readPixels() call, in order to associate memory address &pixels[0][0] first with pixel coordinates (dw.min.x, dw.min.y), then with (dw.min.x, dw.min.y+10), (dw.min.x, dw.min.y+20) and so on.

Reading Custom Attributes

In Storing Custom Attributes, we showed how to store custom attributes in the image file header. Here we show how to test whether a given file’s header contains particular attributes, and how to read those attributes’ values.

 1void
 2readHeader (const char fileName[])
 3{
 4    RgbaInputFile file (fileName);
 5
 6    const StringAttribute* comments =
 7        file.header ().findTypedAttribute<StringAttribute> ("comments");
 8
 9    const M44fAttribute* cameraTransform =
10        file.header ().findTypedAttribute<M44fAttribute> ("cameraTransform");
11
12    if (comments) cout << "commentsn " << comments->value () << endl;
13
14    if (cameraTransform)
15        cout << "cameraTransformn" << cameraTransform->value () << flush;
16}

As usual, we open the file by constructing an RgbaInputFile object. Calling findTypedAttribute<T>(n) searches the header for an attribute with type T and name n. If a matching attribute is found, findTypedAttribute() returns a pointer to the attribute. If the header contains no attribute with name n, or if the header contains an attribute with name n, but the attribute’s type is not T, findAttribute() returns 0. Once we have pointers to the attributes we were looking for, we can access their values by calling the attributes’ value() methods.

In this example, we handle the possibility that the attributes we want may not exist by explicitly checking for 0 pointers. Sometimes it is more convenient to rely on exceptions instead. Function typedAttribute(), a variation of findTypedAttribute(), also searches the header for an attribute with a given name and type, but if the attribute in question does not exist, typedAttribute() throws an exception rather than returning 0.

Note that the pointers returned by findTypedAttribute() point to data that are part of the RgbaInputFile object. The pointers become invalid as soon as the RgbaInputFile object is destroyed. Therefore, the following will not work:

1void
2readComments (const char fileName[], const StringAttribute *&comments)
3{
4    // error: comments pointer is invalid after this function returns
5
6    RgbaInputFile file (fileName);
7
8    comments = file.header().findTypedAttribute <StringAttribute> ("comments");
9}

readComments() must copy the attribute’s value before it returns; for example, like this:

1void
2readComments (const char fileName[], string &comments)
3{
4    RgbaInputFile file (fileName);
5
6    comments = file.header().typedAttribute<StringAttribute>("comments").value();
7}

Luminance/Chroma and Gray-Scale Images

Writing an RGBA image file usually preserves the pixels without losing any data; saving an image file and reading it back does not alter the pixels’ R, G, B and A values. Most of the time, lossless data storage is exactly what we want, but sometimes file space or transmission bandwidth are limited, and we would like to reduce the size of our image files. It is often acceptable if the numbers in the pixels change slightly as long as the image still looks just like the original.

The RGBA interface in the OpenEXR library supports storing RGB data in luminance/chroma format. The R, G, and B channels are converted into a luminance channel, Y, and two chroma channels, RY and BY. The Y channel represents a pixel’s brightness, and the two chroma channels represent its color. The human visual system’s spatial resolution for color is much lower than the spatial resolution for brightness. This allows us to reduce the horizontal and vertical resolution of the RY and BY channels by a factor of two. The visual appearance of the image doesn’t change, but the image occupies only half as much space, even before data compression is applied. (For every four pixels, we store four Y values, one RY value, and one BY value, instead of four R, four G, and four B values.)

When opening a file for writing, a program can select how it wants the pixels to be stored. The constructors for class RgbaOutputFile have an rgbaChannels argument, which determines the set of channels in the file:

WRITE_RGBA

red, green, blue, alpha

WRITE_YC

luminance, chroma

WRITE_YCA

luminance, chroma, alpha

WRITE_Y

luminance only

WRITE_YA

luminance, alpha

WRITE_Y and WRITE_YA provide an efficient way to store gray-scale images. The chroma channels for a gray-scale image contain only zeroes, so they can be omitted from the file.

When an image file is opened for reading, class RgbaInputFile automatically detects luminance/chroma images and converts the pixels back to RGB format.

Using the General Interface for Scan Line Based Files

Writing an Image File

This example demonstrates how to write an OpenEXR image file with two channels: one channel, of type HALF, is called G, and the other, of type FLOAT, is called Z. The size of the image is width by height pixels. The data for the two channels are supplied in two separate buffers, gPixels and zPixels. Within each buffer, the pixels of each scan line are contiguous in memory.

 1void
 2writeGZ1 (
 3    const char   fileName[],
 4    const half*  gPixels,
 5    const float* zPixels,
 6    int          width,
 7    int          height)
 8{
 9    Header header (width, height);                    // 1
10    header.channels ().insert ("G", Channel (HALF));  // 2
11    header.channels ().insert ("Z", Channel (FLOAT)); // 3
12
13    OutputFile file (fileName, header); // 4
14
15    FrameBuffer frameBuffer; // 5
16
17    frameBuffer.insert (
18        "G", // name    // 6
19        Slice (
20            HALF,                        // type    // 7
21            (char*) gPixels,             // base    // 8
22            sizeof (*gPixels) * 1,       // xStride // 9
23            sizeof (*gPixels) * width)); // yStride // 10
24
25    frameBuffer.insert (
26        "Z", // name    // 11
27        Slice (
28            FLOAT,                       // type    // 12
29            (char*) zPixels,             // base    // 13
30            sizeof (*zPixels) * 1,       // xStride // 14
31            sizeof (*zPixels) * width)); // yStride // 15
32
33    file.setFrameBuffer (frameBuffer); // 16
34    file.writePixels (height);         // 17
35}

On line 8, an OpenEXR header is created, and the header’s display window and data window are both set to (0, 0) - (width-1, height-1).

Lines 9 and 10 specify the names and types of the image channels that will be stored in the file.

Constructing an OutputFile object in line 12 opens the file with the specified name, and stores the header in the file.

Lines 14 through 28 tell the OutputFile object how the pixel data for the image channels are laid out in memory. After constructing a FrameBuffer object, a Slice is added for each of the image file’s channels. A Slice describes the memory layout of one channel. The constructor for the Slice object takes four arguments, type, base, xStride, and yStride. type specifies the pixel data type (HALF, FLOAT, or UINT); the other three arguments define the memory address of pixel (x,y) as

base + x * xStride + y * yStride.

Note: base is of type char*, and that offsets from base are not implicitly multiplied by the size of an individual pixel, as in the RGBA-only interface. xStride and yStride must explicitly take the size of the pixels into account.

With the values specified in our example, the OpenEXR library computes the address of the G channel of pixel (x,y) like this:

1(half*)((char*)gPixels + x * sizeof(half) * 1 + y * sizeof(half) * width);
2    // = (half*)((char*)gPixels + x * 2 + y * 2 * width);

The address of the Z channel of pixel (x,y) is

1float* Z = 
2(float*)((char*)zPixels + x * sizeof(float) * 1 + y * sizeof(float) * width);
3    // = (float*)((char*)zPixels + x * 4 + y * 4 * width);

The writePixels() call in line 29 copies the image’s pixels from memory into the file. As in the RGBA-only interface, the argument to writePixels() specifies how many scan lines are copied into the file. (See Writing an RGBA Image File.)

If the image file contains a channel for which the FrameBuffer object has no corresponding Slice, then the pixels for that channel in the file are filled with zeroes. If the FrameBuffer object contains a Slice for which the file has no channel, then the Slice is ignored.

Returning from function writeGZ1() destroys the local OutputFile object and closes the file.

Writing a Cropped Image

Writing a cropped image using the general interface is analogous to writing a cropped image using the RGBA-only interface, as shown in Writing a Cropped RGBA Image. In the file’s header the data window is set explicitly instead of being generated automatically from the image’s width and height. The number of scan lines that are stored in the file is equal to the height of the data window, instead of the height of the entire image. As in Writing a Cropped RGBA Image, the example code below assumes that the memory buffers for the pixels are large enough to hold width by height pixels, but only the region that corresponds to the data window will be stored in the file. For smaller memory buffers with room only for the pixels in the data window, the base, xStride and yStride arguments for the FrameBuffer object’s slices would have to be adjusted accordingly. (Again, see Writing a Cropped RGBA Image.)

 1void
 2writeGZ2 (
 3    const char   fileName[],
 4    const half*  gPixels,
 5    const float* zPixels,
 6    int          width,
 7    int          height,
 8    const Box2i& dataWindow)
 9{
10    Header header (width, height);
11    header.dataWindow () = dataWindow;
12    header.channels ().insert ("G", Channel (HALF));
13    header.channels ().insert ("Z", Channel (FLOAT));
14
15    OutputFile file (fileName, header);
16
17    FrameBuffer frameBuffer;
18
19    frameBuffer.insert (
20        "G", // name
21        Slice (
22            HALF,                        // type
23            (char*) gPixels,             // base
24            sizeof (*gPixels) * 1,       // xStride
25            sizeof (*gPixels) * width)); // yStride
26
27    frameBuffer.insert (
28        "Z", // name
29        Slice (
30            FLOAT,                       // type
31            (char*) zPixels,             // base
32            sizeof (*zPixels) * 1,       // xStride
33            sizeof (*zPixels) * width)); // yStride
34
35    file.setFrameBuffer (frameBuffer);
36    file.writePixels (dataWindow.max.y - dataWindow.min.y + 1);
37}

Reading an Image File

In this example, we read an OpenEXR image file using the OpenEXR library’s general interface. We assume that the file contains two channels, R, and G, of type HALF, and one channel, Z, of type FLOAT. If one of those channels is not present in the image file, the corresponding memory buffer for the pixels will be filled with an appropriate default value.

 1void
 2readGZ1 (
 3    const char      fileName[],
 4    Array2D<half>&  rPixels,
 5    Array2D<half>&  gPixels,
 6    Array2D<float>& zPixels,
 7    int&            width,
 8    int&            height)
 9{
10    InputFile file (fileName);
11
12    Box2i dw = file.header ().dataWindow ();
13    width    = dw.max.x - dw.min.x + 1;
14    height   = dw.max.y - dw.min.y + 1;
15
16    rPixels.resizeErase (height, width);
17    gPixels.resizeErase (height, width);
18    zPixels.resizeErase (height, width);
19
20    FrameBuffer frameBuffer;
21
22    frameBuffer.insert ("R",                                    // name
23                        Slice (HALF,                            // type
24                               (char *) (&rPixels[0][0] -      // base
25                                          dw.min.x -
26                                          dw.min.y * width),
27                               sizeof (rPixels[0][0]) * 1,     // xStride
28                               sizeof (rPixels[0][0]) * width, // yStride
29                               1, 1,                            // x/y sampling
30                               0.0));                           // fillValue
31
32    frameBuffer.insert ("G",                                    // name
33                        Slice (HALF,                            // type
34                               (char *) (&gPixels[0][0] -      // base
35                                          dw.min.x -
36                                          dw.min.y * width),
37                               sizeof (gPixels[0][0]) * 1,     // xStride
38                               sizeof (gPixels[0][0]) * width, // yStride
39                               1, 1,                            // x/y sampling
40                               0.0));                           // fillValue
41
42    frameBuffer.insert ("Z",                                    // name
43                        Slice (FLOAT,                           // type
44                               (char *) (&zPixels[0][0] -      // base
45                                          dw.min.x -
46                                          dw.min.y * width),
47                               sizeof (zPixels[0][0]) * 1,     // xStride
48                               sizeof (zPixels[0][0]) * width, // yStride
49                               1, 1,                            // x/y sampling
50                               FLT_MAX));                       // fillValue
51
52    file.setFrameBuffer (frameBuffer);
53    file.readPixels (dw.min.y, dw.max.y);
54}

First, we open the file with the specified name, by constructing an InputFile object.

Using the Array2D class template, we allocate memory buffers for the image’s R, G and Z channels. The buffers are big enough to hold all pixels in the file’s data window.

Next, we create a FrameBuffer object, which describes our buffers to the OpenEXR library. For each image channel, we add a slice to the FrameBuffer.

As usual, the slice’s type, xStride, and yStride describe the corresponding buffer’s layout. For the R channel, pixel (dw.min.x, dw.min.y) is at address &rPixels[0][0]. By setting the type, xStride and yStride of the corresponding Slice object as shown above, evaluating

base + x * xStride + y * yStride

for pixel (dw.min.x, dw.min.y) produces

(char*)(&rPixels[0][0] - dw.min.x - dw.min.y * width)
 + dw.min.x * sizeof (rPixels[0][0]) * 1
 + dw.min.y * sizeof (rPixels[0][0]) * width
= (char*)&rPixels[0][0]
 - dw.min.x * sizeof (rPixels[0][0])
 - dw.min.y * sizeof (rPixels[0][0]) * width
 + dw.min.x * sizeof (rPixels[0][0])
 + dw.min.y * sizeof (rPixels[0][0]) * width
= &rPixels[0][0] *.*

The address calculations for pixels (dw.min.x+1, dw.min.y) and (dw.min.x, dw.min.y+1) produce &rPixels[0][0]+1 and &rPixels[0][0]+width, which is equivalent to &rPixels[0][1] and &rPixels[1][0].

Each Slice has a fillValue. If the image file does not contain an image channel for the Slice, then the corresponding memory buffer will be filled with the fillValue.

The Slice's remaining two parameters, xSampling and ySampling are used for images where some of the channels are subsampled, for instance, the RY and BY channels in luminance/chroma images. (See Luminance/Chroma and Gray-Scale Images.) Unless an image contains subsampled channels, xSampling and ySampling should always be set to 1. For details see header files ImfFrameBuffer.h and ImfChannelList.h.

After describing our memory buffers’ layout, we call readPixels() to copy the pixel data from the file into the buffers. Just as with the RGBA-only interface, readPixels() allows random-access to the scan lines in the file. (See Reading an RGBA Image File in Chunks.)

Interleaving Image Channels in the Frame Buffer

Here is a variation of the previous example. We are reading an image file, but instead of storing each image channel in a separate memory buffer, we interleave the channels in a single buffer. The buffer is an array of structs, which are defined like this:

1struct GZ
2{
3    half g;
4    float z;
5};

The code to read the file is almost the same as before; aside from reading only two instead of three channels, the only difference is how base, xStride and yStride for the Slice s in the FrameBuffer object are computed:

 1void
 2readGZ2 (const char fileName[], Array2D<GZ>& pixels, int& width, int& height)
 3{
 4    InputFile file (fileName);
 5
 6    Box2i dw = file.header ().dataWindow ();
 7    width    = dw.max.x - dw.min.x + 1;
 8    height   = dw.max.y - dw.min.y + 1;
 9
10    int dx = dw.min.x;
11    int dy = dw.min.y;
12
13    pixels.resizeErase (height, width);
14
15    FrameBuffer frameBuffer;
16
17    frameBuffer.insert (
18        "G",
19        Slice (
20            HALF,
21            (char*) &pixels[-dy][-dx].g,
22            sizeof (pixels[0][0]) * 1,
23            sizeof (pixels[0][0]) * width));
24
25    frameBuffer.insert (
26        "Z",
27        Slice (
28            FLOAT,
29            (char*) &pixels[-dy][-dx].z,
30            sizeof (pixels[0][0]) * 1,
31            sizeof (pixels[0][0]) * width));
32
33    file.setFrameBuffer (frameBuffer);
34    file.readPixels (dw.min.y, dw.max.y);
35}

Which Channels are in a File?

In functions readGZ1() and readGZ2(), above, we simply assumed that the files we were trying to read contained a certain set of channels. We relied on the OpenEXR library to do “something reasonable” in case our assumption was not true. Sometimes we want to know exactly what channels are in an image file before reading any pixels, so that we can do what we think is appropriate.

The file’s header contains the file’s channel list. Using iterators similar to those in the C++ Standard Template Library, we can iterate over the channels:

1const ChannelList &channels = file.header().channels();
2
3for (ChannelList::ConstIterator i = channels.begin(); i != channels.end(); ++i)
4{
5    const Channel &channel = i.channel();
6    // ...
7}

Channels can also be accessed by name, either with the [] operator, or with the f indChannel() function:

1// const ChannelList &channels = file.header().channels();
2
3const Channel &channel = channels["G"];
4
5const Channel *channelPtr = channels.findChannel("G");

The difference between the [] operator and findChannel() function is how errors are handled. If the channel in question is not present, findChannel() returns 0; the [] operator throws an exception.

Layers

In an image file with many channels it is sometimes useful to group the channels into layers, that is, into sets of channels that logically belong together. Grouping channels into layers is done using a naming convention: channel C in layer L is called L.C.

For example, a computer-generated picture of a 3D scene may contain a separate set of R, G and B channels for the light that originated at each one of the light sources in the scene. Every set of R, G, and B channels is in its own layer. If the layers are called light1, light2, light3, etc., then the full names of the channels in this image are light1.R, light1.G, light1.B, light2.R, light2.G, light2.B, light3.R, and so on.

Layers can be nested; for instance, light1.specular.R refers to the R channel in the specular sub-layer of layer light1.

Channel names that do not contain a ., or that contain a . only at the beginning or at the end are not considered to be part of any layer.

Class ChannelList has two member functions that support per-layer access to channels: layers() returns the names of all layers in a ChannelList, and channelsInLayer() converts a layer name into a pair of iterators that allows iterating over the channels in the corresponding layer.

The following sample code prints the layers in a ChannelList and the channels in each layer:

 1const ChannelList &channels = file.header().channels(); ;
 2
 3std::set<string> layerNames;
 4
 5channels.layers (layerNames);
 6
 7for (std::set<std::string>::const_iterator i = layerNames.begin(); i != layerNames.end(); ++i)
 8{
 9    cout << "layer " << *i << endl;
10
11    ChannelList::ConstIterator layerBegin, layerEnd;
12    channels.channelsInLayer (*i, layerBegin, layerEnd);
13    for (ChannelList::ConstIterator j = layerBegin; j != layerEnd; ++j)
14    {
15        cout << "tchannel " << j.name() << endl;
16    }
17}

Tiles, Levels and Level Modes

A single tiled OpenEXR file can hold multiple versions of an image, each with a different resolution. Each version is called a level. A tiled file’s level mode defines how many levels are stored in the file. There are three different level modes:

ONE_LEVEL

The file contains only a single, full-resolution level. A ONE_LEVEL image file is equivalent to a scan line based file; the only difference is that the pixels are accessed by tile instead of by scan line.

MIPMAP_LEVELS

The file contains multiple levels. The first level holds the image at full resolution. Each successive level is half the resolution of the previous level in x and y direction. The last level contains only a single pixel. MIPMAP_LEVELS files are used for texture-mapping and similar applications.

RIPMAP_LEVELS

Like MIPMAP_LEVELS, but with more levels. The levels include all combinations of reducing the resolution of the image by powers of two independently in x and y direction. Used for texture mapping, like MIPMAP_LEVELS. The additional levels in a RIPMAP_LEVELS file can help to accelerate anisotropic filtering during texture lookups.

In MIPMAP_LEVELS and RIPMAP_LEVELS mode, the size (width or height) of each level is computed by halving the size of the level with the next higher resolution. If the size of the higher-resolution level is odd, then the size of the lower-resolution level must be rounded up or down in order to avoid arriving at a non-integer width or height. The rounding direction is determined by the file’s level size rounding mode.

Within each level, the pixels of the image are stored in a two-dimensional array of tiles. The tiles in an OpenEXR file can be any rectangular shape, but all tiles in a file have the same size. This means that lower-resolution levels contain fewer, rather than smaller, tiles.

An OpenEXR file’s level mode and rounding mode, and the size of the tiles are stored in an attribute in the file header. The value of this attribute is a TileDescription object:

 1// Enums defined in ImfTileDescription.h
 2// enum LevelMode
 3// {
 4//     ONE_LEVEL,
 5//     MIPMAP_LEVELS,
 6//     RIPMAP_LEVELS
 7// };
 8    
 9// enum LevelRoundingMode
10// {
11//     ROUND_DOWN,
12//     ROUND_UP
13// };
14    
15class TileDescription
16{
17  public:
18    unsigned int xSize; // size of a tile in the x dimension
19    unsigned int ySize; // size of a tile in the y dimension
20    LevelMode mode;
21    LevelRoundingMode roundingMode;
22    // ...  (methods omitted)
23};

Using the RGBA-only Interface for Tiled Files

Writing a Tiled RGBA Image File with One Resolution Level

Writing a tiled RGBA image with a single level is easy:

 1void
 2writeTiledRgbaONE1 (
 3    const char  fileName[],
 4    const Rgba* pixels,
 5    int         width,
 6    int         height,
 7    int         tileWidth,
 8    int         tileHeight)
 9{
10    TiledRgbaOutputFile out (
11        fileName,
12        width,
13        height, // image size
14        tileWidth,
15        tileHeight,                        // tile size
16        ONE_LEVEL,                         // level mode
17        ROUND_DOWN,                        // rounding mode
18        WRITE_RGBA);                       // channels in file // 1
19    out.setFrameBuffer (pixels, 1, width); // 2
20    out.writeTiles (0, out.numXTiles () - 1, 0, out.numYTiles () - 1); // 3
21}

Opening the file and defining the pixel data layout in memory are done in almost the same way as for scan line based files:

Construction of the TiledRgbaOutputFile object, on line 7, creates an OpenEXR header, sets the header’s attributes, opens the file with the specified name, and stores the header in the file. The header’s display window and data window are both set to (0, 0) - (width-1, height-1). The size of each tile in the file will be tileWidth by tileHeight pixels. The channel list contains four channels, R, G, B, and A, of type HALF.

Line 13 specifies how the pixel data are laid out in memory. The arithmetic involved in calculating the memory address of a specific pixel is the same as for the scan line based interface. (See Writing an RGBA Image File). We assume that the pixels pointer points to an array of width*height pixels, which contains the entire image.

Line 14 copies the pixels into the file. The TiledRgbaOutputFile‘s writeTiles() method takes four arguments, dxMin, dyMin, dxMax and dyMax; writeTiles() writes all tiles that have tile coordinates (dx,dy), where dxMindxdxMax and dyMindydyMax. The numXTiles() method returns the number of tiles in the x direction, and similarly, the numYTiles() method returns the number of tiles in the y direction. Thus,

out.writeTiles (0, out.numXTiles () - 1, 0, out.numYTiles () - 1); // 3

writes the entire image.

This simple method works well when enough memory is available to allocate a frame buffer for the entire image. When allocating a frame buffer for the whole image is not desirable, for example because the image is very large, a smaller frame buffer can be used. Even a frame buffer that can hold only a single tile is sufficient, as demonstrated in the following example:

 1void
 2writeTiledRgbaONE2 (
 3    const char fileName[], int width, int height, int tileWidth, int tileHeight)
 4{
 5    TiledRgbaOutputFile out (
 6        fileName,
 7        width,
 8        height, // image size
 9        tileWidth,
10        tileHeight,  // tile size
11        ONE_LEVEL,   // level mode
12        ROUND_DOWN,  // rounding mode
13        WRITE_RGBA); // channels in file // 1
14
15    Array2D<Rgba> pixels (tileHeight, tileWidth); // 2
16
17    for (int tileY = 0; tileY < out.numYTiles (); ++tileY) // 3
18    {
19        for (int tileX = 0; tileX < out.numXTiles (); ++tileX) // 4
20        {
21            Box2i range = out.dataWindowForTile (tileX, tileY); // 5
22
23            generatePixels (pixels, width, height, range); // 6
24
25            out.setFrameBuffer (
26                &pixels[-range.min.y][-range.min.x],
27                1,          // xStride
28                tileWidth); // yStride // 7
29
30            out.writeTile (tileX, tileY); // 8
31        }
32    }
33}

On line 13 we allocate a pixels array with tileWidtf*tileHeight elements, which is just enough for one tile. Line 18 computes the data window range for each tile, that is, the set of pixel coordinates covered by the tile. The generatePixels() function, on line 20, fills the pixels array with one tile’s worth of image data. The same pixels array is reused for all tiles. We must call setFrameBuffer(), on line 22, before writing each tile so that the pixels in the array are accessed properly in the writeTile() call on line 26. Again, the address arithmetic to access the pixels is the same as for scan line based files. The values for the base, xStride, and yStride arguments to the setFrameBuffer() call must be chosen so that evaluating the expression

base + x * xStride + y * yStride

produces the address of the pixel with coordinates (x,y).

Writing a Tiled RGBA Image File with Mipmap Levels

In order to store a multi-resolution image in a file, we can allocate a frame buffer large enough for the highest-resolution level, (0,0), and reuse it for all levels:

 1void
 2writeTiledRgbaMIP1 (
 3    const char fileName[], int width, int height, int tileWidth, int tileHeight)
 4{
 5    TiledRgbaOutputFile out (
 6        fileName,
 7        width,
 8        height,
 9        tileWidth,
10        tileHeight,
11        MIPMAP_LEVELS,
12        ROUND_DOWN,
13        WRITE_RGBA); // 1
14
15    Array2D<Rgba> pixels (height, width); // 2
16
17    out.setFrameBuffer (&pixels[0][0], 1, width); // 3
18
19    for (int level = 0; level < out.numLevels (); ++level) // 4
20    {
21        generatePixels (pixels, width, height, level); // 5
22
23        out.writeTiles (
24            0,
25            out.numXTiles (level) - 1, // 6
26            0,
27            out.numYTiles (level) - 1,
28            level);
29    }
30}

The main difference here is the use of MIPMAP_LEVELS on line 6 for the TiledRgbaOutputFile constructor. This signifies that the file will contain multiple levels, each level being a factor of 2 smaller in both dimensions than the previous level. Mipmap images contain n levels, with level numbers

(0,0), (1,1), … (n-1,n-1),

where

n = floor (log (max (width, height)) / log (2)) + 1

if the level size rounding mode is ROUND_DOWN, or

n = ceil (log (max (width, height)) / log (2)) + 1

if the level size rounding mode is ROUND_UP. Note that even though level numbers are pairs of integers, (lx,ly), only levels where lx equals ly are used in MIPMAP_LEVELS files.

Line 13 allocates a pixels array with width by height pixels, big enough to hold the highest-resolution level.

In order to store all tiles in the file, we must loop over all levels in the image (line 17). numLevels() returns the number of levels, n, in our mipmapped image. Since the tile sizes remain the same in all levels, the number of tiles in both dimensions varies between levels. numXTiles() and numYTiles() take a level number as an optional argument, and return the number of tiles in the x or y direction for the corresponding level. Line 19 fills the pixels array with appropriate data for each level, and line 21 stores the pixel data in the file.

As with ONE_LEVEL images, we can choose to only allocate a frame buffer for a single tile and reuse it for all tiles in the image:

 1void
 2writeTiledRgbaMIP2 (
 3    const char fileName[], int width, int height, int tileWidth, int tileHeight)
 4{
 5    TiledRgbaOutputFile out (
 6        fileName,
 7        width,
 8        height,
 9        tileWidth,
10        tileHeight,
11        MIPMAP_LEVELS,
12        ROUND_DOWN,
13        WRITE_RGBA);
14
15    Array2D<Rgba> pixels (tileHeight, tileWidth);
16
17    for (int level = 0; level < out.numLevels (); ++level)
18    {
19        for (int tileY = 0; tileY < out.numYTiles (level); ++tileY)
20        {
21            for (int tileX = 0; tileX < out.numXTiles (level); ++tileX)
22            {
23
24                Box2i range = out.dataWindowForTile (tileX, tileY, level);
25
26                generatePixels (pixels, width, height, range, level);
27
28                out.setFrameBuffer (
29                    &pixels[-range.min.y][-range.min.x],
30                    1,          // xStride
31                    tileWidth); // yStride
32
33                out.writeTile (tileX, tileY, level);
34            }
35        }
36    }
37}

The structure of this code is the same as for writing a ONE_LEVEL image using a tile-sized frame buffer, but we have to loop over more tiles. Also, dataWindowForTile() takes an additional level argument to determine the pixel range for the tile at the specified level.

Writing a Tiled RGBA Image File with Ripmap Levels

The ripmap level mode allows for storing all combinations of reducing the resolution of the image by powers of two independently in both dimensions. Ripmap files contains nx*ny levels, with level numbers:

(0, 0), (1, 0), … (nx-1, 0), (0, 1), (1, 1), … (nx-1, 1), … (0,ny-1), (1,ny-1), … (nx-1,ny-1)

where

nx = floor (log (width) / log (2)) + 1 ny = floor (log (height) / log (2)) + 1

if the level size rounding mode is ROUND_DOWN, or

nx = ceil (log (width) / log (2)) + 1 ny = ceil (log (height) / log (2)) + 1

if the level size rounding mode is ROUND_UP.

With a frame buffer that is large enough to hold level (0,0), we can write a ripmap file like this:

 1void
 2writeTiledRgbaRIP1 (
 3    const char fileName[], int width, int height, int tileWidth, int tileHeight)
 4{
 5    TiledRgbaOutputFile out (
 6        fileName,
 7        width,
 8        height,
 9        tileWidth,
10        tileHeight,
11        RIPMAP_LEVELS,
12        ROUND_DOWN,
13        WRITE_RGBA);
14
15    Array2D<Rgba> pixels (height, width);
16
17    out.setFrameBuffer (&pixels[0][0], 1, width);
18
19    for (int yLevel = 0; yLevel < out.numYLevels (); ++yLevel)
20    {
21        for (int xLevel = 0; xLevel < out.numXLevels (); ++xLevel)
22        {
23            generatePixels (pixels, width, height, xLevel, yLevel);
24
25            out.writeTiles (
26                0,
27                out.numXTiles (xLevel) - 1,
28                0,
29                out.numYTiles (yLevel) - 1,
30                xLevel,
31                yLevel);
32        }
33    }
34}

As for ONE_LEVEL and MIPMAP_LEVELS files, the frame buffer doesn’t have to be large enough to hold a whole level. Any frame buffer big enough to hold at least a single tile will work.

Reading a Tiled RGBA Image File

Reading a tiled RGBA image file is done similarly to writing one:

 1void
 2readTiledRgba1 (
 3    const char fileName[], Array2D<Rgba>& pixels, int& width, int& height)
 4{
 5    TiledRgbaInputFile in (fileName);
 6
 7    Box2i dw = in.dataWindow ();
 8    width    = dw.max.x - dw.min.x + 1;
 9    height   = dw.max.y - dw.min.y + 1;
10
11    int dx = dw.min.x;
12    int dy = dw.min.y;
13
14    pixels.resizeErase (height, width);
15
16    in.setFrameBuffer (&pixels[-dy][-dx], 1, width);
17    in.readTiles (0, in.numXTiles () - 1, 0, in.numYTiles () - 1);
18}

First we need to create a TiledRgbaInputFile object for the given file name. We then retrieve information about the data window in order to create an appropriately sized frame buffer, in this case large enough to hold the whole image at level (0,0). After we set the frame buffer, we read the tiles from the file.

This example only reads the highest-resolution level of the image. It can be extended to read all levels, for multi-resolution images, by also iterating over all levels within the image, analogous to the examples in Writing a Tiled RGBA Image File with Mipmap Levels, and Writing a Tiled RGBA Image File with Ripmap Levels.

Using the General Interface for Tiled Files

Writing a Tiled Image File

This example is a variation of the one in Writing an Image File. We are writing a ONE_LEVEL image file with two channels, G, and Z, of type HALF, and FLOAT respectively, but here the file is tiled instead of scan line based:

 1void
 2writeTiled1 (
 3    const char   fileName[],
 4    Array2D<GZ>& pixels,
 5    int          width,
 6    int          height,
 7    int          tileWidth,
 8    int          tileHeight)
 9{
10
11    Header header (width, height);                    // 1
12    header.channels ().insert ("G", Channel (HALF));  // 2
13    header.channels ().insert ("Z", Channel (FLOAT)); // 3
14
15    header.setTileDescription (
16        TileDescription (tileWidth, tileHeight, ONE_LEVEL)); // 4
17
18    TiledOutputFile out (fileName, header); // 5
19
20    FrameBuffer frameBuffer; // 6
21
22    frameBuffer.insert (
23        "G", // name // 7
24        Slice (
25            HALF,                            // type // 8
26            (char*) &pixels[0][0].g,         // base // 9
27            sizeof (pixels[0][0]) * 1,       // xStride // 10
28            sizeof (pixels[0][0]) * width)); // yStride // 11
29
30    frameBuffer.insert (
31        "Z", // name // 12
32        Slice (
33            FLOAT,                           // type // 13
34            (char*) &pixels[0][0].z,         // base // 14
35            sizeof (pixels[0][0]) * 1,       // xStride // 15
36            sizeof (pixels[0][0]) * width)); // yStride // 16
37
38    out.setFrameBuffer (frameBuffer);                                  // 17
39    out.writeTiles (0, out.numXTiles () - 1, 0, out.numYTiles () - 1); // 18
40}

As one would expect, the code here is very similar to the code in Writing an Image File. The file’s header is created in line 1, while lines 2 and 3 specify the names and types of the image channels that will be stored in the file. An important addition is line 4, where we define the size of the tiles and the level mode. In this example we use ONE_LEVEL for simplicity. Line 5 opens the file and writes the header. Lines 6 through 17 tell the TiledOutputFile object the location and layout of the pixel data for each channel. Finally, line 18 stores the tiles in the file.

Reading a Tiled Image File

Reading a tiled file with the general interface is virtually identical to reading a scan line based file, as shown in Interleaving Image Channels in the Frame Buffer; only the last three lines are different. Instead of reading all scan lines at once with a single function call, here we must iterate over all tiles we want to read.

 1void
 2readTiled1 (const char fileName[], Array2D<GZ>& pixels, int& width, int& height)
 3{
 4    TiledInputFile in (fileName);
 5
 6    Box2i dw = in.header ().dataWindow ();
 7    width    = dw.max.x - dw.min.x + 1;
 8    height   = dw.max.y - dw.min.y + 1;
 9
10    int dx = dw.min.x;
11    int dy = dw.min.y;
12
13    pixels.resizeErase (height, width);
14
15    FrameBuffer frameBuffer;
16
17    frameBuffer.insert (
18        "G",
19        Slice (
20            HALF,
21            (char*) &pixels[-dy][-dx].g,
22            sizeof (pixels[0][0]) * 1,
23            sizeof (pixels[0][0]) * width));
24
25    frameBuffer.insert (
26        "Z",
27        Slice (
28            FLOAT,
29            (char*) &pixels[-dy][-dx].z,
30            sizeof (pixels[0][0]) * 1,
31            sizeof (pixels[0][0]) * width));
32
33    in.setFrameBuffer (frameBuffer);
34    in.readTiles (0, in.numXTiles () - 1, 0, in.numYTiles () - 1);
35}

In this example we assume that the file we want to read contains two channels, G and Z, of type HALF and FLOAT respectively. If the file contains other channels, we ignore them. We only read the highest-resolution level of the image. If the input file contains more levels (MIPMAP_LEVELS or MIPMAP_LEVELS), we can access the extra levels by calling a four-argument version of the readTile() function:

in.readTile (tileX, tileY, levelX, levelY);

or by calling a six-argument version of readTiles():

in.readTiles (tileXMin, tileXMax, tileYMin, tileYMax, levelX, levelY);

Deep Data Files

Writing a Deep Scan Line File

This example creates an deep scan line file with two channels. It demonstrates how to write a deep scan line file with two channels:

  1. type FLOAT, is called Z, and is used for storing sample depth, and

  2. type HALF, is called A and is used for storing sample opacity.

The size of the image is width by height pixels.

 1void
 2writeDeepScanLineFile (
 3    const char       filename[],
 4    Box2i            displayWindow,
 5    Box2i            dataWindow,
 6    Array2D<float*>& dataZ,
 7
 8    Array2D<half*>& dataA,
 9
10    Array2D<unsigned int>& sampleCount)
11
12{
13    int height = dataWindow.max.y - dataWindow.min.y + 1;
14    int width  = dataWindow.max.x - dataWindow.min.x + 1;
15
16    Header header (displayWindow, dataWindow);
17
18    header.channels ().insert ("Z", Channel (FLOAT));
19    header.channels ().insert ("A", Channel (HALF));
20    header.setType (DEEPSCANLINE);
21    header.compression () = ZIPS_COMPRESSION;
22
23    DeepScanLineOutputFile file (filename, header);
24
25    DeepFrameBuffer frameBuffer;
26
27    frameBuffer.insertSampleCountSlice (Slice (
28        UINT,
29        (char*) (&sampleCount[0][0] - dataWindow.min.x - dataWindow.min.y * width),
30        sizeof (unsigned int) * 1, // xS
31
32        sizeof (unsigned int) * width)); // yStride
33
34    frameBuffer.insert (
35        "Z",
36        DeepSlice (
37            FLOAT,
38            (char*) (&dataZ[0][0] - dataWindow.min.x - dataWindow.min.y * width),
39            sizeof (float*) * 1, // xStride for pointer
40
41            sizeof (float*) * width, // yStride for pointer array
42            sizeof (float) * 1));    // stride for Z data sample
43
44    frameBuffer.insert (
45        "A",
46        DeepSlice (
47            HALF,
48            (char*) (&dataA[0][0] - dataWindow.min.x - dataWindow.min.y * width),
49            sizeof (half*) * 1,     // xStride for pointer array
50            sizeof (half*) * width, // yStride for pointer array
51            sizeof (half) * 1));    // stride for A data sample
52
53    file.setFrameBuffer (frameBuffer);
54
55    for (int i = 0; i < height; i++)
56    {
57        for (int j = 0; j < width; j++)
58        {
59            sampleCount[i][j] = getPixelSampleCount (i, j);
60            dataZ[i][j]       = new float[sampleCount[i][j]];
61            dataA[i][j]       = new half[sampleCount[i][j]];
62            // Generate data for dataZ and dataA.
63            getPixelSampleData(i, j, dataZ, dataA);
64        }
65
66        file.writePixels (1);
67    }
68
69    for (int i = 0; i < height; i++)
70    {
71        for (int j = 0; j < width; j++)
72        {
73            delete[] dataZ[i][j];
74            delete[] dataA[i][j];
75        }
76    }
77}

The interface for deep scan line files is similar to scan line files. We added two new classes to deal with deep data: DeepFrameBuffer and DeepSlice. DeepFrameBuffer only accepts DeepSlice as its input, except that it accepts Slice for sample count slice. The first difference we see from the previous version is:

header.setType (DEEPSCANLINE);

where we set the type of the header to a predefine string DEEPSCANLINE, then we insert a sample count slice using insertSampleCountSlice(). After that, we insert a DeepSlice with deep z data. Notice that deep slices have three strides, one more than non-deep slices. The first two strides are used for the pointers in the array. Because the memory space for Array2D is contiguous, we can get the strides easily. The third stride is used for pixel samples. Because the data type is float (and we are not interleaving), the stride should be sizeof(float). If we name the stride for deep data samples sampleStride, then the memory address of the i-th sample of this channel in pixel (x, y) is

base +
   x * xStride +
   y * yStride +
   i * sampleStride

Because we may not know the data until we are going to write it, the deep data file must support postponed initialization, as shown in the example code. Another approach would be to prepare all the data first, and then write it all out at once.

Once the slices have been inserted, we get the sample count for each pixel, via a user-supplied getPixelSampleCount() function, and dynamically allocate memory for the Z and A channels. We then write to file in a line-by-line fashion and finally free the the intermediate data structures.

Reading a Deep Scan Line File

An example of reading a deep scan line file created by previous code.

 1void
 2readDeepScanLineFile (
 3    const char             filename[],
 4    Box2i&                 displayWindow,
 5    Box2i&                 dataWindow,
 6    Array2D<float*>&       dataZ,
 7    Array2D<half*>&        dataA,
 8    Array2D<unsigned int>& sampleCount)
 9{
10    DeepScanLineInputFile file (filename);
11
12    const Header& header = file.header ();
13    dataWindow           = header.dataWindow ();
14    displayWindow        = header.displayWindow ();
15
16    int width  = dataWindow.max.x - dataWindow.min.x + 1;
17    int height = dataWindow.max.y - dataWindow.min.y + 1;
18
19    sampleCount.resizeErase (height, width);
20
21    dataZ.resizeErase (height, width);
22    dataA.resizeErase (height, width);
23
24    DeepFrameBuffer frameBuffer;
25
26    frameBuffer.insertSampleCountSlice (Slice (
27        UINT,
28        (char*) (&sampleCount[0][0] - dataWindow.min.x - dataWindow.min.y * width),
29        sizeof (unsigned int) * 1,       // xStride
30        sizeof (unsigned int) * width)); // yStride
31
32    frameBuffer.insert (
33        "dataZ",
34        DeepSlice (
35            FLOAT,
36            (char*) (&dataZ[0][0] - dataWindow.min.x - dataWindow.min.y * width),
37
38            sizeof (float*) * 1,     // xStride for pointer array
39            sizeof (float*) * width, // yStride for pointer array
40            sizeof (float) * 1));    // stride for Z data sample
41
42    frameBuffer.insert (
43        "dataA",
44        DeepSlice (
45            HALF,
46            (char*) (&dataA[0][0] - dataWindow.min.x - dataWindow.min.y * width),
47            sizeof (half*) * 1,     // xStride for pointer array
48            sizeof (half*) * width, // yStride for pointer array
49            sizeof (half) * 1));    // stride for O data sample
50
51    file.setFrameBuffer (frameBuffer);
52
53    file.readPixelSampleCounts (dataWindow.min.y, dataWindow.max.y);
54
55    for (int i = 0; i < height; i++)
56    {
57        for (int j = 0; j < width; j++)
58        {
59
60            dataZ[i][j] = new float[sampleCount[i][j]];
61            dataA[i][j] = new half[sampleCount[i][j]];
62        }
63    }
64
65    file.readPixels (dataWindow.min.y, dataWindow.max.y);
66
67    for (int i = 0; i < height; i++)
68    {
69        for (int j = 0; j < width; j++)
70        {
71            delete[] dataZ[i][j];
72            delete[] dataA[i][j];
73        }
74    }
75}

The interface for deep scan line files is similar to scan line files. The main the difference is we use the sample count slice and deep data slices. To do this, we added a new method to read the sample count table from the file:

file.readPixelSampleCounts (dataWindow.min.y, dataWindow.max.y);

This method reads all pixel sample counts in the range [dataWindow.min.y, dataWindow.max.y], and stores the data to sample count slice in framebuffer.

ReadPixels() supports for postponed memory allocation.

Writing a Deep Tiled File

This example creates an deep tiled file with two channels. It demonstrates how to write a deep tiled file with two channels:

  1. Z, of type FLOAT, and is used for storing sample depth, and

  2. A, type HALF, and is used for storing sample opacity.

The size of the image is width by height pixels.

 1void
 2writeDeepTiledFile (
 3    const char filename[],
 4    Box2i      displayWindow,
 5    Box2i      dataWindow,
 6    int        tileSizeX,
 7    int        tileSizeY)
 8{
 9    int height = dataWindow.max.y - dataWindow.min.y + 1;
10    int width  = dataWindow.max.x - dataWindow.min.x + 1;
11
12    Header header (displayWindow, dataWindow);
13    header.channels ().insert ("Z", Channel (FLOAT));
14    header.channels ().insert ("A", Channel (HALF));
15    header.setType (DEEPTILE);
16    header.compression () = ZIPS_COMPRESSION;
17
18    header.setTileDescription (
19        TileDescription (tileSizeX, tileSizeY, ONE_LEVEL));
20
21    Array2D<float*> dataZ;
22    dataZ.resizeErase (height, width);
23
24    Array2D<half*> dataA;
25    dataA.resizeErase (height, width);
26
27    Array2D<unsigned int> sampleCount;
28    sampleCount.resizeErase (height, width);
29
30    DeepTiledOutputFile file (filename, header);
31
32    DeepFrameBuffer frameBuffer;
33
34    frameBuffer.insertSampleCountSlice (Slice (
35        UINT,
36        (char*) (&sampleCount[0][0] - dataWindow.min.x - dataWindow.min.y * width),
37        sizeof (unsigned int) * 1,       // xStride
38        sizeof (unsigned int) * width)); // yStride
39
40    frameBuffer.insert (
41        "Z",
42        DeepSlice (
43            FLOAT,
44            (char*) (&dataZ[0][0] - dataWindow.min.x - dataWindow.min.y * width),
45            sizeof (float*) * 1,     // xStride for pointer array
46            sizeof (float*) * width, // yStride for pointer array
47            sizeof (float) * 1));    // stride for samples
48
49    frameBuffer.insert (
50        "A",
51        DeepSlice (
52            HALF,
53            (char*) (&dataA[0][0] - dataWindow.min.x - dataWindow.min.y * width),
54            sizeof (half*) * 1,     // xStride for pointer array
55            sizeof (half*) * width, // yStride for pointer array
56            sizeof (half) * 1));    // stride for samples
57
58    file.setFrameBuffer (frameBuffer);
59
60    for (int j = 0; j < file.numYTiles (0); j++)
61    {
62        for (int i = 0; i < file.numXTiles (0); i++)
63        {
64            // Generate data for sampleCount, dataZ and dataA.
65            getSampleDataForTile (i, j, tileSizeX, tileSizeY, sampleCount, dataZ, dataA);
66            file.writeTile (i, j, 0);
67        }
68    }
69    
70    for (int i = 0; i < height; i++)
71    {
72        for (int j = 0; j < width; j++)
73        {
74            delete[] dataZ[i][j];
75            delete[] dataA[i][j];
76        }
77    }
78}

Here, getSampleCountForTile is a user-supplied function that sets each item in sampleCount array to the correct sampleCount for each pixel in the tile, and getSampleDataForTile is a user-supplied function that set the pointers in dataZ and dataA arrays to point to the correct data

The interface for deep tiled files is similar to tiled files. The differences are:

  • we set the type of the header to DEEPTILE

  • we use insertSampleCountSlice() to set sample count slice, and

  • we use DeepSlice instead of Slice to provide three strides needed by the library.

Also, we support postponed initialization.

Reading a Deep Tiled File

An example of reading a deep tiled file created by code explained in the Writing a Deep Tiled File section.

 1void
 2readDeepTiledFile (
 3    const char             filename[],
 4    Box2i&                 displayWindow,
 5    Box2i&                 dataWindow,
 6    Array2D<float*>&       dataZ,
 7    Array2D<half*>&        dataA,
 8    Array2D<unsigned int>& sampleCount)
 9{
10    DeepTiledInputFile file (filename);
11
12    int width  = dataWindow.max.x - dataWindow.min.x + 1;
13    int height = dataWindow.max.y - dataWindow.min.y + 1;
14
15    sampleCount.resizeErase (height, width);
16    dataZ.resizeErase (height, width);
17    dataA.resizeErase (height, width);
18
19    DeepFrameBuffer frameBuffer;
20
21    frameBuffer.insertSampleCountSlice (Slice (
22        UINT,
23        (char*) (&sampleCount[0][0] - dataWindow.min.x - dataWindow.min.y * width),
24        sizeof (unsigned int) * 1,       // xStride
25        sizeof (unsigned int) * width)); // yStride
26
27    frameBuffer.insert (
28        "Z",
29        DeepSlice (
30            FLOAT,
31            (char*) (&dataZ[0][0] - dataWindow.min.x - dataWindow.min.y * width),
32            sizeof (float*) * 1,     // xStride for pointer array
33            sizeof (float*) * width, // yStride for pointer array
34            sizeof (float) * 1));    // stride for samples
35
36    frameBuffer.insert (
37        "A",
38        DeepSlice (
39            HALF,
40            (char*) (&dataA[0][0] - dataWindow.min.x - dataWindow.min.y * width),
41            sizeof (half*) * 1,     // xStride for pointer array
42            sizeof (half*) * width, // yStride for pointer array
43            sizeof (half) * 1));    // stride for samples
44
45    file.setFrameBuffer (frameBuffer);
46
47    int numXTiles = file.numXTiles (0);
48    int numYTiles = file.numYTiles (0);
49
50    file.readPixelSampleCounts (0, numXTiles - 1, 0, numYTiles - 1);
51
52    for (int i = 0; i < height; i++)
53    {
54        for (int j = 0; j < width; j++)
55        {
56            dataZ[i][j] = new float[sampleCount[i][j]];
57            dataA[i][j] = new half[sampleCount[i][j]];
58        }
59    }
60
61    file.readTiles (0, numXTiles - 1, 0, numYTiles - 1);
62
63    // (after read data is processed, data must be freed:)
64
65    for (int i = 0; i < height; i++)
66    {
67        for (int j = 0; j < width; j++)
68        {
69            delete[] dataZ[i][j];
70            delete[] dataA[i][j];
71        }
72    }
73}

This code demonstrates how to read the first level of a deep tiled file created by code explained in the Writing a Deep Tiled File section. The interface for deep tiled files is similar to tiled files. The differences are:

  • we use insertSampleCountSlice() to set sample count slice

  • we use DeepSlice instead of Slice to provide three strides needed by the library, and

  • we use readPixelSampleCounts() to read in pixel sample counts into array.

Also we support postponed memory allocation.

In this example, entries in dataZ and dataA have been allocated by the ‘new’ calls must be deleted after use.

Threads

Library Thread-Safety

The OpenEXR library is thread-safe. In a multithreaded application program, multiple threads can concurrently read and write distinct OpenEXR files. In addition, accesses to a single shared file by multiple application threads are automatically serialized. In other words, each thread can independently create, use and destroy its own input and output file objects. Multiple threads can also share a single input or output file. In the latter case the OpenEXR library uses mutual exclusion to ensure that only one thread at a time can access the shared file.

Multithreaded I/O

The OpenEXR library supports multithreaded file input and output where the library creates its own worker threads that are independent of the application program’s threads. When an application thread calls readPixels(), readTiles(), writePixels() or writeTiles() to read or write multiple scan lines or tiles at once, the library’s worker threads process the tiles or scanlines in parallel.

During startup, the application program must enable multithreading by calling function setGlobalThreadCount(). This tells the OpenEXR library how many worker threads it should create. (As a special case, setting the number of worker threads to zero reverts to single-threaded operation; reading and writing image files happens entirely in the application thread that calls the OpenEXR library.)

The application program should read or write as many scan lines or tiles as possible in each call to readPixels(), readTiles(), writePixels() or writeTiles(). This allows the library to break up the work into chunks that can be processed in parallel. Ideally the application reads or writes the entire image using a single read or write call. If the application reads or writes the image one scan line or tile at a time, the library reverts to single-threaded file I/O.

The following function writes an RGBA file using four concurrent worker threads:

1void
2writeRgbaMT (const char fileName[], const Rgba* pixels, int width, int height)
3{
4    setGlobalThreadCount (4);
5
6    RgbaOutputFile file (fileName, width, height, WRITE_RGBA);
7    file.setFrameBuffer (pixels, 1, width);
8    file.writePixels (height);
9}

Except for the call to setGlobalThreadCount(), function writeRgbaMT() is identical to function writeRgba1() in Writing an RGBA Image File, but on a computer with multiple processors writeRgbaMT() writes files significantly faster than writeRgba1().

Multithreaded I/O, Multithreaded Application Program

Function setGlobalThreadCount() creates a global pool of worker threads inside the OpenEXR library. If an application program has multiple threads, and those threads read or write several OpenEXR files at the same time, then the worker threads must be shared among the application threads. By default each file will attempt to use the entire worker thread pool for itself. If two files are read or written simultaneously by two application threads, then it is possible that all worker threads perform I/O on behalf of one of the files, while I/O for the other file is stalled.

In order to avoid this situation, the constructors for input and output file objects take an optional numThreads argument. This gives the application program more control over how many threads will be kept busy reading or writing a particular file.

For example, we may have an application program that runs on a four-processor computer. The program has one thread that reads files and another one that writes files. We want to keep all four processors busy, and we want to split the processors evenly between input and output. Before creating the input and output threads, the application instructs the OpenEXR library to create four worker threads:

// main, before application threads are created:

setGlobalThreadCount (4);

In the input and output threads, input and output files are opened with numThreads set to 2:

// application's input thread

InputFile in (fileName);

// ...
// application's output thread

OutputFile out (fileName, header, 2);

// ...

This ensures that file input and output in the application’s two threads can proceed concurrently, without one thread stalling the other’s I/O.

An alternative approach for thread management of multithreaded applications is provided for deep scanline input files. Rather than calling setFrameBuffer(), the host application may call rawPixelData() to load a chunk of scanlines into a host-application managed memory store, then pass a DeepFrameBuffer object and the raw data to readPixelSampleCounts() and readPixels(). Only the call to rawPixelData blocks; decompressing the underlying data and copying it to the framebuffer will happen on the host application’s threads independently. This strategy is generally ``less efficient`` than reading multiple scanlines at the same time and allowing OpenEXR’s thread management to decode the file, but may prove effective when the host application has many threads available, cannot avoid accessing scanlines in a random order and wishes to avoid caching an entire uncompressed image. For more details, refer to the inline comments in ImfDeepScanLineInputFile.h

Low-Level I/O

Custom Low-Level File I/O

In all of the previous file reading and writing examples, we were given a file name, and we relied on the constructors for our input file or output file objects to open the file. In some contexts, for example, in a plugin for an existing application program, we may have to read from or write to a file that has already been opened. The representation of the open file as a C or C++ data type depends on the application program and on the operating system.

At its lowest level, the OpenEXR library performs file I/O via objects of type IStream and OStream. IStream and OStream are abstract base classes. The OpenEXR library contains two derived classes, StdIFStream and StdOFStream, that implement reading from std::ifstream and writing to std::ofstream objects. An application program can implement alternative file I/O mechanisms by deriving its own classes from Istream and Ostream. This way, OpenEXR images can be stored in arbitrary file-like objects, as long as it is possible to support read, write, seek and tell operations with semantics similar to the corresponding std::ifstream and std::ofstream methods.

For example, assume that we want to read an OpenEXR image from a C stdio file (of type FILE) that has already been opened. To do this, we derive a new class, C_IStream, from IStream. The declaration of class IStream looks like this:

 1class IStream
 2{
 3  public:
 4    virtual ~IStream ();
 5
 6    virtual bool read (char c[], int n) = 0;
 7    virtual uint64_t tellg () = 0;
 8    virtual void seekg (uint64_t pos) = 0;
 9    virtual void clear ();
10    const char * fileName () const;
11    virtual bool isMemoryMapped () const;
12    virtual char * readMemoryMapped (int n);
13
14  protected:
15    IStream (const char fileName[]);
16    private:
17
18    // ...
19};
20    

Our derived class needs a public constructor, and it must override four methods:

 1class C_IStream: public IStream
 2{
 3  public:
 4    C_IStream (FILE *file, const char fileName[]):
 5        IStream (fileName), _file (file) {}
 6
 7    virtual bool read (char c[], int n);
 8    virtual uint64_t tellg ();
 9    virtual void seekg (uint64_t pos);
10    virtual void clear ();
11
12  private:
13
14    FILE * _file;
15};

read(c,n) reads n bytes from the file, and stores them in array c. If reading hits the end of the file before n bytes have been read, or if an I/O error occurs, read(c,n) throws an exception. If read(c,n) hits the end of the file after reading n bytes, it returns false, otherwise it returns true:

 1bool
 2C_IStream::read (char c[], int n)
 3{
 4    if (n != static_cast <int> (fread (c, 1, n, _file)))
 5    {
 6        // fread() failed, but the return value does not distinguish
 7        // between I/O errors and end of file, so we call ferror() to
 8        // determine what happened.
 9    
10        if (ferror (_file))
11            throwErrnoExc();
12        else
13            throw InputExc ("Unexpected end of file.");
14    }
15    
16    return !feof (_file);
17}

tellg() returns the current reading position, in bytes, from the beginning of the file. The next read() call will begin reading at the indicated position:

1uint64_t
2C_IStream::tellg ()
3{
4    return ftell (_file);
5}

seekg(pos) sets the current reading position to pos bytes from the beginning of the file:

1void
2C_IStream::seekg (uint64_t pos)
3{
4    clearerr (_file);
5    fseek (_file, pos, SEEK_SET);
6}

clear() clears any error flags that may be set on the file after a read() or seekg() operation has failed:

1void
2C_IStream::clear ()
3{
4    clearerr (_file);
5}

In order to read an RGBA image from an open C stdio file, we first make a C_IStream object. Then we create an RgbaInputFile, passing the C_IStream instead of a file name to the constructor. After that, we read the image as usual (see Reading an RGBA Image File):

 1void
 2readRgbaFILE (
 3    FILE*          cfile,
 4    const char     fileName[],
 5    Array2D<Rgba>& pixels,
 6    int&           width,
 7    int&           height)
 8{
 9    C_IStream istr (cfile, fileName);
10
11    RgbaInputFile file (istr);
12
13    Box2i dw = file.dataWindow ();
14
15    width  = dw.max.x - dw.min.x + 1;
16    height = dw.max.y - dw.min.y + 1;
17    pixels.resizeErase (height, width);
18
19    file.setFrameBuffer (&pixels[0][0] - dw.min.x - dw.min.y * width, 1, width);
20
21    file.readPixels (dw.min.y, dw.max.y);
22}

Memory-Mapped I/O

When the OpenEXR library reads an image file, pixel data are copied several times on their way from the file to the application’s frame buffer. For compressed files, the time spent copying is usually not significant when compared to how long it takes to uncompress the data. However, when uncompressed image files are being read from a fast file system, it may be advantageous to eliminate one or two copy operations by using memory-mapped I/O.

Memory-mapping establishes a relationship between a file and a program’s virtual address space, such that from the program’s point of view the file looks like an array of type char. The contents of the array match the data in the file. This allows the program to access the data in the file directly, bypassing any copy operations associated with reading the file via a C++ std::ifstream or a C FILE.

Note that the following examples use POSIX memory mapping, not supported on Windows.

Classes derived from IStream can optionally support memory-mapped input. In order to do this, a derived class must override two virtual functions, isMemoryMapped() and readMemoryMapped(), in addition to the functions needed for regular, non-memory-mapped input:

 1class MemoryMappedIStream: public IStream
 2{
 3  public:
 4    MemoryMappedIStream (const char fileName[]);
 5
 6    virtual ~MemoryMappedIStream ();
 7
 8    virtual bool isMemoryMapped () const;
 9    virtual char * readMemoryMapped (int n);
10    virtual bool read (char c[], int n);
11    virtual uint64_t tellg ();
12
13    virtual void seekg (uint64_t pos);
14
15  private:
16
17    char * _buffer;
18    uint64_t _fileLength;
19    uint64_t _readPosition;
20};

The constructor for class MemoryMappedIStream maps the contents of the input file into the program’s address space. Memory mapping is not portable across operating systems. The example shown here uses the POSIX mmap() system call. On Windows files can be memory-mapped by calling CreateFileMapping() and MapViewOfFile():

 1MemoryMappedIStream::MemoryMappedIStream (const char fileName[])
 2   : IStream (fileName),
 3     _buffer (0),
 4     _fileLength (0),
 5     _readPosition (0)
 6{
 7    int file = open (fileName, O_RDONLY);
 8
 9    if (file < 0)
10        THROW_ERRNO ("Cannot open file \"" << fileName << "\".");
11
12    struct stat stat;
13    fstat (file, &stat);
14
15    _fileLength = stat.st_size;
16
17    _buffer = (char *) mmap (0, _fileLength, PROT_READ, MAP_PRIVATE, file, 0);
18
19    close (file);
20
21    if (_buffer == MAP_FAILED)
22        THROW_ERRNO ("Cannot memory-map file \"" << fileName << "\".");
23}

The destructor frees the address range associated with the file by un-mapping the file. The POSIX version shown here uses munmap(). A Windows version would call UnmapViewOfFile() and CloseHandle():

1bool
2MemoryMappedIStream::isMemoryMapped () const
3{
4    return true;
5}

Function isMemoryMapped() returns true to indicate that memory-mapped input is supported. This allows the OpenEXR library to call readMemoryMapped() instead of read():

1MemoryMappedIStream::~MemoryMappedIStream()
2{
3    munmap (_buffer, _fileLength);
4}

readMemoryMapped() is analogous to read(), but instead of copying data into a buffer supplied by the caller, readMemoryMapped() returns a pointer into the memory-mapped file, thus avoiding the copy operation:

 1char *
 2MemoryMappedIStream::readMemoryMapped (int n)
 3{
 4    if (_readPosition >= _fileLength)
 5        throw InputExc ("Unexpected end of file.");
 6
 7    if (_readPosition + n > _fileLength)
 8        throw InputExc ("Reading past end of file.");
 9
10    char *data = _buffer + _readPosition;
11
12    _readPosition += n;
13
14    return data;
15
16}

The MemoryMappedIStream class must also implement the regular read() function, as well as tellg() and seekg():

 1bool
 2MemoryMappedIStream::read (char c[], int n)
 3{
 4    if (_readPosition >= _fileLength)
 5        throw InputExc ("Unexpected end of file.");
 6    
 7    if (_readPosition + n > _fileLength)
 8        throw InputExc ("Reading past end of file.");
 9
10    memcpy (c, _buffer + _readPosition, n);
11
12    _readPosition += n;
13
14    return _readPosition < _fileLength;
15
16}
17
18uint64_t
19MemoryMappedIStream::tellg ()
20{
21    return _readPosition;
22}
23
24void
25MemoryMappedIStream::seekg (uint64_t pos)
26{
27    _readPosition = pos;
28}

Class MemoryMappedIStream does not need a clear() function. Since the memory-mapped file has no error flags that need to be cleared, the clear() method provided by class IStream, which does nothing, can be re-used.

Memory-mapping a file can be faster than reading the file via a C++ std::istream or a C FILE, but the extra speed comes at a cost. A large memory-mapped file can occupy a significant portion of a program’s virtual address space. In addition, mapping and un-mapping many files of varying sizes can severely fragment the address space. After a while, the program may be unable to map any new files because there is no contiguous range of free addresses that would be large enough hold a file, even though the total amount of free space would be sufficient. An application program that uses memory-mapped I/O should manage its virtual address space in order to avoid fragmentation. For example, the program can reserve several address ranges, each one large enough to hold the largest file that the program expects to read. The program can then explicitly map each new file into one of the reserved ranges, keeping track of which ranges are currently in use.

Miscellaneous

Is this an OpenEXR File?

Sometimes we want to test quickly if a given file is an OpenEXR file. This can be done by looking at the beginning of the file: The first four bytes of every OpenEXR file contain the 32-bit integer “magic number” 20000630 in little-endian byte order. After reading a file’s first four bytes via any of the operating system’s standard file I/O mechanisms, we can compare them with the magic number by explicitly testing if the bytes contain the values 0x76, 0x2f, 0x31, and 0x01.

Given a file name, the following function returns true if the corresponding file exists, is readable, and contains an OpenEXR image:

 1bool
 2isThisAnOpenExrFile (const char fileName[])
 3{
 4    std::ifstream f (fileName, std::ios_base::binary);
 5    
 6    char b[4];
 7    f.read (b, sizeof (b));
 8    
 9    return !!f && b[0] == 0x76 && b[1] == 0x2f && b[2] == 0x31 && b[3] == 0x01;
10}

Using this function does not require linking with the OpenEXR library.

Programs that are linked with the OpenEXR library can determine if a given file is an OpenEXR file by calling one of the following functions, which are part of the library:

 1bool isOpenExrFile (const char fileName[], bool &isTiled);
 2    
 3bool isOpenExrFile (const char fileName[]);
 4    
 5bool isTiledOpenExrFile (const char fileName[]);
 6    
 7bool isOpenExrFile (IStream &is, bool &isTiled);
 8    
 9bool isOpenExrFile (IStream &is);
10    
11bool isTiledOpenExrFile (IStream &is);

Is this File Complete?

Sometimes we want to test if an OpenEXR file is complete. The file may be missing pixels, either because writing the file is still in progress or because writing was aborted before the last scan line or tile was stored in the file. Of course, we could test if a given file is complete by attempting to read the entire file, but the input file classes in the OpenEXR library have an isComplete() method that is faster and more convenient.

The following function returns true or false, depending on whether a given OpenEXR file is complete or not:

1bool
2isComplete (const char fileName[])
3{
4    InputFile in (fileName);
5    return in.isComplete();
6}

Preview Images

Graphical user interfaces for selecting image files often represent files as small preview or thumbnail images. In order to make loading and displaying the preview images fast, OpenEXR files support storing preview images in the file headers.

A preview image is an attribute whose value is of type PreviewImage. A PreviewImage object is an array of pixels of type PreviewRgba. A pixel has four components, r, g, b and a, of type unsigned char, where r, g and b are the pixel’s red, green and blue components, encoded with a gamma of 2.2. a is the pixel’s alpha channel; r, g and b should be premultiplied by a. On a typical display with 8-bits per component, the preview image can be shown by simply loading the r, g and b components into the display’s frame buffer. (No gamma correction or tone mapping is required.)

The code fragment below shows how to test if an OpenEXR file has a preview image, and how to access a preview image’s pixels:

 1RgbaInputFile file (fileName);
 2
 3if (file.header().hasPreviewImage())
 4{
 5    const PreviewImage &preview = file.header().previewImage();
 6
 7    for (int y = 0; y < preview.height(); ++y)
 8    {
 9        for (int x = 0; x < preview.width(); ++x)
10        {
11
12            const PreviewRgba &pixel = preview.pixel (x, y);
13
14            // ...
15
16        }
17    }
18}

Writing an OpenEXR file with a preview image is shown in the following example. Since the preview image is an attribute in the file’s header, it is entirely separate from the main image. Here the preview image is a smaller version of the main image, but this is not required; in some cases storing an easily recognizable icon may be more appropriate. This example uses the RGBA-only interface to write a scan line based file, but preview images are also supported for files that are written using the general interface, and for tiled files.

 1void
 2writeRgbaWithPreview1 (
 3    const char fileName[], const Array2D<Rgba>& pixels, int width, int height)
 4{
 5    Array2D<PreviewRgba> previewPixels; // 1
 6
 7    int previewWidth;  // 2
 8    int previewHeight; // 3
 9
10    makePreviewImage (
11        pixels,
12        width,
13        height, // 4
14        previewPixels,
15        previewWidth,
16        previewHeight);
17
18    Header header (width, height); // 5
19    header.setPreviewImage (
20        PreviewImage (previewWidth, previewHeight, &previewPixels[0][0]));
21
22    RgbaOutputFile file (fileName, header, WRITE_RGBA); // 7
23    file.setFrameBuffer (&pixels[0][0], 1, width);      // 8
24    file.writePixels (height);                          // 9
25}

Lines 7 through 12 generate the preview image. Line 5 creates a header for the image file. Line 16 converts the preview image into a PreviewImage attribute, and adds the attribute to the header. Lines 18 through 20 store the header (with the preview image) and the main image in a file.

Function makePreviewImage(), called on line 12, generates the preview image by scaling the main image down to one eighth of its original width and height:

 1void
 2makePreviewImage (
 3    const Array2D<Rgba>&  pixels,
 4    int                   width,
 5    int                   height,
 6    Array2D<PreviewRgba>& previewPixels,
 7    int&                  previewWidth,
 8    int&                  previewHeight)
 9{
10    const int N = 8;
11
12    previewWidth  = width / N;
13    previewHeight = height / N;
14
15    previewPixels.resizeErase (previewHeight, previewWidth);
16
17    for (int y = 0; y < previewHeight; ++y)
18    {
19        for (int x = 0; x < previewWidth; ++x)
20        {
21
22            const Rgba&  inPixel  = pixels[y * N][x * N];
23            PreviewRgba& outPixel = previewPixels[y][x];
24
25            outPixel.r = gamma (inPixel.r);
26            outPixel.g = gamma (inPixel.g);
27            outPixel.b = gamma (inPixel.b);
28            outPixel.a = static_cast<int> (Imath::clamp (inPixel.a * 255.f, 0.f, 255.f) + 0.5f);
29        }
30    }
31}

To make this example easier to read, scaling the image is done by just sampling every eighth pixel of every eighth scan line. This can lead to aliasing artifacts in the preview image; for a higher-quality preview image, the main image should be lowpass-filtered before it is subsampled.

Function makePreviewImage() calls gamma() to convert the floating-point red, green, and blue components of the sampled main image pixels to unsigned char values. gamma() is a simplified version of what a program should do on order to show an OpenEXR image’s floating-point pixels on the screen:

1unsigned char
2gamma (float x)
3{
4    x = pow (5.5555f * max (0.f, x), 0.4545f) * 84.66f;
5    return (unsigned char) Imath::clamp (x, 0.f, 255.f);
6}

makePreviewImage() converts the pixels’ alpha component to unsigned char by by linearly mapping the range [0.0, 1.0] to [0,255].

Some programs write image files one scan line or tile at a time, while the image is being generated. Since the image does not yet exist when the file is opened for writing, it is not possible to store a preview image in the file’s header at this time (unless the preview image is an icon that has nothing to do with the main image). However, it is possible to store a blank preview image in the header when the file is opened. The preview image can then be updated as the pixels become available. This is demonstrated in the following example:

 1void
 2writeRgbaWithPreview2 (const char fileName[], int width, int height)
 3{
 4    Array<Rgba> pixels (width);
 5
 6    const int N             = 8;
 7    int       previewWidth  = width / N;
 8    int       previewHeight = height / N;
 9
10    Array2D<PreviewRgba> previewPixels (previewHeight, previewWidth);
11
12    Header header (width, height);
13    header.setPreviewImage (PreviewImage (previewWidth, previewHeight));
14
15    RgbaOutputFile file (fileName, header, WRITE_RGBA);
16    file.setFrameBuffer (pixels, 1, 0);
17
18    for (int y = 0; y < height; ++y)
19    {
20        generatePixels (pixels, width, height, y);
21
22        file.writePixels (1);
23
24        if (y % N == 0)
25        {
26            for (int x = 0; x < width; x += N)
27            {
28                const Rgba&  inPixel  = pixels[x];
29                PreviewRgba& outPixel = previewPixels[y / N][x / N];
30
31                outPixel.r = gamma (inPixel.r);
32                outPixel.g = gamma (inPixel.g);
33                outPixel.b = gamma (inPixel.b);
34                outPixel.a = int (Imath::clamp (inPixel.a * 255.f, 0.f, 255.f) + 0.5f);
35            }
36        }
37    }
38
39    file.updatePreviewImage (&previewPixels[0][0]);
40}

Environment Maps

An environment map is an image that represents an omnidirectional view of a three-dimensional scene as seen from a particular 3D location. Every pixel in the image corresponds to a 3D direction, and the data stored in the pixel represent the amount of light arriving from this direction. In 3D rendering applications, environment maps are often used for image-based lighting techniques that approximate how objects are illuminated by their surroundings. Environment maps with enough dynamic range to represent even the brightest light sources in the environment are sometimes called “light probe images.”

In an OpenEXR file, an environment map is stored as a rectangular pixel array, just like any other image, but an attribute in the file header indicates that the image is an environment map. The attribute’s value, which is of type Envmap, specifies the relation between 2D pixel locations and 3D directions. Envmap is an enumeration type. Two values are possible:

ENVMAP_LATLONG

Latitude-Longitude Map The environment is projected onto the image using polar coordinates (latitude and longitude). A pixel’s x coordinate corresponds to its longitude, and the y coordinate corresponds to its latitude. The pixel in the upper left corner of the data window has latitude +π/2 and longitude +π; the pixel in the lower right corner has latitude -π/2 and longitude -π.

In 3D space, latitudes -π/2 and +π/2 correspond to the negative and positive y direction. Latitude 0, longitude 0 points in the positive z direction; latitude 0, longitude π/2 points in the positive x direction.

For a latitude-longitude map, the size of the data window should be 2×N by N pixels (width by height), where N can be any integer greater than 0.

_images/latlong.png

ENVMAP_CUBE

Cube Map The environment is projected onto the six faces of an axis-aligned cube. The cube’s faces are then arranged in a 2D image as shown below.

For a cube map, the size of the data window should be N by 6×N pixels (width by height), where N can be any integer greater than 0.

_images/envcube.png

Note: Both kinds of environment maps contain redundant pixels: In a latitude-longitude map, the top row and the bottom row of pixels correspond to the map’s north pole and south pole (latitudes +π/2 and -π/2). In each of those two rows all pixels are the same. The leftmost column and the rightmost column of pixels both correspond to the meridian with longitude +π (or, equivalently, -π). The pixels in the leftmost column are repeated in the rightmost column. In a cube-face map, the pixels along each edge of a face are repeated along the corresponding edge of the adjacent face. The pixel in each corner of a face is repeated in the corresponding corners of the two adjacent faces.

The following code fragment tests if an OpenEXR file contains an environment map, and if it does, which kind:

1RgbaInputFile file (fileName);
2
3if (hasEnvmap (file.header()))
4{
5    Envmap type = envmap (file.header());
6    // ...
7}

For each kind of environment map, the OpenEXR library provides a set of routines that convert from 3D directions to 2D floating-point pixel locations and back. Those routines are useful in application programs that create environment maps and in programs that perform map lookups. For details, see the header file ImfEnvmap.h.

Compression

Data written to OpenEXR files can be compressed using one of several compression algorithms.

To specify the compression algorithm, set the compression() value on the Header object:

Header header (width, height);
header.channels().insert ("G", Channel (HALF));
header.channels().insert ("Z", Channel (FLOAT));
header.compression() = ZIP_COMPRESSION;

Supported compression types are:

RLE_COMPRESSION

run length encoding

ZIPS_COMPRESSION

zlib compression, one scan line at a time

ZIP_COMPRESSION

zlib compression, in blocks of 16 scan lines

PIZ_COMPRESSION

piz-based wavelet compression

PXR24_COMPRESSION

lossy 24-bit float compression

B44_COMPRESSION

lossy 4-by-4 pixel block compression, fixed compression rate

B44A_COMPRESSION

lossy 4-by-4 pixel block compression, flat fields are compressed more

DWAA_COMPRESSION

lossy DCT based compression, in blocks of 32 scanlines. More efficient for partial buffer access.

DWAB_COMPRESSION

lossy DCT based compression, in blocks of 256 scanlines. More efficient space-wise and faster to decode full frames than DWAA_COMPRESSION.

ZIP_COMPRESSION and DWA compression compress to a user-controllable compression level, which determines the space/time tradeoff. You can control these levels either by setting a global default or by setting the level directly on the Header object.

setDefaultZipCompressionLevel (6);
setDefaultDwaCompressionLevel (45.0f);

The default zip compression level is 4 for OpenEXR v3.1.3+ and 6 for previous versions. The default DWA compression level is 45.0f.

Alternatively, set the compression level on the Header object:

Header header (width, height);
header.channels().insert ("G", Channel (HALF));
header.channels().insert ("Z", Channel (FLOAT));
header.compression() = ZIP_COMPRESSION;
header.zipCompressionLevel() = 6;