Help Shape the Future of Space Exploration

Join The Planetary Society Now  arrow.png

Join our eNewsletter for updates & action alerts

    Please leave this field empty

Headshot of Emily Lakdawalla

Image processing trick: Removing interline transfer smear from Curiosity photos

Posted by Emily Lakdawalla

01-05-2014 15:27 CDT

Topics: pretty pictures, pics of spacecraft in space, amateur image processing, spacecraft, Mars, Curiosity (Mars Science Laboratory), explaining image processing

Over the weekend, Curiosity took a set of 75 photos with her arm-mounted MAHLI camera, enough to produce a spectacular new self-portrait of the rover sitting at the Kimberley, prepared to drill at Windjana. I absolutely love this new self-portrait; it contains everything you'd want. There's the rover, Mount Sharp, beautiful rover tracks, beautiful outcrop, a mound in the middle distance, and the walls of Gale crater quite clear in the background. They even shot it with the head in two different positions, so you can choose to assemble it either with the head facing you or gazing down at the outcrop. I am pretty sure some version of it will end up on the cover of my book.

Here are the component images for the mosaic. Reminds me of a David Hockney collage! I wrote an earlier blog entry about how Curiosity takes these self-portraits.

Curiosity sol 613 MAHLI self-portrait: component images

NASA / JPL / MSSS / Emily Lakdawalla

Curiosity sol 613 MAHLI self-portrait: component images
Curiosity's arm-mounted MAHLI camera took 75 individual photos in order to cover the entire rover (with mast head in two different positions) as well as the east side of the Kimberley field site and Mount Sharp in the background.

I'm not going to post a fully-assembled version here yet, because it's still a work in progress. I want to give the amateur -- and professional! -- community more time to produce what I think will be the definitive version. In the meantime, here is a partial version that I made for my desktop:

Curiosity sol 613 MAHLI self-portrait: desktop background

NASA / JPL / MSSS / Emily Lakdawalla

Curiosity sol 613 MAHLI self-portrait: desktop background
Curiosity captured this view of itself at the Kimberley on sol 613 (April 27, 2014), as it prepared to drill at Windjana.

The folks over at have been working on it, with a variety of different results. My favorite, so far, is this one by Doug Ellison. One of the reason's I like Doug's so much is because he's made the effort to correct a problem with one of the original frames.

You can see the problem in this super-cool animated GIF that James Sorenson put together, an animation of the head in its two positions.

Curiosity sol 613 self-portrait animation

NASA / JPL / MSSS / James Sorenson

Curiosity sol 613 self-portrait animation
On sol 613, Curiosity captured a new MAHLI self-portrait at the Kimberley. The self-portrait included images shot with the mast head in two different positions.

If you look at the back end of the rover, you'll see a blur, as though the rover were racing toward you. That's not motion blur; it's something called interline transfer smear. Here is a great explanation of interline transfer smear from a company that builds cameras (though not the Curiosity cameras, those were made by Malin Space Science Systems):

On the interline transfer CCDs used in many Point Grey cameras, each pixel consists of a light sensitive area, called the photosensor, and a light-shielded area, called the vertical transfer register. The vertical transfer register is used to shift the charge out of the photosensor and off of the sensor. Although vertical transfer cells are approximately 100,000 times less sensitive than the light sensitive region, photons may still tunnel into this area, especially when exposed to very bright light. This tunneling, or leaking, is the source of smear.

During image readout, image pixels are shifted vertically downard, row by row, through the vertical transfer cells to the readout register. If there is any leakage of charge into an area of the vertical transfer register, it will be picked up and shifted downward, so that every pixel above and below the area will contain this extra charge. The result is a relatively bright vertical stripe across the entire image.

The smear in the Curiosity self-portrait is almost entirely contained on a single frame of the mosaic:




It's fairly easy to use Photoshop to remove this smear from this frame before you assemble the mosaic. Here's a link to a de-smeared version, and here is a before-and-after comparison:

Image processing: fixing interline transfer smear: before and after

I was having a hard time putting an explanation in words, so I just decided to record it. It worked even though I had to keep telling my computer to stop worrying about not having enough resources. Enjoy!

Image processing: fixing interline transfer smear
An explainer on using Photoshop to remove interline transfer smear from MAHLI or Mastcam image frames.

Note: one step you may not get in the tutorial is how I link the adjustment layer just to the layer I'm subtracting from the original. After you add an adjustment layer, Control-click on the line between the adjustment layer and the layer immediately below it, and that will make the adjustment layer apply only to the layer immediately below it rather than to the entire image, as would be the default.

See other posts from May 2014


Or read more blog entries about: pretty pictures, pics of spacecraft in space, amateur image processing, spacecraft, Mars, Curiosity (Mars Science Laboratory), explaining image processing


Stephen Van Vuuren: 05/01/2014 08:21 CDT

Nicely done. That was a trick I was not familiar with.

Donald Morrow: 05/05/2014 06:58 CDT

As a part time amateur photographer, I have used PhotoShop (probably more than I should). It is quite the powerful and complex tool. Do students studying astronomy take classes in PhotoShop? It seems the more I learn about astro-photography, the more I realize the PhotoShop is just a much a part of it as it is a part of down to earth photography. What's more, it seems that PhotoShop plays a role in the science of the photography quite a lot too. It's not just about removing a stray hair or slimming up a model.

Leave a Comment:

You must be logged in to submit a comment. Log in now.
Facebook Twitter Email RSS AddThis

Blog Search

Planetary Defense

An asteroid or comet headed for Earth is the only large-scale natural disaster we can prevent. Working together to fund our Shoemaker NEO Grants for astronomers, we can help save the world.


Featured Images

LightSail 2 and Prox-1
Bill Nye at LightSail 2 pre-ship review
LightSail 2 pre-ship review team photo
Swirling maelstrom
More Images

Featured Video

Class 9: Saturn, Uranus, and Neptune

Watch Now

Space in Images

Pretty pictures and
awe-inspiring science.

See More

Join The Planetary Society

Let’s explore the cosmos together!

Become a Member

Connect With Us

Facebook, Twitter, YouTube and more…
Continue the conversation with our online community!