Help Shape the Future of Space Exploration

Join The Planetary Society Now  arrow.png

Join our eNewsletter for updates & action alerts

    Please leave this field empty

Jason Davis headshot v.3

Surveyor Digitization Project Hints at Long-Lost Lunar Treasures

Posted by Jason Davis

23-11-2015 10:36 CST

Topics: NASA lunar missions before 2005, history, the Moon

A project to digitize more than 90,000 images taken by NASA’s five Surveyor spacecraft in the 1960s has revealed early hints of never-before-seen treasures captured by America’s first robotic lunar landers. 

Scientists at the University of Arizona Lunar and Planetary Laboratory started scanning the original Surveyor film reels in March, and finished up last week. The Surveyors were NASA's first probes to soft-land on the moon, and as little as 2 percent of their images have ever been seen. A set of the program's original film reels has been stored at the Lunar and Planetary Laboratory for decades.

The project team is now starting the arduous task of formatting the images for submission to NASA’s Planetary Data System, the agency's master archive of space imagery. After that, anyone will be able to browse and download the pictures for free.

The team hasn’t had much time to play with the images they've scanned during the eight-month process—the emphasis thus far has been the tedious task of digitizing the data. Scanning took place inside a clean room built at the Lunar and Planetary Laboratory. The fifty-year-old film reels are in good shape, but Shane Byrne, the project's principal investigator, wanted to get the pictures scanned as soon as possible.

"At a fundamental level, this is like a rescue operation," Byrne said. "The most important thing is to get the frames digital and freeze them so they don’t decay any more."

Surveyor film reels

Jason Davis / The Planetary Society

Surveyor film reels
Film canisters containing images from the Surveyor program, stored at the University of Arizona Lunar and Planetary Laboratory.

Last week, John Anderson, a media technician working on the project, loaded the final reel of film onto an automated scanning machine on loan from Austin, Texas-based Stokes Imaging. The reel contained a series of calibration images taken at Cape Canaveral before one of the Surveyor probes launched.

"It’s been in the can awhile," Anderson said, during a team meeting. "The film is curled as you take it off the roll." In the clean room, I watched him mount the reel onto a spindle, unroll the film between two pieces of glass, and attach it to an empty reel. A bright light was positioned under the two pieces of glass, and an overhead camera snapped an image of each backlit photo as the film gently spooled through, stopping one frame at a time. Anderson observed the process carefully, occasionally fine-tuning each frame before the shutter clicked. 

It was a tedious process. The bulk of the scanning was done by Anderson, LPL's Maria Schuchardt, and a graduate student that pitched in earlier during the project. The team originally estimated there were 87,000 images, but they acquired more reels from NASA’s Goddard Space Flight Center in Maryland, bringing the total up to about 93,700. Of those images, Anderson estimates 92,000 are usable, valid pictures from the lunar surface. 

I asked Anderson for the size of the raw image cache. Sitting behind a dual-screen Apple computer in LPL's Space Imagery Center, he selected the project folders and tried to open a properties window to get the number. We waited for several minutes as the computer's hard drives grinded away, struggling to come up with an estimate. We finally gave up. (Anderson estimates the figure is about 5 terabytes.)

Though the team has mostly been busy scanning, Anderson has found a few minutes here and there to play with the raw data. He created an algorithm to normalize the brightness levels across a set of frames, and has been able to stitch together part of a mosaic from Surveyor 5 that contains 70 images thus far. Because the raw files are so big, he had to make intermediate mosaics first, and then stitch those together. Here’s an early draft:

Surveyor 5 surface panorama

NASA / JPL-Caltech / University of Arizona Lunar and Planetary Laboratory / John Anderson

Surveyor 5 surface panorama
This panorama of the lunar surface was assembled using 70 frames captured by the Surveyor 5 spacecraft.

Anderson also created a composite high dynamic range Earthrise using 11 frames captured by Surveyor 7. This technique—overlaying multiple pictures of the same thing—is often used by amateur astronomers to make pretty pictures.

Earth from Surveyor 7

NASA / JPL-Caltech / University of Arizona Lunar and Planetary Laboratory / John Anderson

Earth from Surveyor 7
This composite HDR image of Earth was created using 11 frames captured by the Surveyor 7 spacecraft.

I asked Anderson if we could randomly browse through the archive and look for something interesting. We found a series of images showing Surveyor 7 scooping the lunar surface, and I put those together into an animated GIF:

Surveyor 7 scoop animation

NASA / JPL-Caltech / Lunar and Planetary Laboratory / Animation by Jason Davis

Surveyor 7 scoop animation
Surveyor 7 scoops the lunar surface.

To submit the raw Surveyor images to the Planetary Data System, Byrne’s team needs to convert the metadata stamped on each frame into a format that the PDS can accept. That metadata comes in three formats: human-readable text, binary coded decimal (BCD), and a barcode. 

Earth, as seen by Surveyor 7

NASA / JPL-Caltech / University of Arizona Lunar and Planetary Laboratory

Earth, as seen by Surveyor 7
This image of Earth was captured by Surveyor 7 in 1968. The image, stored on a 70 millimeter film reel negative, also contains calibration metadata.

The team first focused on the text, hoping they could automate the digital conversion process through optical character recognition—OCR. But a closer look shows that the text is printed in a dot matrix—each number and letter is actually a series of small dots. That tends to confuse OCR readers. One possible workaround is applying a blur to the text block to connect the dots.

Another option is creating a process to read the BCD or barcode block. But the details on how to decode these blocks have been lost over time. Justin Rennilson, a project member who was also on the spacecraft's original camera team, has been working on interpreting the BCD blocks. He discovered the format of the blocks changed over the course of the Surveyor program. 

Now that the scanning portion of the project is over, the team is turning its full attention to the metadata puzzle. The process they end up using to parse the 92,000-plus images needs to be nearly 100 percent accurate.

Back in the Space Imagery Center, Rennilson looked over a large printout of Anderson's early mosaic. I asked which part of the image was in the foreground, closer to the camera. 

"Look for the fine fragments," he said. "If you can’t resolve them, it’s far away." Surveyor scientists used this trick to help train astronauts how to judge distances on the lunar surface.

"That was a tool we told the astronauts to use on the moon," Rennilson said. "And it worked for most of the astronauts." One exception, he said, was Alan Shepard. America's first human in space apparently never quite got the hang of it. 

See other posts from November 2015


Or read more blog entries about: NASA lunar missions before 2005, history, the Moon


jo4hn: 11/24/2015 09:03 CST

This was my first project at JPL in 1966. My first task was the Mission Independent EDitor (MIED) on the IBM 7094. Ended up running the 7044 Redesign Project three years later. Great fun and challenging work.

Elto: 11/24/2015 09:57 CST

" ..a series of small dots. That tends to confuse OCR readers.." I just can not believe how bad OCR software are. I use many other programs doing much more complex things successfully, while the OCR programs I use are all very unsatisfactory. For example, I use "Subtitle Edit" to convert subtitle images into text. "I will" will be converted as "l wlII" or "l w!!!" or "! w!lI". "Welcome" will be converted as "Weicome" or "We!come", etc... An intelligent OCR should recognize that "We!come" is not an English word, while the similar "Welcome" is.

onebigmonkey: 11/24/2015 03:32 CST

Posted this on the facebook page but it's a shame to waste it :) Here's a comparison of that Earth image with the satellite image taken at the same time (12 noon GMT on January 23rd 1968). South America is the landmass under the clouds.

manifestnc: 11/24/2015 09:21 CST

70mm film's a pretty good source. But how'd the images get on the film? Surveyors didn't have any sample or film return capability, did they? These images look much crisper than conventional TV images of the day.

Paul McCarthy: 11/25/2015 03:21 CST

manifestnc, I was wondering that too.

onebigmonkey: 11/25/2015 04:32 CST

The images were captured with a TV camera and transmitted back to Earth. The quality of the new images are a result of better image processing capabilities from modern equipment

Jason Davis: 11/25/2015 01:38 CST

onebigmonkey: Did you get that date/time off the film negative timestamp? I'm not sure that it's the same picture as the composite HDR. manifestnc: As I understand it the raw signals were recorded on magnetic tape, and then read out using a machine that converted them into film negatives with the metadata.

Schrambo: 11/30/2015 11:23 CST

Looks like actual good fun and a great challenge to do and very self satisfying to do a good job. Knowing that once the task is complete the images are stored and hopefully in a digitalised state that is easier to manage for further post-processing and future archiving. Such a great achievement then and now.

onebigmonkey: 12/01/2015 12:37 CST

@Jason - yes, I based the time on the image in the Surveyor 7 report. My hard copy is better than the online version: There is a slight difference in the pattern of the clouds, which is explained by the fact that the time at terminator on the weather satellite image is at least 5 hours later and the visible portion took several hours to complete (I was oversimplifying in saying they were done at the same time!) You can check the data here:

Leave a Comment:

You must be logged in to submit a comment. Log in now.
Facebook Twitter Email RSS AddThis

Blog Search

Planetary Defense

An asteroid or comet headed for Earth is the only large-scale natural disaster we can prevent. Working together to fund our Shoemaker NEO Grants for astronomers, we can help save the world.


Featured Images

SpaceX CRS-8 landed booster
SES-10 static test fire
More Images

Featured Video

Class 9: Saturn, Uranus, and Neptune

Watch Now

Space in Images

Pretty pictures and
awe-inspiring science.

See More

Join The Planetary Society

Let’s explore the cosmos together!

Become a Member

Connect With Us

Facebook, Twitter, YouTube and more…
Continue the conversation with our online community!