For nearly two months, I've been working on a restoration of The Truman Show that expands the picture to 1.66. The 4K UHD disc is the heart of it, and the 1999 DVD adds extra picture around the edges. The goal is for every pixel to come from real footage, with nothing invented.
My first full render finished a few days ago, but even after a carefully prepared 13-day render time, it became clear it would have to only serve as a Beta test. Because it revealed four big problems:
1. The image was slightly squeezed. A bug in how the output frame was sized compressed the picture by about 2%. Most might not ever notice, but once I knew, I couldn't unsee it.
2. The DVD margin was dirtier than I thought. Once it's upscaled to 4K, every dust spot and bit of DVD noise on the old disc shows up right next to the clean, fully restored UHD picture. There was far more that slipped through.
3. The DVD and the UHD weren't always showing the same frame. This was one of the most frustrating issues, and I only discovered it because the edges of some shots didn't seem to line up and stay in sync. In some shots, the seam between the DVD margin and the UHD looked fine on a still frame, but in motion you'd see the edge stutter, or picture details doubling across the seam.
Comparing the two sources frame by frame showed that occasionally (and seemingly for no reason) the DVD would drift a frame ahead or behind the UHD in places. That came from dropped or repeated frames and differences in how each was transferred. So I had to build a frame map for each of the UHD's 148,030 frames, showing which exact DVD frame matches it.
4. Some shots had seriously strange geometry. Even with the right frames paired, the edges still wouldn't line up in some shots. No matter what I did, I just couldn't get some shots to work.
As it turned out, not only was the whole DVD transfer very slightly rotated compared to the UHD (about a third of a degree), but it was also scaled differently in some shots. Normally invisible on its own, but it became obvious when trying to align two images together.
A handful of shots were even worse: the DVD image was distorted in unusual ways, sometimes shifting over the course of the shot. Even large transformations and skews could not get the edges to line up at all. Those shots only came together once the DVD was reshaped frame by frame to the UHD's geometry, sometimes with fairly large corrections that corrected a weird ripple or curve (lens distortion?) in the DVD.
So I went back and rebuilt most of the pipeline. Here's what changed:
- Frame-by-frame alignment. Before, the DVD was lined up with the UHD shot by shot. Now every single frame is registered to the UHD across dozens of specific pixel anchors, so the edges stay locked in place instead of drifting or wobbling. That alone was the biggest visible improvement.
- Dust cleanup. Dust and dirt are found on the DVD before upscaling, so the upscaler never turns a speck into a big 4K blob. I also went through and marked the stubborn ones by hand.
- Noise and speckle. Upscaling DVD noise created a fine "speckle" at the edges that was really visible on an HDR TV. It took many iterations of code to find a process that keeps flat areas like sky and walls from picking up that speckle.
- Smarter cropping. The DVD and UHD don't always line up perfectly, which can leave small empty gaps at the edges. I missed a bunch of them in the first render, and discovered that I had holes in the video. So I had to carefully crop to remove those gaps.
- Better seams. I improved the blend where the upscaled DVD edge meets the UHD. In a few tricky shots, like TV screens and one patterned couch, the seam gets custom handling so you can't see the join.
- Sturdier render setup. The full render takes 300+ hours on one laptop. So this second run has more resilient and reliable code, so any hiccups don't throw everything off.
My second (!) full 300+ hour re-render is about to start. While I was waiting on a bunch of test shots to process, I threw together a fun side project: a frame-for-frame recreation of the original theatrical trailer, using my beta 1.66 footage.
Every shot in the trailer was matched to its exact frames in the film and rebuilt in 4K. The graphics, title cards and a few isolated shots still come from the old trailer. Everything else is "The 1.66 Truman Show". I also kept the trailer's original color grading so it still feels like the 1998 trailer.
Happy to answer questions about the process, and I'd love feedback on anything that looks off. Good morning, and in case I don't see ya... 👋