GPU MC Viarte Frame-Rate Conversion
Sharp - Smooth - Superior Image Quality

Accurate Simulated Motion-blur for Playback Judder Reduction
Temporal Conversion & Slow-mo Effects

Frame-Rate Options for Shooting "Future-Proof" Video

What are best practises to make your film/video shots future proof? How can you repurpose your video shots for multiple different applications such as traditional interlaced broadcast, web broadcast, or film production, and do it without introducing significant judder, blur, or artifacts?

Web broadcasting is gradually changing how videographers select their mode of capture - often to 24p or 30p frame rates determined by imposed limits of 30 frames/second on many video sites in order to save some network bandwidth. While these limits are imposed to reduce costs, it is arguable that capturing video at lower frame rates is a mistake, and that higher frame rates should be used, preferably double the rate, with high quality frame rate conversion (FRC) to rates appropriate for web publishing.

High Frame Rate Capture is a Genuine Advantage when Repurposing Video

At lower frame rates, if frame-to-frame motion is too extreme, it may be very difficult or impossible to automatically motion-interpolate intermediate frames in order to achieve good results, particularly if they need to be viewed frame-by-frame. All other things being equal, all (repeat ALL) frame rate converters do a better job with higher input frame rates. Other things that influence FRC quality are noise, and lossy video compression.

Higher Frame or Field Rates - Both Can Work Well

A higher image capture rate can include deinterlaced field rates for professional quality interlaced cameras. For example, 30ifr (interlaced frames) per second is actually 60 fields per second (60i), so the effective scene sampling rate is 60, and can be regarded as equivalent to 60p, but only if used with a very high quality deinterlacer. Viarte deinterlaces from 30ifr to 60p and 25ifr to 50p using novel algorithms so that the result is virtually indistinguishable from capturing progressive at 60p and 50p. By this we mean that there is no resolution loss, no residual flicker, and no perceptible residual combing. If you have interlaced video cameras, it is actually better to continue to use them, than to purchase cameras that only work at lower frame rates such as 30p, 25p, or 24p, where FRC is more difficult in general.

If you do decide to replace a high quality interlaced camera with a progressive one, then very, very seriously consider only going from 30ifr to 60p, or 25ifr to 50p. Then you can frame rate convert using a high quality converter to anything you need, whether it is finally converted to interlaced or left as progressive.

Motion Blur & Judder

So you capture this 60p sequence, and it looks nice and smooth, even with a small shutter angle (fast shutter). Say it uses 180 degrees, i.e. the shutter is open half the time. At 1/60 of a second between frames, this represents a shutter exposure of 1/60 * 180/360 = 1/120 of a second. Now you decide to frame rate convert it to 24p. At 1/24 of a second, the effective shutter angle is 360 x (1/120 / 1/24) = 72 degrees. As any videographer will tell you, this is much too fast for film, and will result in considerable motion judder in a daylight scene with lots of detail.

In general, we usually need to add accurate motion blur as we go from a higher frame rate to a lower frame rate.

To avoid this problem, isovideo provides a configurable/tunable accurate motion blur facility in our Viarte frame rate converter and Viarte server. It can add precise motion blur, so the 72 degrees from the example above can be extended to 180 degrees by adding 108 degrees. While not trivial to do, adding motion blur again comes down to having good frame rate conversion, and a fair amount of compute power, but its attainable.

When downsampling frame rates by larger amounts, adding the correct degree of high quality motion blur to avoid motion judder is a necessity, not a luxury! For example, going from 60p/50p down to 30p/25p/24p would all require adding motion blur.

Note that we define general motion blur as applying to the motion of objects within a scene, and not just from camera motion. The latter also introduces motion blur, but is easier to correct for. This leads us to the following problem: if you capture at 24p, with a commonly used 180 degree shutter (1/24 * (180/360) = 1/48 second shutter speed), and try to upsample to 60p, then 1/48 second shutter speed will occur in output with 1/60 of a second between frames - or 360 x (1/48 / 1/60) = 450 degrees! This will cause the eye to perceive the scene as blurry, because the blur is not commensurate with the human vision queues arising from the higher frame rate and our ability to track motion. How can you reduce the blur? This is an unsolved problem for general motion. It is much easier to motion-blur than to motion-deblur! Even if an individual frame could be motion-deblurred, one could still get issues arising from inconsistencies that occur frame-to-frame (similar to deinterlacer flicker).

High Quality Repurposing, when accounting for
Deinterlacing, FRC, Motion Blur & the Motion deblur issue

It is strongly recommended that the hierarchy of choices for cameras in terms of repurposing would be (best to worst):

60p, 60i (30ifr), 50p, 50i (25ifr), 48p,

and much worse:

30p, 25p, 24p

Note that this list does not change its order based on the output frame rates you wish to use, although 50 or 60Hz countries might reasonably prefer to shoot at rates based on their region in order to simplify or minimize the number of conversions.

Judder Reduction Examples

Note: When adding simulated motion blur for FRC from 50p to 24p, some fine lines/details may appear less sharp than in the original 50p when viewed frame-by-frame. This same motion blurring would have occured on a real 24p camera.

Conclusions

No one in the business of high-end video capture should be using low frame rates just because of limitations in distribution channels to rates such as 24p or 30p. This is especially true for sports or action sequences. We hope that this article helps you make smart repurposing and future-proof choices when making production decisions on the frame rates used, what cameras to use, and when preparing for a shoot.

Finally, offer our proprietary, IABM/NAB game-changer-award-winning Viarte-based media conversion services, include 100% vertical resolution deinterlacing, cinema-quality frame rate conversion (any-to-any) with the ability to add accurate simulated motion blur for down-frame-rate conversion, detail-retaining noise reduction, etc. For more information, visit Services.