Variable Frame Rate MP4

Introduction

This guide assumes you're comfortable with AviSynth, MeGUI and batch files or working through the command line.

What is variable frame rate? You can probably guess that a constant frame rate is where the frame rate of a video stays the same throughout its whole length. In VFR you'll have sections that have a different framerate. VFR is useful when the game you've recorded has multiple in-game framerates. For example, God of War for the PS2 outputs gameplay at full framerate while its cinematics are half framerate.

This guide will not work with DivX / Xvid.

Understanding the VFR process

1. Normally, videos that have different framerates cannot be joined together.

2. Using Avisynth, we can change the framerates of each video so that they match, and can thus be joined. Of course this will make parts of the video play faster or slower than it should. As you can see, changing the framerate from 60 to 30 has doubled the length of Video2.

3. Once joined, a temporary video is encoded with H.264 / AAC in the MP4 container.

4. Now to get the video to play like normal again, we tell tc2mp4 which parts should be set to the orignal framerate. The result is a variable framerate video.

Files you'll need

Download tc2mp4 and extract the contents to your working directory. Place mp4box.exe in the same directory. Mp4box can be found in "..\MeGUI\tools\mp4box\".

Avisynth script

As you saw in the pictures above, changing the framerate can change the video duration. Doing so also changes the duration of the audio which affects the pitch; not a good thing. So, the first goal is to create an audio file that sounds normal. Here's a simple AviSynth script:

vid1=avisource("my30fpsvid.avi")
vid2=avisource("my60fpsvid.avi")

vid2=vid2.changefps(vid1)

AlignedSplice(a,b)
ConvertToYV12()

Modify it to your liking and encode the audio only. Once that's done it's time to prepare the real avisynth script. Simply change changefps to assumefps and encode the video.

vid1=avisource("my30fpsvid.avi")
vid2=avisource("my60fpsvid.avi")

vid2=vid2.assumefps(vid1)

AlignedSplice(a,b)
ConvertToYV12()

Finding the frame ranges

To calculate the frame ranges from the AviSynth script above, first find out how many there are in each set.

From the script above, if the 30 fps video had 1000 frames, and the 60 fps video had 2500 frames, then your timecode.txt file would be:

# timecode format v1
Assume 30
0,999,30
1000,3499,60

Setting the VFR

Your CFR encoding should be done now. Open a command line and use the following:

tc2mp4 -i myCFRvid.mp4 -t timecode.txt -o myVFRvid.mp4

tc2mp4 gets rid of any audio in your files, so keep reading..

Muxing the Audio

If you were to encode the audio based off the AviSynth scripts above, you'd get parts in the audio stream playing at an abnormal speed. Let's modify the above scripts solely to get the correct audio stream.

Example 1.

a=avisource("my30fpsvid.avi")
b=avisource("my60fpsvid.avi")

### Match a's framerate to that of b. Avoid using numbers, if the
### framerates are even 0.000001 different, this will not work.
#a=a.assumefps(b)
a=a.changefps(b)

AlignedSplice(a,b)
ConvertToYV12()

To splice the videos together, they need to have the same framerate. But how do we do that without speeding up the 30 fps vid? Use the changefps command this time to match the framerate by duplicating the frames but not actually changing the pace.

Example 2.

Loadplugin("C:\Program Files\DGMPGDec\DGDecode.dll")

Ac3Source(MPEG2source("SEG7_5155.d2v"),"SEG7_5155_DELAY-73ms.ac3").DelayAudio(-0.073)

assumetff()

a=last.Trim(0,1720).mvbob()
b=last.Trim(1721,4080).telecide().assumefps(a)
c=last.Trim(4081,11480).mvbob()
d=last.Trim(11481,12455).telecide().assumefps(a)
e=last.Trim(12456,13485).mvbob()
f=last.Trim(13486,16680).telecide().assumefps(a)
g=last.Trim(16681,17200).mvbob()

#AlignedSplice(a,b,c,d,e,f,g)
Lanczos4Resize(640,480)
ConvertToYV12()

Simply comment out the AlignedSplice. What gets through is the original ac3source line.

Encode the audio in MeGUI, and mux it with the vfr video. Et voilà, you're done.