Images, video, voice and music

Video extension

In short

Video extension is an AI editing feature that generates new frames after an existing clip so the action continues for longer. It uses the end of the source video and a prompt to make a continuation that aims to match its motion and appearance.

Also called
AI video extension, Generative extend, Scene extension
Topic
Images, video, voice and music
Level
Beginner
First described
Ho and colleagues described conditional spatial and temporal video extension in the paper Video Diffusion Models, published in April 2022.

A video-extension system analyses part or all of a clip, then samples a new segment conditioned on the final frames and an instruction. The instruction might say that a person walks through a door or that a camera continues panning across a landscape12.

The research idea is older than today's editing buttons. Ho and colleagues described conditional spatial and temporal video extension as a way to generate longer or higher-resolution videos with a video diffusion model1. Current services expose the same general idea as a continuation at the tail of a clip.

Extension is not the same as simply slowing a clip, looping it or stretching the timeline. The model invents new frames, so a face, object, camera movement or soundtrack can drift. Some tools only append to the end. Google's Gemini documentation says uploaded-video extension cannot prepend content or extend the middle of a clip2.

Editors use it to give a shot more room for a cut, finish a movement or add a few seconds to a social video. Google describes Veo's scene extension as using the last second of a shot to continue the story while maintaining visual and audio consistency2.

Example

A five-second clip ends just before a child reaches a kite. The editor prompts the tool to continue the scene, then reviews the generated seconds before joining them to the original.

Why it matters

A good extension can rescue a shot that ends too soon without a reshoot. It is still synthetic footage, so editors need to check continuity, rights, dialogue and unwanted changes before delivery.

Questions people ask

How does AI video extension work?

The model uses the source clip, especially its ending, as context and generates a new segment from a continuation prompt. Video diffusion research describes conditional sampling for spatial and temporal extension1.

Can video extension add footage to the middle of a clip?

It depends on the tool. Gemini's documented extension feature only appends content to the end and does not prepend content or extend the middle of an uploaded clip2.

Is video extension the same as video outpainting?

No. Extension adds time after a clip. Outpainting expands the visible image area, such as adding space at the sides of a frame. Some products offer both features.

Related terms

Tools that use it

Sources

  1. Ho et al. (2022), Video Diffusion Models, arXiv:2204.03458
  2. Google AI for Developers, Generate and edit videos with Gemini Omni Flash

Back to the glossary