DEMO: MOTION-CONSISTENT

VIDEO INPAINTING

Authors Introduction
Thuc Trinh LE2
Andres ALMANSA1
Video inpainting
Yann GOUSSEAU2 Replacing the content of a region in a video with some
Simon MASNOU3 other content which is visually plausible.
Applications: Video editing, object removal
Challenges:
Moving objects reconstruction
Artifact (spatial/temporal incoherence)
Long computation times

Proposed method
Optimize a global, patch-based function:
1 - MAP5, CNRS & Paris Descartes
2 - LTCI, Telecom ParisTech
3 - Univ Claude Bernard Lyon 1 & CNRS, , = , +
Institut Camille Jordan

Multi-scale Nearest neighbor search Pixel reconstruction

Find the nearest neighbor field with the following distance:
Color volume Optical flow volume111 Gradient texture volume
2 , Weighted-mean based approach
1
= + 2 = , , color information +
= ,


+ + 2 = , texture information
2 , +()
=
+ + 2 = , optical flow information 22

: :
1 ( /) ,

= 1 exp + 0
0 y 2
1
, is distance from q to the border

Results
Intensive use of the optical flow + Moving objects reconstruction
Coarse + Objects removal.
initialization

Nearest Distance
neighbor Optical flow between
search patches

Patch
shape

Contact thuc.le@telecom-paristech.fr Site web https://purl.org/vid_inp_motion