Home / Issues / 8.2011 / Visual Fixation for 3D Video Stabilization
Document Actions

Citation and metadata

Back to the article.

Recommended citation

Christian Kurz, Thorsten Thormählen, and Hans-Peter Seidel, Visual Fixation for 3D Video Stabilization. JVRB - Journal of Virtual Reality and Broadcasting, 8(2011), no. 2. (urn:nbn:de:0009-6-28222)

Download Citation

Endnote

%0 Journal Article
%T Visual Fixation for 3D Video Stabilization
%A Kurz, Christian
%A Thormählen, Thorsten
%A Seidel, Hans-Peter
%J JVRB - Journal of Virtual Reality and Broadcasting
%D 2011
%V 8(2011)
%N 2
%@ 1860-2037
%F kurz2011
%X Visual fixation is employed by humans and some animalsto keep a specific 3D location at the center ofthe visual gaze. Inspired by this phenomenon in nature,this paper explores the idea to transfer this mechanismto the context of video stabilization for a handheldvideo camera. A novel approach is presentedthat stabilizes a video by fixating on automaticallyextracted 3D target points. This approach is differentfrom existing automatic solutions that stabilizethe video by smoothing. To determine the 3D targetpoints, the recorded scene is analyzed with a stateof-the-art structure-from-motion algorithm, which estimatescamera motion and reconstructs a 3D pointcloud of the static scene objects. Special algorithmsare presented that search either virtual or real 3D targetpoints, which back-project close to the center of theimage for as long a period of time as possible. The stabilization algorithm then transforms the original imagesof the sequence so that these 3D target points arekept exactly in the center of the image, which, in caseof real 3D target points, produces a perfectly stable resultat the image center. Furthermore, different methodsof additional user interaction are investigated. It isshown that the stabilization process can easily be controlledand that it can be combined with state-of-thearttracking techniques in order to obtain a powerfulimage stabilization tool. The approach is evaluated ona variety of videos taken with a hand-held camera innatural scenes.
%L 004
%K camera motion estimation
%K camera shake
%K structure-from-motion
%K video stabilization
%K visual fixation
%R 10.20385/1860-2037/8.2011.2
%U http://nbn-resolving.de/urn:nbn:de:0009-6-28222
%U http://dx.doi.org/10.20385/1860-2037/8.2011.2
Download

Bibtex

@Article{kurz2011,
  author = 	"Kurz, Christian
		and Thorm{\"a}hlen, Thorsten
		and Seidel, Hans-Peter",
  title = 	"Visual Fixation for 3D Video Stabilization",
  journal = 	"JVRB - Journal of Virtual Reality and Broadcasting",
  year = 	"2011",
  volume = 	"8(2011)",
  number = 	"2",
  keywords = 	"camera motion estimation; camera shake; structure-from-motion; video stabilization; visual fixation",
  abstract = 	"Visual fixation is employed by humans and some animalsto keep a specific 3D location at the center ofthe visual gaze. Inspired by this phenomenon in nature,this paper explores the idea to transfer this mechanismto the context of video stabilization for a handheldvideo camera. A novel approach is presentedthat stabilizes a video by fixating on automaticallyextracted 3D target points. This approach is differentfrom existing automatic solutions that stabilizethe video by smoothing. To determine the 3D targetpoints, the recorded scene is analyzed with a stateof-the-art structure-from-motion algorithm, which estimatescamera motion and reconstructs a 3D pointcloud of the static scene objects. Special algorithmsare presented that search either virtual or real 3D targetpoints, which back-project close to the center of theimage for as long a period of time as possible. The stabilization algorithm then transforms the original imagesof the sequence so that these 3D target points arekept exactly in the center of the image, which, in caseof real 3D target points, produces a perfectly stable resultat the image center. Furthermore, different methodsof additional user interaction are investigated. It isshown that the stabilization process can easily be controlledand that it can be combined with state-of-thearttracking techniques in order to obtain a powerfulimage stabilization tool. The approach is evaluated ona variety of videos taken with a hand-held camera innatural scenes.",
  issn = 	"1860-2037",
  doi = 	"10.20385/1860-2037/8.2011.2",
  url = 	"http://nbn-resolving.de/urn:nbn:de:0009-6-28222"
}
Download

RIS

TY  - JOUR
AU  - Kurz, Christian
AU  - Thormählen, Thorsten
AU  - Seidel, Hans-Peter
PY  - 2011
DA  - 2011//
TI  - Visual Fixation for 3D Video Stabilization
JO  - JVRB - Journal of Virtual Reality and Broadcasting
VL  - 8(2011)
IS  - 2
KW  - camera motion estimation
KW  - camera shake
KW  - structure-from-motion
KW  - video stabilization
KW  - visual fixation
AB  - Visual fixation is employed by humans and some animalsto keep a specific 3D location at the center ofthe visual gaze. Inspired by this phenomenon in nature,this paper explores the idea to transfer this mechanismto the context of video stabilization for a handheldvideo camera. A novel approach is presentedthat stabilizes a video by fixating on automaticallyextracted 3D target points. This approach is differentfrom existing automatic solutions that stabilizethe video by smoothing. To determine the 3D targetpoints, the recorded scene is analyzed with a stateof-the-art structure-from-motion algorithm, which estimatescamera motion and reconstructs a 3D pointcloud of the static scene objects. Special algorithmsare presented that search either virtual or real 3D targetpoints, which back-project close to the center of theimage for as long a period of time as possible. The stabilization algorithm then transforms the original imagesof the sequence so that these 3D target points arekept exactly in the center of the image, which, in caseof real 3D target points, produces a perfectly stable resultat the image center. Furthermore, different methodsof additional user interaction are investigated. It isshown that the stabilization process can easily be controlledand that it can be combined with state-of-thearttracking techniques in order to obtain a powerfulimage stabilization tool. The approach is evaluated ona variety of videos taken with a hand-held camera innatural scenes.
SN  - 1860-2037
UR  - http://nbn-resolving.de/urn:nbn:de:0009-6-28222
DO  - 10.20385/1860-2037/8.2011.2
ID  - kurz2011
ER  -
Download

Wordbib

<?xml version="1.0" encoding="UTF-8"?>
<b:Sources SelectedStyle="" xmlns:b="http://schemas.openxmlformats.org/officeDocument/2006/bibliography"  xmlns="http://schemas.openxmlformats.org/officeDocument/2006/bibliography" >
<b:Source>
<b:Tag>kurz2011</b:Tag>
<b:SourceType>ArticleInAPeriodical</b:SourceType>
<b:Year>2011</b:Year>
<b:PeriodicalTitle>JVRB - Journal of Virtual Reality and Broadcasting</b:PeriodicalTitle>
<b:Volume>8(2011)</b:Volume>
<b:Issue>2</b:Issue>
<b:Url>http://nbn-resolving.de/urn:nbn:de:0009-6-28222</b:Url>
<b:Url>http://dx.doi.org/10.20385/1860-2037/8.2011.2</b:Url>
<b:Author>
<b:Author><b:NameList>
<b:Person><b:Last>Kurz</b:Last><b:First>Christian</b:First></b:Person>
<b:Person><b:Last>Thormählen</b:Last><b:First>Thorsten</b:First></b:Person>
<b:Person><b:Last>Seidel</b:Last><b:First>Hans-Peter</b:First></b:Person>
</b:NameList></b:Author>
</b:Author>
<b:Title>Visual Fixation for 3D Video Stabilization</b:Title>
<b:Comments>Visual fixation is employed by humans and some animalsto keep a specific 3D location at the center ofthe visual gaze. Inspired by this phenomenon in nature,this paper explores the idea to transfer this mechanismto the context of video stabilization for a handheldvideo camera. A novel approach is presentedthat stabilizes a video by fixating on automaticallyextracted 3D target points. This approach is differentfrom existing automatic solutions that stabilizethe video by smoothing. To determine the 3D targetpoints, the recorded scene is analyzed with a stateof-the-art structure-from-motion algorithm, which estimatescamera motion and reconstructs a 3D pointcloud of the static scene objects. Special algorithmsare presented that search either virtual or real 3D targetpoints, which back-project close to the center of theimage for as long a period of time as possible. The stabilization algorithm then transforms the original imagesof the sequence so that these 3D target points arekept exactly in the center of the image, which, in caseof real 3D target points, produces a perfectly stable resultat the image center. Furthermore, different methodsof additional user interaction are investigated. It isshown that the stabilization process can easily be controlledand that it can be combined with state-of-thearttracking techniques in order to obtain a powerfulimage stabilization tool. The approach is evaluated ona variety of videos taken with a hand-held camera innatural scenes.</b:Comments>
</b:Source>
</b:Sources>
Download

ISI

PT Journal
AU Kurz, C
   Thormählen, T
   Seidel, H
TI Visual Fixation for 3D Video Stabilization
SO JVRB - Journal of Virtual Reality and Broadcasting
PY 2011
VL 8(2011)
IS 2
DI 10.20385/1860-2037/8.2011.2
DE camera motion estimation; camera shake; structure-from-motion; video stabilization; visual fixation
AB Visual fixation is employed by humans and some animalsto keep a specific 3D location at the center ofthe visual gaze. Inspired by this phenomenon in nature,this paper explores the idea to transfer this mechanismto the context of video stabilization for a handheldvideo camera. A novel approach is presentedthat stabilizes a video by fixating on automaticallyextracted 3D target points. This approach is differentfrom existing automatic solutions that stabilizethe video by smoothing. To determine the 3D targetpoints, the recorded scene is analyzed with a stateof-the-art structure-from-motion algorithm, which estimatescamera motion and reconstructs a 3D pointcloud of the static scene objects. Special algorithmsare presented that search either virtual or real 3D targetpoints, which back-project close to the center of theimage for as long a period of time as possible. The stabilization algorithm then transforms the original imagesof the sequence so that these 3D target points arekept exactly in the center of the image, which, in caseof real 3D target points, produces a perfectly stable resultat the image center. Furthermore, different methodsof additional user interaction are investigated. It isshown that the stabilization process can easily be controlledand that it can be combined with state-of-thearttracking techniques in order to obtain a powerfulimage stabilization tool. The approach is evaluated ona variety of videos taken with a hand-held camera innatural scenes.
ER
Download

Mods

<mods>
  <titleInfo>
    <title>Visual Fixation for 3D Video Stabilization</title>
  </titleInfo>
  <name type="personal">
    <namePart type="family">Kurz</namePart>
    <namePart type="given">Christian</namePart>
  </name>
  <name type="personal">
    <namePart type="family">Thormählen</namePart>
    <namePart type="given">Thorsten</namePart>
  </name>
  <name type="personal">
    <namePart type="family">Seidel</namePart>
    <namePart type="given">Hans-Peter</namePart>
  </name>
  <abstract>Visual fixation is employed by humans and some animals
to keep a specific 3D location at the center of
the visual gaze. Inspired by this phenomenon in nature,
this paper explores the idea to transfer this mechanism
to the context of video stabilization for a handheld
video camera. A novel approach is presented
that stabilizes a video by fixating on automatically
extracted 3D target points. This approach is different
from existing automatic solutions that stabilize
the video by smoothing. To determine the 3D target
points, the recorded scene is analyzed with a stateof-
the-art structure-from-motion algorithm, which estimates
camera motion and reconstructs a 3D point
cloud of the static scene objects. Special algorithms
are presented that search either virtual or real 3D target
points, which back-project close to the center of the
image for as long a period of time as possible. The stabilization algorithm then transforms the original images
of the sequence so that these 3D target points are
kept exactly in the center of the image, which, in case
of real 3D target points, produces a perfectly stable result
at the image center. Furthermore, different methods
of additional user interaction are investigated. It is
shown that the stabilization process can easily be controlled
and that it can be combined with state-of-theart
tracking techniques in order to obtain a powerful
image stabilization tool. The approach is evaluated on
a variety of videos taken with a hand-held camera in
natural scenes.</abstract>
  <subject>
    <topic>camera motion estimation</topic>
    <topic>camera shake</topic>
    <topic>structure-from-motion</topic>
    <topic>video stabilization</topic>
    <topic>visual fixation</topic>
  </subject>
  <classification authority="ddc">004</classification>
  <relatedItem type="host">
    <genre authority="marcgt">periodical</genre>
    <genre>academic journal</genre>
    <titleInfo>
      <title>JVRB - Journal of Virtual Reality and Broadcasting</title>
    </titleInfo>
    <part>
      <detail type="volume">
        <number>8(2011)</number>
      </detail>
      <detail type="issue">
        <number>2</number>
      </detail>
      <date>2011</date>
    </part>
  </relatedItem>
  <identifier type="issn">1860-2037</identifier>
  <identifier type="urn">urn:nbn:de:0009-6-28222</identifier>
  <identifier type="doi">10.20385/1860-2037/8.2011.2</identifier>
  <identifier type="uri">http://nbn-resolving.de/urn:nbn:de:0009-6-28222</identifier>
  <identifier type="citekey">kurz2011</identifier>
</mods>
Download

Full Metadata

Bibliographic Citation JVRB, 8(2011), no. 2.
Title

Visual Fixation for 3D Video Stabilization (eng)
Author Christian Kurz, Thorsten Thormählen, Hans-Peter Seidel
Language eng
Abstract Visual fixation is employed by humans and some animals to keep a specific 3D location at the center of the visual gaze. Inspired by this phenomenon in nature, this paper explores the idea to transfer this mechanism to the context of video stabilization for a handheld video camera. A novel approach is presented that stabilizes a video by fixating on automatically extracted 3D target points. This approach is different from existing automatic solutions that stabilize the video by smoothing. To determine the 3D target points, the recorded scene is analyzed with a stateof- the-art structure-from-motion algorithm, which estimates camera motion and reconstructs a 3D point cloud of the static scene objects. Special algorithms are presented that search either virtual or real 3D target points, which back-project close to the center of the image for as long a period of time as possible. The stabilization algorithm then transforms the original images of the sequence so that these 3D target points are kept exactly in the center of the image, which, in case of real 3D target points, produces a perfectly stable result at the image center. Furthermore, different methods of additional user interaction are investigated. It is shown that the stabilization process can easily be controlled and that it can be combined with state-of-theart tracking techniques in order to obtain a powerful image stabilization tool. The approach is evaluated on a variety of videos taken with a hand-held camera in natural scenes.
Subject camera motion estimation, camera shake, structure-from-motion, video stabilization, visual fixation
Classified Subjects
swd
  • 4536854-5, Video / Bildverarbeitung
DDC 004
Rights DPPL
URN: urn:nbn:de:0009-6-28222
DOI https://doi.org/10.20385/1860-2037/8.2011.2