Home / Issues / 14.2017 / 3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces
Document Actions

Citation and metadata

Back to the article.

Recommended citation

Xavier Martinez, Nicolas Férey, Jean-Marc Vézien, and Patrick Bourdot, 3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces. Journal of Virtual Reality and Broadcasting, 14(2017), no. 2. (urn:nbn:de:0009-6-46956)

Download Citation

Endnote

%0 Journal Article
%T 3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces
%A Martinez, Xavier
%A Férey, Nicolas
%A Vézien, Jean-Marc
%A Bourdot, Patrick
%J Journal of Virtual Reality and Broadcasting
%D 2019
%V 14(2017)
%N 2
%@ 1860-2037
%F martinez2019
%X Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD & mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.
%L 004
%K Markerless Tracking
%K Molecular Tangible Interface
%K Physical model (Peppytide)
%K Structure from Motion
%R 10.20385/1860-2037/14.2017.2
%U http://nbn-resolving.de/urn:nbn:de:0009-6-46956
%U http://dx.doi.org/10.20385/1860-2037/14.2017.2
Download

Bibtex

@Article{martinez2019,
  author = 	"Martinez, Xavier
		and F{\'e}rey, Nicolas
		and V{\'e}zien, Jean-Marc
		and Bourdot, Patrick",
  title = 	"3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces",
  journal = 	"Journal of Virtual Reality and Broadcasting",
  year = 	"2019",
  volume = 	"14(2017)",
  number = 	"2",
  keywords = 	"Markerless Tracking; Molecular Tangible Interface; Physical model (Peppytide); Structure from Motion",
  abstract = 	"Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD {\&} mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.",
  issn = 	"1860-2037",
  doi = 	"10.20385/1860-2037/14.2017.2",
  url = 	"http://nbn-resolving.de/urn:nbn:de:0009-6-46956"
}
Download

RIS

TY  - JOUR
AU  - Martinez, Xavier
AU  - Férey, Nicolas
AU  - Vézien, Jean-Marc
AU  - Bourdot, Patrick
PY  - 2019
DA  - 2019//
TI  - 3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces
JO  - Journal of Virtual Reality and Broadcasting
VL  - 14(2017)
IS  - 2
KW  - Markerless Tracking
KW  - Molecular Tangible Interface
KW  - Physical model (Peppytide)
KW  - Structure from Motion
AB  - Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD & mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.
SN  - 1860-2037
UR  - http://nbn-resolving.de/urn:nbn:de:0009-6-46956
DO  - 10.20385/1860-2037/14.2017.2
ID  - martinez2019
ER  -
Download

Wordbib

<?xml version="1.0" encoding="UTF-8"?>
<b:Sources SelectedStyle="" xmlns:b="http://schemas.openxmlformats.org/officeDocument/2006/bibliography"  xmlns="http://schemas.openxmlformats.org/officeDocument/2006/bibliography" >
<b:Source>
<b:Tag>martinez2019</b:Tag>
<b:SourceType>ArticleInAPeriodical</b:SourceType>
<b:Year>2019</b:Year>
<b:PeriodicalTitle>Journal of Virtual Reality and Broadcasting</b:PeriodicalTitle>
<b:Volume>14(2017)</b:Volume>
<b:Issue>2</b:Issue>
<b:Url>http://nbn-resolving.de/urn:nbn:de:0009-6-46956</b:Url>
<b:Url>http://dx.doi.org/10.20385/1860-2037/14.2017.2</b:Url>
<b:Author>
<b:Author><b:NameList>
<b:Person><b:Last>Martinez</b:Last><b:First>Xavier</b:First></b:Person>
<b:Person><b:Last>Férey</b:Last><b:First>Nicolas</b:First></b:Person>
<b:Person><b:Last>Vézien</b:Last><b:First>Jean-Marc</b:First></b:Person>
<b:Person><b:Last>Bourdot</b:Last><b:First>Patrick</b:First></b:Person>
</b:NameList></b:Author>
</b:Author>
<b:Title>3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces</b:Title>
<b:Comments>Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD &amp; mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.</b:Comments>
</b:Source>
</b:Sources>
Download

ISI

PT Journal
AU Martinez, X
   Férey, N
   Vézien, J
   Bourdot, P
TI 3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces
SO Journal of Virtual Reality and Broadcasting
PY 2019
VL 14(2017)
IS 2
DI 10.20385/1860-2037/14.2017.2
DE Markerless Tracking; Molecular Tangible Interface; Physical model (Peppytide); Structure from Motion
AB Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD & mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.
ER
Download

Mods

<mods>
  <titleInfo>
    <title>3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces</title>
  </titleInfo>
  <name type="personal">
    <namePart type="family">Martinez</namePart>
    <namePart type="given">Xavier</namePart>
  </name>
  <name type="personal">
    <namePart type="family">Férey</namePart>
    <namePart type="given">Nicolas</namePart>
  </name>
  <name type="personal">
    <namePart type="family">Vézien</namePart>
    <namePart type="given">Jean-Marc</namePart>
  </name>
  <name type="personal">
    <namePart type="family">Bourdot</namePart>
    <namePart type="given">Patrick</namePart>
  </name>
  <abstract>Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD &amp; mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.</abstract>
  <subject>
    <topic>Markerless Tracking</topic>
    <topic>Molecular Tangible Interface</topic>
    <topic>Physical model (Peppytide)</topic>
    <topic>Structure from Motion</topic>
  </subject>
  <classification authority="ddc">004</classification>
  <relatedItem type="host">
    <genre authority="marcgt">periodical</genre>
    <genre>academic journal</genre>
    <titleInfo>
      <title>Journal of Virtual Reality and Broadcasting</title>
    </titleInfo>
    <part>
      <detail type="volume">
        <number>14(2017)</number>
      </detail>
      <detail type="issue">
        <number>2</number>
      </detail>
      <date>2019</date>
    </part>
  </relatedItem>
  <identifier type="issn">1860-2037</identifier>
  <identifier type="urn">urn:nbn:de:0009-6-46956</identifier>
  <identifier type="doi">10.20385/1860-2037/14.2017.2</identifier>
  <identifier type="uri">http://nbn-resolving.de/urn:nbn:de:0009-6-46956</identifier>
  <identifier type="citekey">martinez2019</identifier>
</mods>
Download

Full Metadata

Bibliographic Citation JVRB, 14(2017), no. 2.
Title

3D reconstruction with a markerless tracking method of flexible and modular molecular physical models: towards tangible interfaces (eng)
Author Xavier Martinez, Nicolas Férey, Jean-Marc Vézien, Patrick Bourdot
Language eng
Abstract Physical models have always been used in the field of molecular science as an understandable representation of complex molecules, particularly in chemistry. Even if physical models were recently completed by numerical in silico molecular visualizations which offer a wide range of molecular representations and rendering features, they are still involved in research work and teaching, because they are more suitable than virtual objects for manipulating and building molecular structures. In this paper, we present a markerless tracking method to construct a molecular virtual representation from a flexible and modular physical model. Our approach is based on a single RGB camera to reconstruct the physical model in interactive time in order to use it as a tangible interface, and thus benefits from both physical and virtual representations. This method was designed to require only a light virtual and augmented reality hardware setup, such as a smartphone or HMD & mounted camera, providing a markerless molecular tangible interface suitable for a classroom context or a classical biochemistry researcher desktop. The approach proposes a fast image processing algorithm based on color blob detection to extract 2D atom positions of a user-defined conformation in each frame of a video. A tracking algorithm recovers a set of 2D projected atom positions as an input of the 3D reconstruction stage, based on a Structure From Motion method. We tuned this method to robustly process a few key feature points and combine them within a global point cloud. Biological knowledge drives the final reconstruction, filling missing atoms to obtain the desired molecular conformation.
Subject Markerless Tracking, Molecular Tangible Interface, Physical model (Peppytide), Structure from Motion
Classified Subjects
swd
  • 4824190-8, Gegenständliche Benutzeroberfläche
  • 4150634-0, Dreidimensionale Rekonstruktion
  • 4311226-2, Objektverfolgung
DDC 004
Rights DPPL
URN: urn:nbn:de:0009-6-46956
DOI https://doi.org/10.20385/1860-2037/14.2017.2