Home / Issues / 13.2016 / A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities
Document Actions

Citation and metadata

Back to the article.

Recommended citation

Bahar Pourazar, and Oscar Meruvia-Pastor, A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities. Journal of Virtual Reality and Broadcasting, 13(2016), no. 2. (urn:nbn:de:0009-6-44179)

Download Citation

Endnote

%0 Journal Article
%T A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities
%A Pourazar, Bahar
%A Meruvia-Pastor, Oscar
%J Journal of Virtual Reality and Broadcasting
%D 2017
%V 13(2016)
%N 2
%@ 1860-2037
%F pourazar2017
%X In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the   target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.
%L 004
%K Augmented Reality
%K Binocular Stereo
%K Depth Sensing Cameras
%K Disparity
%K Display Resolution
%K Field of View
%K Head-Mounted Displays
%K Human Visual System
%K Stereo Correspondence
%K Stereoacuity
%K Virtual Reality
%R 10.20385/1860-2037/13.2016.2
%U http://nbn-resolving.de/urn:nbn:de:0009-6-44179
%U http://dx.doi.org/10.20385/1860-2037/13.2016.2
Download

Bibtex

@Article{pourazar2017,
  author = 	"Pourazar, Bahar
		and Meruvia-Pastor, Oscar",
  title = 	"A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities",
  journal = 	"Journal of Virtual Reality and Broadcasting",
  year = 	"2017",
  volume = 	"13(2016)",
  number = 	"2",
  keywords = 	"Augmented Reality; Binocular Stereo; Depth Sensing Cameras; Disparity; Display Resolution; Field of View; Head-Mounted Displays; Human Visual System; Stereo Correspondence; Stereoacuity; Virtual Reality",
  abstract = 	"In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the   target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.",
  issn = 	"1860-2037",
  doi = 	"10.20385/1860-2037/13.2016.2",
  url = 	"http://nbn-resolving.de/urn:nbn:de:0009-6-44179"
}
Download

RIS

TY  - JOUR
AU  - Pourazar, Bahar
AU  - Meruvia-Pastor, Oscar
PY  - 2017
DA  - 2017//
TI  - A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities
JO  - Journal of Virtual Reality and Broadcasting
VL  - 13(2016)
IS  - 2
KW  - Augmented Reality
KW  - Binocular Stereo
KW  - Depth Sensing Cameras
KW  - Disparity
KW  - Display Resolution
KW  - Field of View
KW  - Head-Mounted Displays
KW  - Human Visual System
KW  - Stereo Correspondence
KW  - Stereoacuity
KW  - Virtual Reality
AB  - In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the   target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.
SN  - 1860-2037
UR  - http://nbn-resolving.de/urn:nbn:de:0009-6-44179
DO  - 10.20385/1860-2037/13.2016.2
ID  - pourazar2017
ER  -
Download

Wordbib

<?xml version="1.0" encoding="UTF-8"?>
<b:Sources SelectedStyle="" xmlns:b="http://schemas.openxmlformats.org/officeDocument/2006/bibliography"  xmlns="http://schemas.openxmlformats.org/officeDocument/2006/bibliography" >
<b:Source>
<b:Tag>pourazar2017</b:Tag>
<b:SourceType>ArticleInAPeriodical</b:SourceType>
<b:Year>2017</b:Year>
<b:PeriodicalTitle>Journal of Virtual Reality and Broadcasting</b:PeriodicalTitle>
<b:Volume>13(2016)</b:Volume>
<b:Issue>2</b:Issue>
<b:Url>http://nbn-resolving.de/urn:nbn:de:0009-6-44179</b:Url>
<b:Url>http://dx.doi.org/10.20385/1860-2037/13.2016.2</b:Url>
<b:Author>
<b:Author><b:NameList>
<b:Person><b:Last>Pourazar</b:Last><b:First>Bahar</b:First></b:Person>
<b:Person><b:Last>Meruvia-Pastor</b:Last><b:First>Oscar</b:First></b:Person>
</b:NameList></b:Author>
</b:Author>
<b:Title>A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities</b:Title>
<b:Comments>In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the   target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.</b:Comments>
</b:Source>
</b:Sources>
Download

ISI

PT Journal
AU Pourazar, B
   Meruvia-Pastor, O
TI A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities
SO Journal of Virtual Reality and Broadcasting
PY 2017
VL 13(2016)
IS 2
DI 10.20385/1860-2037/13.2016.2
DE Augmented Reality; Binocular Stereo; Depth Sensing Cameras; Disparity; Display Resolution; Field of View; Head-Mounted Displays; Human Visual System; Stereo Correspondence; Stereoacuity; Virtual Reality
AB In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the   target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.
ER
Download

Mods

<mods>
  <titleInfo>
    <title>A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities</title>
  </titleInfo>
  <name type="personal">
    <namePart type="family">Pourazar</namePart>
    <namePart type="given">Bahar</namePart>
  </name>
  <name type="personal">
    <namePart type="family">Meruvia-Pastor</namePart>
    <namePart type="given">Oscar</namePart>
  </name>
  <abstract>In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the   target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.</abstract>
  <subject>
    <topic>Augmented Reality</topic>
    <topic>Binocular Stereo</topic>
    <topic>Depth Sensing Cameras</topic>
    <topic>Disparity</topic>
    <topic>Display Resolution</topic>
    <topic>Field of View</topic>
    <topic>Head-Mounted Displays</topic>
    <topic>Human Visual System</topic>
    <topic>Stereo Correspondence</topic>
    <topic>Stereoacuity</topic>
    <topic>Virtual Reality</topic>
  </subject>
  <classification authority="ddc">004</classification>
  <relatedItem type="host">
    <genre authority="marcgt">periodical</genre>
    <genre>academic journal</genre>
    <titleInfo>
      <title>Journal of Virtual Reality and Broadcasting</title>
    </titleInfo>
    <part>
      <detail type="volume">
        <number>13(2016)</number>
      </detail>
      <detail type="issue">
        <number>2</number>
      </detail>
      <date>2017</date>
    </part>
  </relatedItem>
  <identifier type="issn">1860-2037</identifier>
  <identifier type="urn">urn:nbn:de:0009-6-44179</identifier>
  <identifier type="doi">10.20385/1860-2037/13.2016.2</identifier>
  <identifier type="uri">http://nbn-resolving.de/urn:nbn:de:0009-6-44179</identifier>
  <identifier type="citekey">pourazar2017</identifier>
</mods>
Download

Full Metadata

Bibliographic Citation JVRB, 13(2016), no. 2.
Title

A Comprehensive Framework for Evaluation of Stereo Correspondence Solutions in Immersive Augmented and Virtual Realities (eng)
Author Bahar Pourazar, Oscar Meruvia-Pastor
Language eng
Abstract In this article, a comprehensive approach for the evaluation of hardware and software solutions to support stereo vision and depth-dependent interactions based on the specific requirements of the human visual system within the context of augmented reality applications is presented. To evaluate stereo correspondence solutions in software, we present an evaluation model that integrates existing metrics of stereo correspondence algorithms with additional metrics that consider human factors that are relevant in the context of outdoor augmented reality systems. Our model provides modified metrics of stereoacuity, average outliers, disparity error, and processing time. These metrics have been modified to provide more relevant information with respect to the target application. We illustrate how this model can be used to evaluate two stereo correspondence methods: the OpenCV implementation of the semi-global block matching, also known as SGBM, which is a modified version of the semi-global matching by Hirschmuller; and ADCensusB, our implementation of ADCensus, by Mei et al.. To test these methods, we use a sample of fifty-two image pairs selected from the Kitti stereo dataset, which depicts many situations typical of outdoor scenery. Further on, we present an analysis of the effect and the trade-off of the post processing steps in the stereo algorithms between the accuracy of the results and performance. Experimental results show that our proposed model can provide a more detailed evaluation of both algorithms. To evaluate the hardware solutions, we use the characteristics of the human visual system as a baseline to characterize the state-of-the-art in equipment designed to support interactions within immersive augmented and virtual reality systems. The analysis suggests that current hardware developments have not yet reached the point where their characteristics adequately match the capabilities of the human visual system and serves as a reference point as to what are the desirable characteristics of such systems.
Subject Augmented Reality, Binocular Stereo, Depth Sensing Cameras, Disparity, Display Resolution, Field of View, Head-Mounted Displays, Human Visual System, Stereo Correspondence, Stereoacuity, Virtual Reality
Classified Subjects
swd
  • 4399931-1, Virtuelle Realität
  • 4715802-5, Erweiterte Realität
  • 4783877-2, Head-mounted Display
  • 4078921-4, Visuelle Wahrnehmung
  • 4157113-7, Gesichtsfeld
DDC 004
Rights DPPL
URN: urn:nbn:de:0009-6-44179
DOI https://doi.org/10.20385/1860-2037/13.2016.2