SlideShare a Scribd company logo
1 of 173
Download to read offline
Immersive Virtual Reality
          Sébastien Kuntz
          http://cb.nowan.net/blog
          Sebastien.Kuntz@nowan.net


                                       Last update
                                      November 2012
Friday, November 16, 12
License
    ”Immersive Virtual Reality Introduction” by Sebastien Kuntz is
    licensed under a Creative Commons Attribution-ShareAlike 3.0
    Unported License. http://creativecommons.org/licenses/by/3.0/
                                                                • With the understanding that:
         You are free:                                           • Waiver — Any of the above conditions can be
          •   to Share — to copy, distribute and transmit the      waived if you get permission from the copyright
              work                                                 holder.
                                                                 • Public Domain — Where the work or any of its
          •   to Remix — to adapt the work
                                                                   elements is in the public domain under applicable
          •   to make commercial use of the work                   law, that status is in no way affected by the license.
   Under the following conditions:                               • Other Rights — In no way are any of the following
    • Attribution — You must attribute the work in the             rights affected by the license:
      manner specified by the author or licensor (but not in          ◦ Your fair dealing or fair use rights, or other
      any way that suggests that they endorse you or your use           applicable copyright exceptions and limitations;
      of the work).                                                  ◦ The author's moral rights;
    • You must attribute “Immersive VR introduction” to              ◦ Rights other persons may have either in the
      (with this link):                                                 work itself or in how the work is used, such as
      • Sébastien Kuntz - http://cb.nowan.net/blog                      publicity or privacy rights.
                                                                 • Notice — For any reuse or distribution, you must
                                                                   make clear to others the license terms of this work.
                                                                   The best way to do this is with a link to this web
                                                                   page.

Friday, November 16, 12
Plan


                     Definitions
                     VR Systems
                     Applications
                     Techniques




Friday, November 16, 12
WHO AM I ?
      •   Founder                    editor of

           •   http://www.imin-vr.com

      •   AFRV - French VR association: Board member - http://www.af-rv.fr

      •   VR Geeks association: President - http://www.vrgeeks.org

      •   Blog: http://cb.nowan.net/blog

      •   Twitter: @Cb_VRGeek

      •   10 years in VR

           •   Virtools / Dassault Systèmes

           •   SNCF - French railways
Friday, November 16, 12
What is VR for you ?




Friday, November 16, 12
Immersive Virtual Reality
                               Presence in a virtual world




                                       (c) Barco
                 (c) eMagin




Friday, November 16, 12
Immersive VR = iVR


              iVR is the science and technology required for a user to
                     feel present, via perceptive, cognitive
                and functional immersion and interaction, in a
                        (computer) generated  environment.




Friday, November 16, 12
Presence
               Cognitive presence
               Perceptive presence


               Results
                     Natural interactions
                     Natural reactions



Friday, November 16, 12
What is VR ?
               Realtime 3D != VR
               Stereoscopy != VR
               3D Tracking != VR         But everything
               Haptics != VR           combined can be VR
               3D Sound != VR
               3D Interactions != VR



Friday, November 16, 12
Ridiculous
                           If it’s real VR,
                           you probably
                          look ridiculous




Friday, November 16, 12
Why now ?
     Already changing world in industry and research
     Democratization
     Are we in the future ? No ! We’re still in prehistory !
     WE can make a difference, invent systems, applications,
     businesses, interactions
Friday, November 16, 12
Measure presence ?




Friday, November 16, 12
Measure presence ?

               Can’t objectively measure presence (qualia)
               What you can measure is if people respond to
               this Virtual Environment as if it is real, which is
               a result of presence
                     Compare real-life behavior vs virtual
               If avatar: brain zone activates when user
               accepts the avatar as real



Friday, November 16, 12
Immersion parameters
               Graphics framerate
               Extent of tracking
               Tracking latency (measure?)
               Quality of the images
               Field of view
               Plausibility of behaviors
               Range of sensory modalities
               ...
Friday, November 16, 12
Paul Milgram




Friday, November 16, 12
VR Systems




Friday, November 16, 12
Projector based VR Systems




Friday, November 16, 12
CAVE




     http://www.jamstec.go.jp/esc/research/Perception/vr.en.html
Friday, November 16, 12
Cave




                           (c) Sébastien Kuntz




Friday, November 16, 12
http://www.youtube.com/watch?v=Hb29bLHEjUg
                     Clarte - SAS Cube
Friday, November 16, 12
Immersia 3




                            (c) Sébastien Kuntz
Friday, November 16, 12
Immersia 3 - IRISA Rennes




                          http://www.youtube.com/watch?v=cTd5DLe8KD0
Friday, November 16, 12
Calit2 - StarCave




            http://www.scivee.tv/node/3648
  http://www.calit2.net/newsroom/release.php?id=1383
Friday, November 16, 12
Projector based
          Reality center - HoloStage




                            (c) Arnaud Muthelet
Friday, November 16, 12
Projector based -
          Workbench




                  http://liris.cnrs.fr/~sbrandel/en/research/VR/
                  LSIIT-IGG
Friday, November 16, 12
Projector based




                          Workbench © PSA Peugeot Citroën Mediatheque.

Friday, November 16, 12
Clarte R-Screen




        http://www.youtube.com/watch?v=AcV5ma5nEVg
Friday, November 16, 12
Panoscope 360°

                                           (c) Matsushita
Friday, November 16, 12
La Géode
Friday, November 16, 12
jDome




       http://www.youtube.com/watch?v=rNsFSVhZi9w
Friday, November 16, 12
Toob
                          Immersive dome




                             http://youtu.be/N6LiLaNOHHU

Friday, November 16, 12
Barco - RP-360




   • 13 projectors
   • Diamètre: 3.4m
Friday, November 16, 12
Barco - RP-360




                          http://www.youtube.com/watch?v=3EbrQwpOx24
Friday, November 16, 12
6 users: stereo + tracking




                                        Weimar University (DE)
    http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html
Friday, November 16, 12
6 users
                    stereoscopy + tracking


                     • video


                                             Weimar University (DE)
                http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html
Friday, November 16, 12
Screen based




                          Full-scale NexCAVE developed and deployed by Calit2 for Saudi
                          Arabia's King Abdullah University of Science and Technology -
                          http://www.calit2.net/newsroom/release.php?id=1743




Friday, November 16, 12
Ultra-Short throw
                              projectors

         • Sanyo PDG-DWL2500
          • 1280x800
          • 2500 lumens
         • Canon LV-8235 UST

Friday, November 16, 12
Ultra-Short throw projectors




                          http://www.youtube.com/watch?v=VSblSrTRJh0

Friday, November 16, 12
TV-3D - 154”




                              (c) Sébastien Kuntz



Friday, November 16, 12
Projector based VR Systems
               (-)
                     (Very) expensive !
                     Lots of space ! ( front and behind, AC... )
                     Not 360°
                     Cluster hard to program !
               (+)
                     +/- Collaborative
                     Not much to wear
                     High resolution, big FOV
Friday, November 16, 12
HMD
          Head mounted displays




Friday, November 16, 12
Vuzix
          •640x480
          •32° FOV




          •852x480
          •32° FOV




Friday, November 16, 12
eMagin Z800


               800x600
               40° FOV




Friday, November 16, 12
Sony


               HMZ-T1
                     1280x1024
                     45°




Friday, November 16, 12
Sensics

               piSight
                     Multiple screens
               zSight
                     1280x1024
                     70° FOV




Friday, November 16, 12
NVIS
                          nVisor SX60
                            1280x1024
                            60° FOV
                          nVisor SX111
                            1280x1024
                            111° FOV



Friday, November 16, 12
Fakespace Labs

               Wide5
                     150° horizontal FOV
                     1600x1200
                     Progressive




Friday, November 16, 12
OCULUS RIFT
                                  • Developer kit
                                   • 90° horizontal
                                      FOV
                                   • 1280x800
                                    • 640x800 per
                                        eye




Friday, November 16, 12
HMD
               (-)
                     Low resolution, low FOV
                     Must wear, adjust
                     No peripheral vision
               (+)
                     Lightweight
                     Compact
                     Easier to program
                     360° tracking

Friday, November 16, 12
Summary
               Projector/screen based
                     Cave, holostage, workbench
                     Collaborative, high FOV
                     Expensive, Complex
               HMD
                     360°
                     “Cheap”
                     Low Fov/resolution

Friday, November 16, 12
Depth perception




Friday, November 16, 12
Depth perception



                   How do you perceive depth ?



Friday, November 16, 12
Stereoscopy ?




                          http://www.youtube.com/watch?v=Jd3-eiid-Uw
                             Johnny Lee - Head Tracking with a wiimote
Friday, November 16, 12
Stereoscopy ?




               http://www.youtube.com/watch?v=nRYybo2WNwU
                            Esiea Virtual Showcase
Friday, November 16, 12
Stereoscopy



                          You perceived depth without stereoscopy !




Friday, November 16, 12
Depth perception
                   Monoscopic cues :                    Stereoscopic cues :
                          perspective
                                                          eye accomodation
                          atmospheric artifacts (fog)
                          relative sizes
                                                          eye convergence
                                                          angle
                          occlusion
                          parallax                        disparity between left
                          shadows                         and right images

     Parallax can be more important for depth perception!
        Stereoscopy is important for size and distance
                          evaluation
Friday, November 16, 12
Stereoscopy



Friday, November 16, 12
Friday, November 16, 12
Stereoscopy
       •       Useful for
             •       Relative distance perception
             •       Detection of objects
             •       Discrimination between two objects
             •       Localisation
       •       But...
             •       Fusing problems
             •       Headaches
             •       Visual fatigue
             •       Accommodation / Vergence dissociation
Friday, November 16, 12
Different stereoscopic
          separation schemes
                  Active shutter glasses
                  Polarized glasses
                  Anaglyph
                  Infitec
                  Autostereoscopic
                  Holograms



Friday, November 16, 12
Active stereoscopy




Friday, November 16, 12
Passive Stereoscopy




                 Linear
                              Circular Polarization
               Polarization


Friday, November 16, 12
Anaglyph




Friday, November 16, 12
Infitec




                          -   Eye separation by color spectrum -




Friday, November 16, 12
Light Efficiency




 http://www.barco.com/projection_systems/downloads/Stereoscopic_technologies_overview.pdf
Friday, November 16, 12
Autostereoscopic




Friday, November 16, 12
Holograms



               Stores ALL light interactions
               through an entire “window”




Friday, November 16, 12
Holograms




Friday, November 16, 12
Stereoscopy for multiple
                              users ?



Friday, November 16, 12
Stereoscopy for multiple
          users ?


               Active + polarized
               Sequential




Friday, November 16, 12
6 users: stereo + tracking




                                        Weimar University (DE)
    http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html
Friday, November 16, 12
6 users
                    stereoscopy + tracking


                     • video


                                             Weimar University (DE)
                http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html
Friday, November 16, 12
Multi-display




Friday, November 16, 12
What system can we create
          with only one graphics card?



Friday, November 16, 12
What can we do with one
          graphics card?




Friday, November 16, 12
Nvidia SLI - ATI Crossfire
         Use two graphics card for output on only one
         graphics cards


         Alternate frame rendering




         Split frame rendering


Friday, November 16, 12
Scalable graphics
           Image decomposition ( ~= SLI )
           Useful if application is fill-rate limited
                 frame rate decreases with increasing number of pixels (i.e. when the image resolution increases)




Friday, November 16, 12
Scalable graphics
         Database decomposition
         Useful if application is CPU limited
               frame rate decreases with increasing size of 3D scenes




Friday, November 16, 12
Scalable graphics
               Stereoscopy




Friday, November 16, 12
How many displays with one
                computer ?



Friday, November 16, 12
Why multi-display ?
               Multiple display surfaces
                     Cave
               Increase display size
               Increase brightness
               CPU/GPU Bottlenecks
                     Cluster



Friday, November 16, 12
How ?
               Matrox DualHead2Go
               Matrox TripleHead2Go
               Multiple graphics card in a single PC
                     Often max 2 graphics cards
               Cyviz




Friday, November 16, 12
Multiple graphics cards in
          one PC
               Multi-pipe ~= Multi-GPU
               One rendering context per GPU
               Problems of resources sharing, threading
               Need specific graphics engine adaptations
               But best performances




Friday, November 16, 12
NVidia Quadro Plex
•Up to :
 •4 GPU
 •4 outputs
 •16gb memory
•Can combine two Quadro Plex




Friday, November 16, 12
Quadro Mosaic Mode
      Mosaic mode hides
      multi-gpu
            Only shows one gpu
            to system
      Can have 4 outputs
      with 1 plex without
      needing multi-pipe
      adaptation
      Good performances

Friday, November 16, 12
ATI EyeFinity




Friday, November 16, 12
Increase size or brightness
               Mersive autocalibration




Friday, November 16, 12
What if need more displays ?



               96 projectors ?




Friday, November 16, 12
Cluster !




Friday, November 16, 12
Cluster Synchronisation


               Scene synchronisation (Scenelock)
               Swap-Buffer synchronisation (Swaplock)
               Eyes synchronisation (Genlock)




Friday, November 16, 12
Cluster

               +
                     Scalable
                     Each node can be cheap
                     Easy node replacement
               -
                     Complex to manage/program


Friday, November 16, 12
Tracking




Friday, November 16, 12
Tracking
          Mechanical


               Fakespace’s Boom
               +
                     Precise
                     Fast
                     Help Lift weight
               -
                     Big, discontinued

Friday, November 16, 12
Tracking
          Magnetic


               Polhemus
               Ascension
               +
                     Precise, fast
               -
                     Wires
                     Sensitive to metal
Friday, November 16, 12
Tracking
          Inertial

               SpacePoint Fusion
               XSens Mocap
               Accelerometers,
               Gyroscopes, magnetometers
               +
                     Very fast
                     Light
               -
                     Drift
                     Orientation only
Friday, November 16, 12
Tracking
          Optical

               ART
               ioTracker
               OptiTrack
               TrackIR
               +
                     Wireless
                     No electronics
               -
                     Install cameras
                     Line of sight
Friday, November 16, 12
Leap motion




      https://www.youtube.com/watch?v=N6hCwjwzUHg
Friday, November 16, 12
Tracking
          Mixing Optical



               Intersense IS-900
                     Inertial + Ultrasound
               IS-1200
                     Inertial + AR Patterns
               Wiimote
               Playstation Move

Friday, November 16, 12
Optical Body Tracking


               4D Views




               http://www.4dviews.com/

Friday, November 16, 12
Friday, November 16, 12
Kinect fusion




                          http://www.youtube.com/watch?v=quGhaggn3cQ



Friday, November 16, 12
Gloves




Friday, November 16, 12
Haptics



Friday, November 16, 12
Haptics
          Force feedback




Friday, November 16, 12
Haptics
          Force feedback




Friday, November 16, 12
Haptics
          Force feedback




Friday, November 16, 12
TN Games - Gaming Vest




Friday, November 16, 12
Locomotion



Friday, November 16, 12
Locomotion




     CirculaFloor
     •   http://www.youtube.com/watch?v=rYsvB2y2Ero

     Virtusphere
     •   http://www.youtube.com/watch?v=qTnnJR-hS7k

     OmniDirectionnal Treadmill
     •   http://www.youtube.com/watch?v=BQw1tsgrJOs
Friday, November 16, 12
Kuka robot




                          http://www.cyberneum.de/f1/
Friday, November 16, 12
Force Dynamics




                          http://www.force-dynamics.com/
Friday, November 16, 12
Wizdish




                          http://www.wizdish.com
Friday, November 16, 12
Applications



Friday, November 16, 12
IVR Applications
               Design, prototyping
               Marketing
               Training
               Medical
               Research
               Geoscience, finance, archeologie, urbanism, sport, art...



Friday, November 16, 12
iVR Applications
          Design, prototyping



               Car, aircraft, boat, tractors,
               house appliances
               Collaborative design review      (c) Peugeot PSA
               Experience from user’s
               point of view
               Easy and fast to prototype
                     More iterations, better
                     products
                                                    (c) Miele
Friday, November 16, 12
PSA Peugeot-Citroen - http://www.youtube.com/watch?v=WhMh191RltQ


Friday, November 16, 12
FORD




                          http://cb.nowan.net/blog/2010/10/12/more-about-fords-vr-facilities/
Friday, November 16, 12
VR4D




                          http://vr4d.ingenierium.com/
Friday, November 16, 12
Ergo-Wide




                          http://www.clarte.asso.fr/realite-virtuelle.php/en/ERGOWIDE%C2%B3/
                                    https://www.youtube.com/watch?v=aczLiNtVyDI
Friday, November 16, 12
Lockheed Martin




              http://www.youtube.com/watch?v=itOxIpj68Mw
Friday, November 16, 12
Mockup-builder




       http://www.youtube.com/watch?v=ZxJD9DXDB1E
Friday, November 16, 12
iVR Applications
          Marketing




                     Product experience          (c) University of Gronigen




                     Shopping experience
                          Procter&Gamble
                          Kimberley Clarke



                                             (c) Virtools

Friday, November 16, 12
iVR Applications
          Training
             Repeatability
             Controlled environment
                                                        (c) SNCF
             Can practice rare / dangerous situations
             Can analyze / quantify performance
             No health risk for patients
             Easy accessibility
             Reduced costs
             Adaptable difficulty and assistance
             Multiple users trained at same time
                                                                   (c) University of Florida
             Attractive
Friday, November 16, 12
SNCF - Fiacre




Friday, November 16, 12
SNCF - Simurat




Friday, November 16, 12
Saint-Gobain & Clarte




      Use less material
            Environment friendly
            No water, nothing to clean
      Faster to setup




                http://www.youtube.com/watch?v=FEnalzHVmdI
Friday, November 16, 12
RE-lion




                          http://vimeo.com/25032061
Friday, November 16, 12
ESCIN - Sivic - Crime scene investigation




         http://www.youtube.com/watch?v=FC0gHv-Snmw
Friday, November 16, 12
iVR Applications
          Research


            Heal
                  Exposure therapy
                          PTSD, Phobias
                  Rehabilitation :
                   motor, addictions
            Create Empathy
                                          http://www.youtube.com/watch?v=SinlgK5Q4v4
            Pain Distraction                 Crescent - Acrophobia

Friday, November 16, 12
Burn pain - Snow World




                http://www.youtube.com/watch?v=jNIqyyypojg
Friday, November 16, 12
Fear of flight




                  Arte - “A chacun sa réalité”

Friday, November 16, 12
Summary

               IVR strengths
                     Controlled / adaptable / safe environment
                     Natural interactions / reactions
                     Analyze




Friday, November 16, 12
iVR Games ?




                          Cave Quake 3 (c) Paul Rajlich




                                                          Cave Unreal Tournament
                                                            (c) Jeffrey Jacobson
Friday, November 16, 12
https://www.youtube.com/watch?v=r580mzSxSp8


Friday, November 16, 12
Immersive rail shooter




                          http://vimeo.com/9549613
Friday, November 16, 12
VR Angry-bot




          http://www.youtube.com/watch?v=QSXxjr1SnqA
Friday, November 16, 12
Battlefield 3 simulator




                          www.youtube.com/watch?v=nQR49JGySTM


Friday, November 16, 12
3D User Interactions




Friday, November 16, 12
VR Techniques
          3D User Interactions

               Bowman classification for generic interactions
                  Selection
                       Specifying one or more objects from a set
                  Manipulation
                       Modifying object properties (position, orientation,
                          scale, shape, color, texture, behavior, etc.)
                  Navigation
                       Travel
                       Wayfinding
                  System Control
                       Menus
                       Issuing command
                       Changing mode
                       Choosing tool
                  Symbolic Input
               Other interactions
                  Measuring
                  …?
                                                                        http://www.3dui.org
Friday, November 16, 12
Navidget




            http://www.youtube.com/watch?v=wpaKjLZll80
Friday, November 16, 12
Friday, November 16, 12
http://cb.nowan.net/blog/2010/03/25/3dui-grand-prize-2010-the-winners/

Friday, November 16, 12
http://cb.nowan.net/blog/2010/03/25/3dui-grand-prize-2010-the-winners/

Friday, November 16, 12
Friday, November 16, 12
Friday, November 16, 12
World builder




        http://www.youtube.com/watch?v=VzFpg271sm8
Friday, November 16, 12
Perceptive illusions




Friday, November 16, 12
Body representation in VR



               Proteus effect : virtual appearance can transform our
               behaviors towards other people ( Jeremy Bailenson )
               It seems possible to transfer our body in virtual bodies




Friday, November 16, 12
Rubber hand illusion




               http://www.youtube.com/watch?v=TCQbygjG0RU
Friday, November 16, 12
Body transfer




                     http://www.youtube.com/watch?v=8oF8sQvnTlM
Friday, November 16, 12
Barbie doll illusion




               http://www.youtube.com/watch?v=_z8pSTMfGSo
Friday, November 16, 12
First person VR illusion




               http://www.youtube.com/watch?v=DlbSVnVRLTU
Friday, November 16, 12
Perceptive
          Ilusions
           Pseudo haptics


                                            http://kaji-lab.jp/ja/index.php?research




             http://www.irisa.fr/tactiles
Friday, November 16, 12
Perceptive Ilusions
                Pseudo haptics




Friday, November 16, 12
Perceptive Illusions
               Play with perception’s limits
               Our perception is dominated by visual sense
                     Balance
                     Redirected Walking :




                                               (c) Franck Steinicke
Friday, November 16, 12
Perceptive illusions
                     Change blindness :




                              (c) Evan Suma - USC/ICT
Friday, November 16, 12
Institute of creative technologies - change blindess




      https://www.youtube.com/watch?v=FTWVjJ4um4A
Friday, November 16, 12
Friday, November 16, 12
Perceptive Illusions
                     Passive haptics




                                       (c) Luv Kohli
Friday, November 16, 12
Passive haptics

               Ford PVM




Friday, November 16, 12
Perceptive illusions


               Learn about human perception through its limitations
               Improve VR experience by taking advantage of those
               limitations




Friday, November 16, 12
Conclusion


               It is possible to transfer your body in VR
               Reality is not what you think
                     VR is just another reality




Friday, November 16, 12
http://www.af-rv.fr
Friday, November 16, 12
AFRV




               http://www.youtube.com/watch?v=lHZltjDZBJo&feature=plcp



Friday, November 16, 12
Friday, November 16, 12
                          www.VRGeeks.org
http://www.vrgeeks.org/vr-experiences/vrescape
Friday, November 16, 12
http://www.vrgeeks.org/vr-experiences/vrsadistic
Friday, November 16, 12
http://www.vrgeeks.org/vr-experiences/insnaketion
Friday, November 16, 12
Friday, November 16, 12
VR Challenges
          What we must solve
               VR is mainly a SOFTWARE problem
                     “3DUI is a hard and unexplored software engineering (and ergonomic) problem”
               Markerless tracking
               Minimum latency
               HMDs
                     Lightweight
                     Wide FOV
                     Wireless
               Full body haptics
               Multi-sensorial experience
               Locomotion
               Avatars

               VR For All
Friday, November 16, 12
VR “Experiences”




    Your goal :
          Create presence
          And don’t break it !!!

                                   Verdun 1916-Time machine
                          http://www.youtube.com/watch?v=ZBfYIefenp0
Friday, November 16, 12
Conclusion




Friday, November 16, 12
Thank you !
                             Questions ?

                          Sebastien.Kuntz@nowan.net

Friday, November 16, 12

More Related Content

What's hot

Virtual Reality and Augmented Reality
Virtual Reality and Augmented RealityVirtual Reality and Augmented Reality
Virtual Reality and Augmented RealityNikitaGour5
 
Virtual Reality Technology.pptx
Virtual Reality Technology.pptxVirtual Reality Technology.pptx
Virtual Reality Technology.pptxLSURYAPRAKASHREDDY
 
Virtual reality
Virtual realityVirtual reality
Virtual realityAmit Sinha
 
Virtual Reality vs Augmented Reality - Knowing the Difference
Virtual Reality vs Augmented Reality - Knowing the DifferenceVirtual Reality vs Augmented Reality - Knowing the Difference
Virtual Reality vs Augmented Reality - Knowing the DifferenceAugment
 
virtual reality ppt
virtual reality pptvirtual reality ppt
virtual reality pptBhagyaReddy8
 
Introducing virtual reality
Introducing  virtual  realityIntroducing  virtual  reality
Introducing virtual realitySagar Suvarnakar
 
Augmented Reality (AR)
Augmented Reality (AR)Augmented Reality (AR)
Augmented Reality (AR)Samsil Arefin
 
Virtual reality (vr) presentation
Virtual reality (vr) presentation Virtual reality (vr) presentation
Virtual reality (vr) presentation Ranjeet Kumar
 
VIRTUAL REALITY (VR) ppt
VIRTUAL REALITY (VR) pptVIRTUAL REALITY (VR) ppt
VIRTUAL REALITY (VR) pptKhumanDewangan
 
Virtual reality
Virtual reality Virtual reality
Virtual reality DeepikaDG1
 

What's hot (20)

Virtual Reality and Augmented Reality
Virtual Reality and Augmented RealityVirtual Reality and Augmented Reality
Virtual Reality and Augmented Reality
 
Virtual Reality Technology.pptx
Virtual Reality Technology.pptxVirtual Reality Technology.pptx
Virtual Reality Technology.pptx
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Reality
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 
Augmented reality ppt
Augmented reality pptAugmented reality ppt
Augmented reality ppt
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
AR & VR technology
AR & VR technologyAR & VR technology
AR & VR technology
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 
Virtual Reality vs Augmented Reality - Knowing the Difference
Virtual Reality vs Augmented Reality - Knowing the DifferenceVirtual Reality vs Augmented Reality - Knowing the Difference
Virtual Reality vs Augmented Reality - Knowing the Difference
 
virtual reality ppt
virtual reality pptvirtual reality ppt
virtual reality ppt
 
Introducing virtual reality
Introducing  virtual  realityIntroducing  virtual  reality
Introducing virtual reality
 
Augmented Reality (AR)
Augmented Reality (AR)Augmented Reality (AR)
Augmented Reality (AR)
 
Virtual reality The Future
Virtual reality The FutureVirtual reality The Future
Virtual reality The Future
 
Augmented reality
Augmented realityAugmented reality
Augmented reality
 
Virtual reality (vr) presentation
Virtual reality (vr) presentation Virtual reality (vr) presentation
Virtual reality (vr) presentation
 
VIRTUAL REALITY (VR) ppt
VIRTUAL REALITY (VR) pptVIRTUAL REALITY (VR) ppt
VIRTUAL REALITY (VR) ppt
 
Virtual reality
Virtual reality Virtual reality
Virtual reality
 
Virtual reality
Virtual realityVirtual reality
Virtual reality
 

Similar to Immersive Virtual Reality

@Bristol Data Dome workshop - NSC Creative
@Bristol Data Dome workshop - NSC Creative@Bristol Data Dome workshop - NSC Creative
@Bristol Data Dome workshop - NSC CreativeSouth West Data Meetup
 
The Future of the Cinema Experience – Shared Augmented Cinema
The Future of the Cinema Experience – Shared Augmented CinemaThe Future of the Cinema Experience – Shared Augmented Cinema
The Future of the Cinema Experience – Shared Augmented CinemaChris Ward
 
Natural User Interfaces in a Nutshel
Natural User Interfaces in a NutshelNatural User Interfaces in a Nutshel
Natural User Interfaces in a NutshelMichael Heydt
 
Hack Reality - awe
Hack Reality - aweHack Reality - awe
Hack Reality - aweAlex Young
 
The Emerging Virtual Reality Landscape: a Primer
The Emerging Virtual Reality Landscape: a PrimerThe Emerging Virtual Reality Landscape: a Primer
The Emerging Virtual Reality Landscape: a PrimerSim Blaustein
 
New Media Services from a Mobile Chipset Vendor and Standardization Perspective
New Media Services from a Mobile Chipset Vendor and Standardization PerspectiveNew Media Services from a Mobile Chipset Vendor and Standardization Perspective
New Media Services from a Mobile Chipset Vendor and Standardization PerspectiveFörderverein Technische Fakultät
 
SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
SEARIS 2014 Keynote - MiddleVR - Philosophy and architectureSEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
SEARIS 2014 Keynote - MiddleVR - Philosophy and architectureSebastien Kuntz
 
Paweł Ruszlewski - First steps in Mixed Reality design
Paweł Ruszlewski - First steps in Mixed Reality designPaweł Ruszlewski - First steps in Mixed Reality design
Paweł Ruszlewski - First steps in Mixed Reality designPaweł Ruszlewski
 
Toward webXR (POOS 2017)
Toward webXR (POOS 2017)Toward webXR (POOS 2017)
Toward webXR (POOS 2017)Thomas Bourgeau
 
blueMarine a desktop app for the open source photographic workflow
blueMarine  a desktop app for the open source photographic workflowblueMarine  a desktop app for the open source photographic workflow
blueMarine a desktop app for the open source photographic workflowFabrizio Giudici
 
The History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual ExperienceThe History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual ExperienceC4Media
 
Layar at WPP Stream 2010
Layar at  WPP Stream 2010Layar at  WPP Stream 2010
Layar at WPP Stream 2010Layar
 
Georgia Tech hacking Accessibility
Georgia Tech hacking AccessibilityGeorgia Tech hacking Accessibility
Georgia Tech hacking AccessibilityChristian Heilmann
 
Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...
Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...
Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...ascribeIO
 
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heaven
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenUDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heaven
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenPatrick Chanezon
 
Ict presentation
Ict presentationIct presentation
Ict presentationchuchikwong
 
Show and Tell (with notes)
Show and Tell (with notes)Show and Tell (with notes)
Show and Tell (with notes)Tom Jenkins
 

Similar to Immersive Virtual Reality (20)

@Bristol Data Dome workshop - NSC Creative
@Bristol Data Dome workshop - NSC Creative@Bristol Data Dome workshop - NSC Creative
@Bristol Data Dome workshop - NSC Creative
 
The Future of the Cinema Experience – Shared Augmented Cinema
The Future of the Cinema Experience – Shared Augmented CinemaThe Future of the Cinema Experience – Shared Augmented Cinema
The Future of the Cinema Experience – Shared Augmented Cinema
 
Natural User Interfaces in a Nutshel
Natural User Interfaces in a NutshelNatural User Interfaces in a Nutshel
Natural User Interfaces in a Nutshel
 
Hack Reality - awe
Hack Reality - aweHack Reality - awe
Hack Reality - awe
 
The Emerging Virtual Reality Landscape: a Primer
The Emerging Virtual Reality Landscape: a PrimerThe Emerging Virtual Reality Landscape: a Primer
The Emerging Virtual Reality Landscape: a Primer
 
Making VR Webby
Making VR WebbyMaking VR Webby
Making VR Webby
 
New Media Services from a Mobile Chipset Vendor and Standardization Perspective
New Media Services from a Mobile Chipset Vendor and Standardization PerspectiveNew Media Services from a Mobile Chipset Vendor and Standardization Perspective
New Media Services from a Mobile Chipset Vendor and Standardization Perspective
 
SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
SEARIS 2014 Keynote - MiddleVR - Philosophy and architectureSEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
 
Paweł Ruszlewski - First steps in Mixed Reality design
Paweł Ruszlewski - First steps in Mixed Reality designPaweł Ruszlewski - First steps in Mixed Reality design
Paweł Ruszlewski - First steps in Mixed Reality design
 
Toward webXR (POOS 2017)
Toward webXR (POOS 2017)Toward webXR (POOS 2017)
Toward webXR (POOS 2017)
 
blueMarine a desktop app for the open source photographic workflow
blueMarine  a desktop app for the open source photographic workflowblueMarine  a desktop app for the open source photographic workflow
blueMarine a desktop app for the open source photographic workflow
 
The History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual ExperienceThe History and Future of Wearable Computing and Virtual Experience
The History and Future of Wearable Computing and Virtual Experience
 
Layar at WPP Stream 2010
Layar at  WPP Stream 2010Layar at  WPP Stream 2010
Layar at WPP Stream 2010
 
Georgia Tech hacking Accessibility
Georgia Tech hacking AccessibilityGeorgia Tech hacking Accessibility
Georgia Tech hacking Accessibility
 
Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...
Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...
Rewiring the Internet for Ownership with Big Data and Blockchains, by Trent M...
 
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heaven
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenUDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heaven
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heaven
 
Ict presentation
Ict presentationIct presentation
Ict presentation
 
Show and Tell (with notes)
Show and Tell (with notes)Show and Tell (with notes)
Show and Tell (with notes)
 
Sketching in Code
Sketching in CodeSketching in Code
Sketching in Code
 
wotxr-20190320rzr
wotxr-20190320rzrwotxr-20190320rzr
wotxr-20190320rzr
 

More from Sebastien Kuntz

2016-10 - Laval Virtual Days - Training
2016-10 - Laval Virtual Days - Training2016-10 - Laval Virtual Days - Training
2016-10 - Laval Virtual Days - TrainingSebastien Kuntz
 
Oculus Connect 2014 - The value of VR for professional applications
Oculus Connect 2014 - The value of VR for professional applicationsOculus Connect 2014 - The value of VR for professional applications
Oculus Connect 2014 - The value of VR for professional applicationsSebastien Kuntz
 
IEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
IEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architectureIEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
IEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architectureSebastien Kuntz
 
VR - Creating the ultimate reality
VR - Creating the ultimate realityVR - Creating the ultimate reality
VR - Creating the ultimate realitySebastien Kuntz
 
SAE AR/VR - The challenges of creating a VR application with Unity
SAE AR/VR - The challenges of creating a VR application with UnitySAE AR/VR - The challenges of creating a VR application with Unity
SAE AR/VR - The challenges of creating a VR application with UnitySebastien Kuntz
 
Improving the VR experience - VRST 2012
Improving the VR experience - VRST 2012Improving the VR experience - VRST 2012
Improving the VR experience - VRST 2012Sebastien Kuntz
 
Innovations technologiques pour l'immersion
Innovations technologiques pour l'immersionInnovations technologiques pour l'immersion
Innovations technologiques pour l'immersionSebastien Kuntz
 

More from Sebastien Kuntz (9)

VR in aerospace
VR in aerospaceVR in aerospace
VR in aerospace
 
2016-10 - Laval Virtual Days - Training
2016-10 - Laval Virtual Days - Training2016-10 - Laval Virtual Days - Training
2016-10 - Laval Virtual Days - Training
 
Oculus Connect 2014 - The value of VR for professional applications
Oculus Connect 2014 - The value of VR for professional applicationsOculus Connect 2014 - The value of VR for professional applications
Oculus Connect 2014 - The value of VR for professional applications
 
IEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
IEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architectureIEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
IEEE VR-SEARIS 2014 Keynote - MiddleVR - Philosophy and architecture
 
VR - Creating the ultimate reality
VR - Creating the ultimate realityVR - Creating the ultimate reality
VR - Creating the ultimate reality
 
SAE AR/VR - The challenges of creating a VR application with Unity
SAE AR/VR - The challenges of creating a VR application with UnitySAE AR/VR - The challenges of creating a VR application with Unity
SAE AR/VR - The challenges of creating a VR application with Unity
 
Improving the VR experience - VRST 2012
Improving the VR experience - VRST 2012Improving the VR experience - VRST 2012
Improving the VR experience - VRST 2012
 
Unite 2012: MiddleVR
Unite 2012: MiddleVRUnite 2012: MiddleVR
Unite 2012: MiddleVR
 
Innovations technologiques pour l'immersion
Innovations technologiques pour l'immersionInnovations technologiques pour l'immersion
Innovations technologiques pour l'immersion
 

Immersive Virtual Reality

  • 1. Immersive Virtual Reality Sébastien Kuntz http://cb.nowan.net/blog Sebastien.Kuntz@nowan.net Last update November 2012 Friday, November 16, 12
  • 2. License ”Immersive Virtual Reality Introduction” by Sebastien Kuntz is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License. http://creativecommons.org/licenses/by/3.0/ • With the understanding that: You are free: • Waiver — Any of the above conditions can be • to Share — to copy, distribute and transmit the waived if you get permission from the copyright work holder. • Public Domain — Where the work or any of its • to Remix — to adapt the work elements is in the public domain under applicable • to make commercial use of the work law, that status is in no way affected by the license. Under the following conditions: • Other Rights — In no way are any of the following • Attribution — You must attribute the work in the rights affected by the license: manner specified by the author or licensor (but not in ◦ Your fair dealing or fair use rights, or other any way that suggests that they endorse you or your use applicable copyright exceptions and limitations; of the work). ◦ The author's moral rights; • You must attribute “Immersive VR introduction” to ◦ Rights other persons may have either in the (with this link): work itself or in how the work is used, such as • Sébastien Kuntz - http://cb.nowan.net/blog publicity or privacy rights. • Notice — For any reuse or distribution, you must make clear to others the license terms of this work. The best way to do this is with a link to this web page. Friday, November 16, 12
  • 3. Plan Definitions VR Systems Applications Techniques Friday, November 16, 12
  • 4. WHO AM I ? • Founder editor of • http://www.imin-vr.com • AFRV - French VR association: Board member - http://www.af-rv.fr • VR Geeks association: President - http://www.vrgeeks.org • Blog: http://cb.nowan.net/blog • Twitter: @Cb_VRGeek • 10 years in VR • Virtools / Dassault Systèmes • SNCF - French railways Friday, November 16, 12
  • 5. What is VR for you ? Friday, November 16, 12
  • 6. Immersive Virtual Reality Presence in a virtual world (c) Barco (c) eMagin Friday, November 16, 12
  • 7. Immersive VR = iVR iVR is the science and technology required for a user to feel present, via perceptive, cognitive and functional immersion and interaction, in a (computer) generated  environment. Friday, November 16, 12
  • 8. Presence Cognitive presence Perceptive presence Results Natural interactions Natural reactions Friday, November 16, 12
  • 9. What is VR ? Realtime 3D != VR Stereoscopy != VR 3D Tracking != VR But everything Haptics != VR combined can be VR 3D Sound != VR 3D Interactions != VR Friday, November 16, 12
  • 10. Ridiculous If it’s real VR, you probably look ridiculous Friday, November 16, 12
  • 11. Why now ? Already changing world in industry and research Democratization Are we in the future ? No ! We’re still in prehistory ! WE can make a difference, invent systems, applications, businesses, interactions Friday, November 16, 12
  • 12. Measure presence ? Friday, November 16, 12
  • 13. Measure presence ? Can’t objectively measure presence (qualia) What you can measure is if people respond to this Virtual Environment as if it is real, which is a result of presence Compare real-life behavior vs virtual If avatar: brain zone activates when user accepts the avatar as real Friday, November 16, 12
  • 14. Immersion parameters Graphics framerate Extent of tracking Tracking latency (measure?) Quality of the images Field of view Plausibility of behaviors Range of sensory modalities ... Friday, November 16, 12
  • 17. Projector based VR Systems Friday, November 16, 12
  • 18. CAVE http://www.jamstec.go.jp/esc/research/Perception/vr.en.html Friday, November 16, 12
  • 19. Cave (c) Sébastien Kuntz Friday, November 16, 12
  • 20. http://www.youtube.com/watch?v=Hb29bLHEjUg Clarte - SAS Cube Friday, November 16, 12
  • 21. Immersia 3 (c) Sébastien Kuntz Friday, November 16, 12
  • 22. Immersia 3 - IRISA Rennes http://www.youtube.com/watch?v=cTd5DLe8KD0 Friday, November 16, 12
  • 23. Calit2 - StarCave http://www.scivee.tv/node/3648 http://www.calit2.net/newsroom/release.php?id=1383 Friday, November 16, 12
  • 24. Projector based Reality center - HoloStage (c) Arnaud Muthelet Friday, November 16, 12
  • 25. Projector based - Workbench http://liris.cnrs.fr/~sbrandel/en/research/VR/ LSIIT-IGG Friday, November 16, 12
  • 26. Projector based Workbench © PSA Peugeot Citroën Mediatheque. Friday, November 16, 12
  • 27. Clarte R-Screen http://www.youtube.com/watch?v=AcV5ma5nEVg Friday, November 16, 12
  • 28. Panoscope 360° (c) Matsushita Friday, November 16, 12
  • 30. jDome http://www.youtube.com/watch?v=rNsFSVhZi9w Friday, November 16, 12
  • 31. Toob Immersive dome http://youtu.be/N6LiLaNOHHU Friday, November 16, 12
  • 32. Barco - RP-360 • 13 projectors • Diamètre: 3.4m Friday, November 16, 12
  • 33. Barco - RP-360 http://www.youtube.com/watch?v=3EbrQwpOx24 Friday, November 16, 12
  • 34. 6 users: stereo + tracking Weimar University (DE) http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html Friday, November 16, 12
  • 35. 6 users stereoscopy + tracking • video Weimar University (DE) http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html Friday, November 16, 12
  • 36. Screen based Full-scale NexCAVE developed and deployed by Calit2 for Saudi Arabia's King Abdullah University of Science and Technology - http://www.calit2.net/newsroom/release.php?id=1743 Friday, November 16, 12
  • 37. Ultra-Short throw projectors • Sanyo PDG-DWL2500 • 1280x800 • 2500 lumens • Canon LV-8235 UST Friday, November 16, 12
  • 38. Ultra-Short throw projectors http://www.youtube.com/watch?v=VSblSrTRJh0 Friday, November 16, 12
  • 39. TV-3D - 154” (c) Sébastien Kuntz Friday, November 16, 12
  • 40. Projector based VR Systems (-) (Very) expensive ! Lots of space ! ( front and behind, AC... ) Not 360° Cluster hard to program ! (+) +/- Collaborative Not much to wear High resolution, big FOV Friday, November 16, 12
  • 41. HMD Head mounted displays Friday, November 16, 12
  • 42. Vuzix •640x480 •32° FOV •852x480 •32° FOV Friday, November 16, 12
  • 43. eMagin Z800 800x600 40° FOV Friday, November 16, 12
  • 44. Sony HMZ-T1 1280x1024 45° Friday, November 16, 12
  • 45. Sensics piSight Multiple screens zSight 1280x1024 70° FOV Friday, November 16, 12
  • 46. NVIS nVisor SX60 1280x1024 60° FOV nVisor SX111 1280x1024 111° FOV Friday, November 16, 12
  • 47. Fakespace Labs Wide5 150° horizontal FOV 1600x1200 Progressive Friday, November 16, 12
  • 48. OCULUS RIFT • Developer kit • 90° horizontal FOV • 1280x800 • 640x800 per eye Friday, November 16, 12
  • 49. HMD (-) Low resolution, low FOV Must wear, adjust No peripheral vision (+) Lightweight Compact Easier to program 360° tracking Friday, November 16, 12
  • 50. Summary Projector/screen based Cave, holostage, workbench Collaborative, high FOV Expensive, Complex HMD 360° “Cheap” Low Fov/resolution Friday, November 16, 12
  • 52. Depth perception How do you perceive depth ? Friday, November 16, 12
  • 53. Stereoscopy ? http://www.youtube.com/watch?v=Jd3-eiid-Uw Johnny Lee - Head Tracking with a wiimote Friday, November 16, 12
  • 54. Stereoscopy ? http://www.youtube.com/watch?v=nRYybo2WNwU Esiea Virtual Showcase Friday, November 16, 12
  • 55. Stereoscopy You perceived depth without stereoscopy ! Friday, November 16, 12
  • 56. Depth perception Monoscopic cues : Stereoscopic cues : perspective eye accomodation atmospheric artifacts (fog) relative sizes eye convergence angle occlusion parallax disparity between left shadows and right images Parallax can be more important for depth perception! Stereoscopy is important for size and distance evaluation Friday, November 16, 12
  • 59. Stereoscopy • Useful for • Relative distance perception • Detection of objects • Discrimination between two objects • Localisation • But... • Fusing problems • Headaches • Visual fatigue • Accommodation / Vergence dissociation Friday, November 16, 12
  • 60. Different stereoscopic separation schemes Active shutter glasses Polarized glasses Anaglyph Infitec Autostereoscopic Holograms Friday, November 16, 12
  • 62. Passive Stereoscopy Linear Circular Polarization Polarization Friday, November 16, 12
  • 64. Infitec - Eye separation by color spectrum - Friday, November 16, 12
  • 67. Holograms Stores ALL light interactions through an entire “window” Friday, November 16, 12
  • 69. Stereoscopy for multiple users ? Friday, November 16, 12
  • 70. Stereoscopy for multiple users ? Active + polarized Sequential Friday, November 16, 12
  • 71. 6 users: stereo + tracking Weimar University (DE) http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html Friday, November 16, 12
  • 72. 6 users stereoscopy + tracking • video Weimar University (DE) http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html Friday, November 16, 12
  • 74. What system can we create with only one graphics card? Friday, November 16, 12
  • 75. What can we do with one graphics card? Friday, November 16, 12
  • 76. Nvidia SLI - ATI Crossfire Use two graphics card for output on only one graphics cards Alternate frame rendering Split frame rendering Friday, November 16, 12
  • 77. Scalable graphics Image decomposition ( ~= SLI ) Useful if application is fill-rate limited frame rate decreases with increasing number of pixels (i.e. when the image resolution increases) Friday, November 16, 12
  • 78. Scalable graphics Database decomposition Useful if application is CPU limited frame rate decreases with increasing size of 3D scenes Friday, November 16, 12
  • 79. Scalable graphics Stereoscopy Friday, November 16, 12
  • 80. How many displays with one computer ? Friday, November 16, 12
  • 81. Why multi-display ? Multiple display surfaces Cave Increase display size Increase brightness CPU/GPU Bottlenecks Cluster Friday, November 16, 12
  • 82. How ? Matrox DualHead2Go Matrox TripleHead2Go Multiple graphics card in a single PC Often max 2 graphics cards Cyviz Friday, November 16, 12
  • 83. Multiple graphics cards in one PC Multi-pipe ~= Multi-GPU One rendering context per GPU Problems of resources sharing, threading Need specific graphics engine adaptations But best performances Friday, November 16, 12
  • 84. NVidia Quadro Plex •Up to : •4 GPU •4 outputs •16gb memory •Can combine two Quadro Plex Friday, November 16, 12
  • 85. Quadro Mosaic Mode Mosaic mode hides multi-gpu Only shows one gpu to system Can have 4 outputs with 1 plex without needing multi-pipe adaptation Good performances Friday, November 16, 12
  • 87. Increase size or brightness Mersive autocalibration Friday, November 16, 12
  • 88. What if need more displays ? 96 projectors ? Friday, November 16, 12
  • 90. Cluster Synchronisation Scene synchronisation (Scenelock) Swap-Buffer synchronisation (Swaplock) Eyes synchronisation (Genlock) Friday, November 16, 12
  • 91. Cluster + Scalable Each node can be cheap Easy node replacement - Complex to manage/program Friday, November 16, 12
  • 93. Tracking Mechanical Fakespace’s Boom + Precise Fast Help Lift weight - Big, discontinued Friday, November 16, 12
  • 94. Tracking Magnetic Polhemus Ascension + Precise, fast - Wires Sensitive to metal Friday, November 16, 12
  • 95. Tracking Inertial SpacePoint Fusion XSens Mocap Accelerometers, Gyroscopes, magnetometers + Very fast Light - Drift Orientation only Friday, November 16, 12
  • 96. Tracking Optical ART ioTracker OptiTrack TrackIR + Wireless No electronics - Install cameras Line of sight Friday, November 16, 12
  • 97. Leap motion https://www.youtube.com/watch?v=N6hCwjwzUHg Friday, November 16, 12
  • 98. Tracking Mixing Optical Intersense IS-900 Inertial + Ultrasound IS-1200 Inertial + AR Patterns Wiimote Playstation Move Friday, November 16, 12
  • 99. Optical Body Tracking 4D Views http://www.4dviews.com/ Friday, November 16, 12
  • 101. Kinect fusion http://www.youtube.com/watch?v=quGhaggn3cQ Friday, November 16, 12
  • 104. Haptics Force feedback Friday, November 16, 12
  • 105. Haptics Force feedback Friday, November 16, 12
  • 106. Haptics Force feedback Friday, November 16, 12
  • 107. TN Games - Gaming Vest Friday, November 16, 12
  • 109. Locomotion CirculaFloor • http://www.youtube.com/watch?v=rYsvB2y2Ero Virtusphere • http://www.youtube.com/watch?v=qTnnJR-hS7k OmniDirectionnal Treadmill • http://www.youtube.com/watch?v=BQw1tsgrJOs Friday, November 16, 12
  • 110. Kuka robot http://www.cyberneum.de/f1/ Friday, November 16, 12
  • 111. Force Dynamics http://www.force-dynamics.com/ Friday, November 16, 12
  • 112. Wizdish http://www.wizdish.com Friday, November 16, 12
  • 114. IVR Applications Design, prototyping Marketing Training Medical Research Geoscience, finance, archeologie, urbanism, sport, art... Friday, November 16, 12
  • 115. iVR Applications Design, prototyping Car, aircraft, boat, tractors, house appliances Collaborative design review (c) Peugeot PSA Experience from user’s point of view Easy and fast to prototype More iterations, better products (c) Miele Friday, November 16, 12
  • 116. PSA Peugeot-Citroen - http://www.youtube.com/watch?v=WhMh191RltQ Friday, November 16, 12
  • 117. FORD http://cb.nowan.net/blog/2010/10/12/more-about-fords-vr-facilities/ Friday, November 16, 12
  • 118. VR4D http://vr4d.ingenierium.com/ Friday, November 16, 12
  • 119. Ergo-Wide http://www.clarte.asso.fr/realite-virtuelle.php/en/ERGOWIDE%C2%B3/ https://www.youtube.com/watch?v=aczLiNtVyDI Friday, November 16, 12
  • 120. Lockheed Martin http://www.youtube.com/watch?v=itOxIpj68Mw Friday, November 16, 12
  • 121. Mockup-builder http://www.youtube.com/watch?v=ZxJD9DXDB1E Friday, November 16, 12
  • 122. iVR Applications Marketing Product experience (c) University of Gronigen Shopping experience Procter&Gamble Kimberley Clarke (c) Virtools Friday, November 16, 12
  • 123. iVR Applications Training Repeatability Controlled environment (c) SNCF Can practice rare / dangerous situations Can analyze / quantify performance No health risk for patients Easy accessibility Reduced costs Adaptable difficulty and assistance Multiple users trained at same time (c) University of Florida Attractive Friday, November 16, 12
  • 124. SNCF - Fiacre Friday, November 16, 12
  • 125. SNCF - Simurat Friday, November 16, 12
  • 126. Saint-Gobain & Clarte Use less material Environment friendly No water, nothing to clean Faster to setup http://www.youtube.com/watch?v=FEnalzHVmdI Friday, November 16, 12
  • 127. RE-lion http://vimeo.com/25032061 Friday, November 16, 12
  • 128. ESCIN - Sivic - Crime scene investigation http://www.youtube.com/watch?v=FC0gHv-Snmw Friday, November 16, 12
  • 129. iVR Applications Research Heal Exposure therapy PTSD, Phobias Rehabilitation : motor, addictions Create Empathy http://www.youtube.com/watch?v=SinlgK5Q4v4 Pain Distraction Crescent - Acrophobia Friday, November 16, 12
  • 130. Burn pain - Snow World http://www.youtube.com/watch?v=jNIqyyypojg Friday, November 16, 12
  • 131. Fear of flight Arte - “A chacun sa réalité” Friday, November 16, 12
  • 132. Summary IVR strengths Controlled / adaptable / safe environment Natural interactions / reactions Analyze Friday, November 16, 12
  • 133. iVR Games ? Cave Quake 3 (c) Paul Rajlich Cave Unreal Tournament (c) Jeffrey Jacobson Friday, November 16, 12
  • 135. Immersive rail shooter http://vimeo.com/9549613 Friday, November 16, 12
  • 136. VR Angry-bot http://www.youtube.com/watch?v=QSXxjr1SnqA Friday, November 16, 12
  • 137. Battlefield 3 simulator www.youtube.com/watch?v=nQR49JGySTM Friday, November 16, 12
  • 138. 3D User Interactions Friday, November 16, 12
  • 139. VR Techniques 3D User Interactions Bowman classification for generic interactions Selection Specifying one or more objects from a set Manipulation Modifying object properties (position, orientation, scale, shape, color, texture, behavior, etc.) Navigation Travel Wayfinding System Control Menus Issuing command Changing mode Choosing tool Symbolic Input Other interactions Measuring …? http://www.3dui.org Friday, November 16, 12
  • 140. Navidget http://www.youtube.com/watch?v=wpaKjLZll80 Friday, November 16, 12
  • 146. World builder http://www.youtube.com/watch?v=VzFpg271sm8 Friday, November 16, 12
  • 148. Body representation in VR Proteus effect : virtual appearance can transform our behaviors towards other people ( Jeremy Bailenson ) It seems possible to transfer our body in virtual bodies Friday, November 16, 12
  • 149. Rubber hand illusion http://www.youtube.com/watch?v=TCQbygjG0RU Friday, November 16, 12
  • 150. Body transfer http://www.youtube.com/watch?v=8oF8sQvnTlM Friday, November 16, 12
  • 151. Barbie doll illusion http://www.youtube.com/watch?v=_z8pSTMfGSo Friday, November 16, 12
  • 152. First person VR illusion http://www.youtube.com/watch?v=DlbSVnVRLTU Friday, November 16, 12
  • 153. Perceptive Ilusions Pseudo haptics http://kaji-lab.jp/ja/index.php?research http://www.irisa.fr/tactiles Friday, November 16, 12
  • 154. Perceptive Ilusions Pseudo haptics Friday, November 16, 12
  • 155. Perceptive Illusions Play with perception’s limits Our perception is dominated by visual sense Balance Redirected Walking : (c) Franck Steinicke Friday, November 16, 12
  • 156. Perceptive illusions Change blindness : (c) Evan Suma - USC/ICT Friday, November 16, 12
  • 157. Institute of creative technologies - change blindess https://www.youtube.com/watch?v=FTWVjJ4um4A Friday, November 16, 12
  • 159. Perceptive Illusions Passive haptics (c) Luv Kohli Friday, November 16, 12
  • 160. Passive haptics Ford PVM Friday, November 16, 12
  • 161. Perceptive illusions Learn about human perception through its limitations Improve VR experience by taking advantage of those limitations Friday, November 16, 12
  • 162. Conclusion It is possible to transfer your body in VR Reality is not what you think VR is just another reality Friday, November 16, 12
  • 164. AFRV http://www.youtube.com/watch?v=lHZltjDZBJo&feature=plcp Friday, November 16, 12
  • 165. Friday, November 16, 12 www.VRGeeks.org
  • 170. VR Challenges What we must solve VR is mainly a SOFTWARE problem “3DUI is a hard and unexplored software engineering (and ergonomic) problem” Markerless tracking Minimum latency HMDs Lightweight Wide FOV Wireless Full body haptics Multi-sensorial experience Locomotion Avatars VR For All Friday, November 16, 12
  • 171. VR “Experiences” Your goal : Create presence And don’t break it !!! Verdun 1916-Time machine http://www.youtube.com/watch?v=ZBfYIefenp0 Friday, November 16, 12
  • 173. Thank you ! Questions ? Sebastien.Kuntz@nowan.net Friday, November 16, 12