Lecture 1: What is VR? AR? MR? Flashcards
Give a definition of Mixed Reality
Milgram et al. :
“… it is straightforward to define a generic
Mixed Reality (MR) environment as one in
which real world and virtual world objects are
presented together within a single display …”
Please fill in the gaps of this graphic:
Give a definition of Augmented Reality (AR)
The real world is augmented with virtual content.
For our purpose the “real world” may also be images or videos shown on a display!
For Augmented Reality we are looking primarily at the real world.
Virtual objects, annotations, overlays, etc. may be added to create AR.
Give a definition of Virtual Reality (VR)
A computer-generated, three-dimensional environment that can be at least explored and ideally interacted with by the user.
The user is confronted with a completely synthetic (virtual) world.
Give a definition of Augmented Virtuality (AV) and give an example what is considered AV.
AV is a virtual environment augmented with real-world content.
Term is not commonly used in media. AV is the counterpart to AR on the right-hand side of the MR continuum.
Showing a video call, real world objects or the user’s hand in VR hands is considered AV
What senses do we need for MR?
Which senses are often covered by MR devices?
Mixed Reality may provide input for any sense.
MR is not limited to any certain number of the human senses.
Sight (visual), hearing (audio), touch (haptic), smell (olfactory) and taste (gustatory)
may all be provided with input.
Most often only sight or sight and hearing are covered by MR devices.
What are areas of application for Mixed Reality / Virtual Reality?
Medicine/Psychology, Science, Art and Media, Trainings, Product Presentation, Product Development, Simulation, Entertainment
Explain the Medical Applications of VR and give examples how VR can be used to train medical specialists. What is the main goal of a simulation for medical purposes?
Uses for VR in medicine include
trainings, simulations, treatment,
patient care, …
Some of these uses require haptic
feedback or specialised input devices.
Many medical procedures require special
skills and mistakes can have serious
consequences for patients!
Goal: A training simulation should be as lifelike as possible!
VR can be an important asset for training medical specialists:
* Special input devices can simulate medical instruments
* Haptic feedback improves realism
* Can train any procedure at any time
* No risk to patients!
Can be used for a wide variety of fields:
* Surgeons
* Dentists
Medical Therapy
How can VR help with Repetitive Exercises for patients?
A lot of exercises for therapy require repeated execution.
This can be boring and lead to patients not doing it or doing it incorrectly.
VR applications can help to motivate patients.
As an additional element the applications may include gamification:
Adding gaming elements can make the exercises a lot less tedious!
Medical Therapy: How can VR help with Repetitive Exercises for patients?
Give specific examples of medical treatment with the help of VR applications
Treating Diplopia (lazy-eye)
An HMD can present different images for each eye.
This can be used for treating diplopia by presenting images with different brightness. Over time and by alternating the content the eyes can be trained to work together (see picture).
Stroke rehabilitiation
Stroke patients do exercises simulating every-day situations in a controlled environment without risk of injury. Gamification can be included here as well to make the exercises more enjoyable.
Treatment of phobias
Exposure therapy: confronting the patients with their fears in a controlled environment. MR allows a controlled environment that can easily be adapted. A doctor can control and change the environment while the patient is immersed.
Calming patients using VR
VR can be used to ease anxiety and relax patients during long or unpleasant procedures. Removing patients from a stressful environment and placing
them in a virtual environment that has a calming effect and can seem unpleasant procedures more bearable.
How to train employees with VR/MR? Give two examples where this kind of training has already been used for a long time. What is the benefit of such training?
Similar to medical trainings, VR can be used to simulate the exact environmnet an employee is supposed to be working in.
This idea has been used for flight simulators and astronaut trainings for a long time!
Trainings or simulations can make good use of mixed reality:
combining a VE with a real tool or device (as input device) can be great for trainings.
Large scale MR installations like LED walls or large-scale projector displays can combine real training devices with virtual content.
Benefit:
Low-cost, easily adaptable and can used for training many scenarios.
Describe why MR can help with Rapid prototyping and what are the benefits.
Designing a product is often not straightforward and requires multiple iterations of prototypes or models to evaluate designs and ergonomics, do studies, etc.
Working with physical models or prototypes can be time consuming and expensive.
Not every step in the design process requires a physical object that you can interact with.
Often, it is just enough to see a life-sized version. Replacing physical models or prototypes with models shown in MR can reduce time, cost and waste!
Describe how MR/VR can be used for Product Development
Many products are designed beforehand using CAD models, which can often easily be transferred to an MR environment.
A VR environment can not only be used to look at a prototype.
Given the right input setup it can be used to simulate using it, simulate various times of day, weather, locations on the globe, ….
All without travelling, transportation, etc.
Describe how MR/VR can be used for Product Presentation
Presenting a product to a customer can be a challenge:
* Many configuration options or variations
* Needs to be in stock
* Ideally presented in the final environment
* …
VR can be used to present the product in a completely virtual space and control the environment for a controlled presentation.
AR allows users to see the product in the final environment, the comfort of their home, etc.
Describe how MR/VR can be used for Entertainment
Gaming in VR is no longer a niche product. Large companies (Valve, Sony, Facebook, etc.) have become major players and are selling hardware and/or games for VR!
Applications like VRChat, Mozilla Hubs, AltspaceVR, Facebook Horizon, etc. aim at bringing social interaction into a virtual space.
These applications are not (only) designed for corporate use, but for everyday interaction as well.
Another area of application for VR/AR is scientific visualization. What are the respective advantages and disadvantages/problems of the individual technologies in connection with scientific visualization?
Name a few examples for Scientific Visualisation with VR
