Shared Virtual Environment

4 downloads 478 Views 3MB Size Report
immersive VR. VIVE – Very. Immersive. Virtual ... User Interface in VR: • Only Input device: Your own ... Oculus Rift DK2 / Samsung Gear VR. • Finger tracking.
SVEn Shared Virtual Environment Tobias Manroth, Nils Pospischil, Philipp Schoemacker, Arnulph Fuhrmann

Cologne University of Applied Sciences

1. Introduction • Scope • • • •

Module in a Media Technology Master‘s degree Group project (3 students) One year 12 ECTS per student

• Objective • Development of an interactive graphical system

SVEn - Shared Virtual Environment

2

1. Introduction • Key factors to foster creativity • project definition up to the students • design of a complex technical system

• working on emerging technologies

SVEn - Shared Virtual Environment

3

2. Similar projects Giant vs Horde

Virtsim Military

Xsens – Multiperson full-body immersive VR

VIVE – Very Immersive Virtual Experience

SVEn - Shared Virtual Environment

4

What is SVEn?

Shared Virtual Environment Motion Capturing Studio 1

Motion Capturing Studio 2

SVEn - Shared Virtual Environment

5

7. Results & Benefit

SVEn - Shared Virtual Environment

6

3. Hard- and Software HDMI

AV-Receiver

AV-Transmitter

USB

Oculus Rift DK1 HDMI

USB

Powerbank 10.000mAh USB

Motion Capturing Studio

Wiimote Wiimote

Computer

SVEn - Shared Virtual Environment

7

3. Hard- and Software

Motion Capturing Studio 1

Motion Capturing Studio 2

Spectator with HMD

Spectator without HMD SVEn - Shared Virtual Environment

8

3. Hard- and Software • Local data streaming

C++  C# NatNet SDK Wrapper

Motion Capturing

Optitrack Motive

Unity3D

SVEn - Shared Virtual Environment

9

3. Hard- and Software • Costs: Hard- and Software

Costs [€]

Unity

0€

2x Wiimote

100 €

Powerbank, Bluetooth-Stick …

100 €

2x Peerless HDMI-Transmitter/Receiver

600 €

2x Oculus Rift DK1

640 €

Total:

1.440 €

MoCap Studio 1 (Optitrack Flex13 Bundle 12 Cameras)

18.000 €

MoCap Studio 2 (Optitrack Bundle 24 S250e Cameras)

65.000 €

Total:

84.440 €

SVEn - Shared Virtual Environment

10

4. Implementation • Data streaming

Optitrack Motive

Unity3D SVEn - Shared Virtual Environment

11

4. Implementation • Prediction • Reduce system related latency • Oculus tracking and latency compensation is not used • Our implementation based on “Head Tracking for the Oculus Rift” [LYKA14] Angular extrapolation

Positional extrapolation

SVEn - Shared Virtual Environment

12

4. Implementation • Online Connectivity

Peer-to-Peer Connection Unity Server

Unity Client

SVEn - Shared Virtual Environment

13

5. Virtual Environment

SVEn - Shared Virtual Environment

14

5. Virtual Environment

Start

Shooter Game

Character Choosing Room

Physics Demo

Gym

SVEn - Shared Virtual Environment

Teaching Room

15

SVEn - Shared Virtual Environment

16

5. Virtual Environment • Shooter Game is similar to Flexible Spaces [VKBS13] Player Trigger

Inside Outside Virtual Walls SVEn - Shared Virtual Environment

17

5. Virtual Environment

SVEn - Shared Virtual Environment

18

5. Virtual Environment Main Menu:

• User Interface in VR: • Only Input device: Your own body • No haptic feedback

• Oculus Rift DK1 1. Limited resolution  Large UI elements

Button not touched

Button touched: Delay time

Button event fired

SVEn - Shared Virtual Environment

19

5. Virtual Environment • Ingame HUD:

• Ingame Menu:

• Ingame Buttons:

SVEn - Shared Virtual Environment

20

6. Results & Benefit • Feedback from users: • Highly immersive • Strong feeling of presence • Low Latency

• Beneficial for • • • •

Gaming Remote training Vertigo therapy Future student projects SVEn - Shared Virtual Environment

21

3. Hardware Structure • VIDEO

SVEn - Shared Virtual Environment

22

7. Future Work • Assessing presence • Measuring latency • Oculus Rift DK2 / Samsung Gear VR • Finger tracking • Voice streaming

SVEn - Shared Virtual Environment

23

References • [LYKA14] –LaValle S., Yershova A., Katsev M., Antonov M.: Head Tracking for the Oculus Rift. Robotics and Automation (ICRA), 2014 IEEE International Conference, Hong Kong, CN; 2014-05-31 – 2014-06-07 • [VKBS13] VASYLEVSKA K., KAUFMANN H., BOLAS M.,SUMA E. A.: Flexible spaces: A virtual step outside of reality.poster presentation: IEEE Virtual Reality, Orlando, FL (USA); 2013-03-18 – 2013-03-20, 2013.

• Credits • 3D model DeLorean: ’A certain DeLorean’ from KuhnIndustries www.blendswap.com (20.02.2015) • 3D characters: www.mixamo.com

SVEn - Shared Virtual Environment

24

Suggest Documents