STATE OF THE ART OF THE METHODS FOR STATIC 3D ...

www.homometrica.ch

STATE OF THE ART OF THE METHODS FOR STATIC 3D SCANNING OF PARTIAL OR FULL HUMAN BODY

Dr. Nicola D’Apuzzo 3D Modelling 2006, Paris, France

N. D‘Apuzzo, 14.6.06

1

www.homometrica.ch

Contents of presentation Introduction on 3D human body digitization Measurement - Applications - Technologies

Overview and state of technology Methods – Scanning systems

Examples of applications Different fields

3D Modelling 2006, Paris, France


2

3D Surface digitization of the human body

www.homometrica.ch

What can be measured? Full body Half body Chest Back Face Foot Legs Arms Hands Skin Body parts 3D Modelling 2006, Paris, France


3


www.homometrica.ch

Where to use it? Animation Computer games Art / Sculpture Ergonomics Medicine / Forensic Cosmetics / Dermatology Anthropology Biometry / Security Fitness / Sport Appeal / Fashion / Beauty Communications 3D Modelling 2006, Paris, France


4


www.homometrica.ch

How to measure? Laser Scanning

White light projection

Silhouette/Modeling



5


www.homometrica.ch

Where are the systems produced/developed



6

www.homometrica.ch

3D Surface digitization of the human body Where are the systems produced/developed

Laser scanning White light projection Modeling / Other N. America

7

7

5 19

Europe

0

22

7 29

Asia

4

3

11


0

7

32 12 55


7

www.homometrica.ch

3D Surface digitization of the human body Different systems? Example Full Body Scanning: 21 companies, 33 products

Different results – equipment – processing – application

€20’000 - €400’000



8


www.homometrica.ch

Different systems? Example Face Scanning: 28 companies, 40 products

Different results – equipment – processing – application 3D Modelling 2006, Paris, France

€500 - €100’000 N. D‘Apuzzo, 14.6.06

9

www.homometrica.ch

3D Surface digitization of the human body Selection of adequate product/system 1. List clearly the requirements

2. Consider more criterions

Measurement of? full body

head

face

foot

hands

skin

back

parts

…

Quality & type of result? accuracy

resolution

surface

point cloud

texture

color

b/w

…

Processing? acquisition time

processing time

technical know-how

automatism

…

Environment? space limitation

transportability

installation

light condition

sterilization

…

Dedicated solutions? crystal engraving mass customization plastic surgery computer games …

Technical expert assistance – Consulting ! 3D Modelling 2006, Paris, France


10

www.homometrica.ch






11

www.homometrica.ch

Methods – Scanning Systems Laser Scanning Full body Head/face Foot

White light projection Full body Face Foot

Silhouette/Modeling Body sizes Face Foot



12

www.homometrica.ch

Laser scanning Method: Laser stripe projected onto the human body Light sensor acquire the scene Triangulation: distance projected line - sensor To scan surface parts: displacement of line Laser scanning system:

laser

b d

Laser beam Optics

sensor

a

Scanning head

Light sensor Displacement mechanism: optical, electromechanical, mechanical, free



13

www.homometrica.ch

Laser scanning - Setup (examples) Full body scanner (VITRONIC GmbH) 3 scanner units moves vertically along 3 pillars

Head scanner (Cyberware Inc.) 1 scanner unit moves horizontally around a person

Foot scanner (Vorum Research Corp.) 3 scanner units moves horizontally along the foot



14

www.homometrica.ch

Laser scanning - Setup (examples) Full body scanner Vitus LC (VITRONIC GmbH) 3 scanner units moves vertically along 3 pillars Total scanning time: ~ 12 seconds



15

www.homometrica.ch

Laser scanning - Setup (examples) Head scanner 3030RGB/PS (Cyberware Inc.) 1 scanner unit moves horizontally in circle around a person Total scanning time: ~ 17 seconds



16

www.homometrica.ch

Laser scanning - Setup (examples) Foot scanner YETI (Vorum Research Corp.) 3 scanner units moves horizontally along the foot Total scanning time: ~ 4 seconds



17

www.homometrica.ch






18

www.homometrica.ch

Coded light projection Method: Coded light projected onto the human body Camera(s) acquire the scene Triangulation: distance projected lines - sensor Coding system to determine position of source: binary code, vertical, horizontal, color code, squared, dotted pattern … projector

d


b

camera

a


19

Coded light projection – Setup (examples)

www.homometrica.ch

Fullbody Scanner (InSpeck Inc.) 3 pillars placed around a person

Face scanner (Breuckman GmbH) 1 projector and 2 cameras

Foot scanner (Precision 3D Ltd.) 5 projectors and 5 camera



20


www.homometrica.ch

Fullbody Scanner Mega 3P (InSpeck Inc.) 3 pillars placed around a person Each pillar has 2 sensor units Sensor unit: projector and camera Total scanning time: ~ 4 seconds

camera projector



21

www.homometrica.ch

Coded light projection – Setup (examples) Face scanner faceSCAN-II (Breuckman GmbH) 1 projector and 2 cameras 2 independent acquisitions Total scanning time: ~ 1 second camera 1

projector


camera 2


22


www.homometrica.ch

Foot scanner FotoScan (Precision 3D Ltd.) 5 units: each 1 projector and 1 camera 5 acquisitions (around + bottom) Total scanning time: ~4 second



23

www.homometrica.ch






24

www.homometrica.ch

Modeling / image processing Method: Real 3D measurement is not performed Image processing / modeling techniques are used to gain 3D information from 2D images

Examples: Body sizes measurement from two images Realistic 3D face models from anthropometrical database and two photographs Foot size measurement



25

www.homometrica.ch

Modeling / image processing - Examples

camera

2D Full Body Scanner (Human-Solutions GmbH) Setup: 1 camera, 2 lights, calibration panel Two acquisitions: front and side

light

light

From silhouettes: extraction of body sizes Accuracy: < 1mm

calibration panel



26


www.homometrica.ch

3D Face Modeler FaceGen (Singular Inversions) Modeling software (anthropometric database) Predefined, parameterized 3D face model 3D shape can be easily modeled to fit photographs (+ texture mapping)



27


www.homometrica.ch

2D Foot Scanner FootScan (VisImage Systems Inc.) Setup: desktop scanner (consumer market) Acquisition of foot images Automatic extraction of foot sizes



28

www.homometrica.ch






29

Human Body Digitization - Some Examples

www.homometrica.ch

Appeal / Fashion / Beauty Virtual-try-on, virtual-make-over

Medicine Plastic surgery, forensic

Cosmetics / Dermatology Skin measurement

Art / Sculpture

Reproductions, artistic works

Animation Digital movies 3D Modelling 2006, Paris, France


30

www.homometrica.ch

Appeal / Fashion / Beauty Virtual-try-on Full body scan Cloth definition (CAD) Stitching Cloth simulation MOCAP Virtual fashion show

Images: CNNITH (France) Video: Digital fashion (Japan) 3D Modelling 2006, Paris, France


31

www.homometrica.ch

Appeal / Fashion / Beauty Virtual-make-over (3DiView, Stellure) Eyewear Head scanning Accessories 3D Virtual-make-over

Hairdressing Head scanning Haircut 3D modeling Haircut visualization



32

www.homometrica.ch

Medicine / Plastic surgery

Face and chest measurement (GFMesstechnik, Novaptus, InSpeck.) 3D measurement of the human face or chest Virtual planning and forecasting of surgical interventions Analysis and comparison of pre- and post-operative measurements

Placing a virtual breast implants Pre- and post-operative comparison

volume measurement and comparison 3D Modelling 2006, Paris, France


33

www.homometrica.ch

Forensic medicine Virtual autopsy (Inst. Forensic Medicine, Univ. of Bern) Documentation of internal and external body morphology CT and MRI for internal body structures 3D scanning (structured light) for external surface Analysis and study of injuries to determine causes

CT and 3D scanner (arrow)

3D model of vehicle and injured pedestrian 3D Modelling 2006, Paris, France


34

www.homometrica.ch

Dermatology Cellulite measurement (Cyberware Inc.) 3D laser scanning of the thighs Analysis of 3D topology of skin surface Quantification of cellulite severity grade

3D laser scanning and results

3D scans arranged with cellulite severity grade 3D Modelling 2006, Paris, France


35

www.homometrica.ch

Art / Sculpture Reproduction of humans 3D scanning (full body, face) 3D engraving in crystal 3D printing - colored

Sculptures Jurisprudent of Helmick and Schechter (East St. Luis, IL, USA) 3D laser scanning of 12 human faces 3000 3D copies of them, suspended to form two facing heads

Jurisprudent at the Melvin Price Federal Courthouse in East St. Louis (IL, USA) 3D Modelling 2006, Paris, France


36

www.homometrica.ch

Animation

Grand Odyssey – Mitsui-Toshiba Pavillon at Aichi Exposition Japan Spectators queuing outside a cinema 3D scan of visitors (structured light scanner) Fast generation of 3D face mask models Parameterization to index face features (eyes, eyebrows, nose, mouth) Face mask is inserted and animated in real time in the digital movie Spectators see themselves in the digital movie



37

www.homometrica.ch

Thank you for the attention!

For any questions regarding 3D digitization of the human body:

www.homometrica.ch



38

STATE OF THE ART OF THE METHODS FOR STATIC 3D ...

STATE OF THE ART OF THE METHODS FOR STATIC 3D ...

Suggest Documents

STATE OF THE ART OF THE METHODS FOR STATIC 3D ... - CiteSeer

ON THE STATE-OF-THE-ART: METHODS FOR ... - Archive@NYU

ON THE STATE-OF-THE-ART: METHODS FOR EVALUATING ... - Core

State-of-the-art Algorithms for Complete 3D Model Reconstruction

State-of-the-art Algorithms for Complete 3D Model Reconstruction

methods for track stiffness measurement - state of the art

STATE OF THE ART OF 3D MEASUREMENT ... - Geometric Software

State of the art

1147 APPLICATION OF STATE-OF-THE-ART METHODS TO SEARCH

Experimental Comparison of State-of-the-Art Methods ... - IEEE Xplore

1147 APPLICATION OF STATE-OF-THE-ART METHODS TO SEARCH ...

3D Skeletons: A State-of-the-Art Report

Experimental State of the Art in 3D Object Recognition ... - CiteSeer

State of the art 3D optical measurement systems ... - Geometric Software

State of the art 2D & 3D seismic interpretation ... - Matimop

What Additional Factors Beyond State-of-the-Art Analytical Methods

Multi-Hop Video Routing Methods: State of the Art - CiteSeerX

D iagnosing State-Of-The-Art Object P roposal Methods

Numerical radiative transfer with state-of-the-art iterative methods ...

Deliverable (D) No: 1.4 State-of-the-Art Methods

STATE-OF-THE-ART REPORTS

State of the Art - Nature

State of the art - BioMedSearch

state-of-the-art