Performance Metrics for Data Center [0.3ex ...

IEEE CLOUD 2015

Performance Metrics for Data Center Communication Systems Claudio Fiandrino

University of Luxembourg

Dzmitry Kliazovich Pascal Bouvry Albert Y. Zomaya

University of Sydney

June 29, 2015

Cloud Computing

Changes the way we use apps

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

1 of 15

Cloud Computing

Changes the way we use apps

$ 241 billion market by 2020

Source: Forrester Research, Inc.

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

1 of 15

Cloud Computing Data Centers I

Cloud applications: typically run in Data Centers

Data Center

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

2 of 15

Data Center Efficiency Operation Costs (OPEX)

Revenues

Data Center

Efficiency

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

3 of 15

Operational Costs (OPEX)

Data Center Efficiency

IT Equipment

Cooling

Revenues

Data Center

Power Distribution

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

3 of 15

Data Center Energy Efficiency

I

Power Usage Effectiveness (PUE)

PUE =

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

Total Facility Energy IT Equipment Energy

4 of 15

Data Center Energy Efficiency

I

Need to differentiate IT equipment

PUE =

Total Facility Energy IT Equipment Energy Internet

Communication System PUE

Computing System

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

4 of 15

Data Center Energy Efficiency

I

Need to differentiate IT equipment

PUE =

Total Facility Energy IT Equipment Energy Internet

Communication System PUE

Computing System

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

4 of 15

The need for communication systems metrics Compare

Plan/Optimize Design

Harvest and Exploit Information

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

5 of 15

The proposed framework of metrics

I

Structured into two categories:

Power

Performance

I

Network Power Usage Effectiveness (NPUE)

I

Communication Network Energy Efficiency (CNEE)

I

Energy Proportionality Coefficient (EPC)

I

Uplink/Downlink Communication Latency (UDCL)

I

Inter-Server Communication Latency (ISCL)

I

Average Server Degree Connectivity (ASDC)

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

6 of 15

The proposed framework of metrics

Power

I

How much power is spent for information delivery?

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

6 of 15

The Network Power Usage Effectiveness (NPUE)

I

Fraction of IT power spent to operate the network NPUE =

Total Power Consumed by IT Equipment Power Consumed by Network Equipment

Internet

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

NPUE

7 of 15

The Network Power Usage Effectiveness (NPUE)

I

Fraction of IT power spent to operate the network NPUE =

Total Power Consumed by IT Equipment Power Consumed by Network Equipment

Internet

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

NPUE

7 of 15

The Communication Network Energy Efficiency (CNEE)

I

Amount of energy to deliver a single bit of information Internet

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

8 of 15

The Communication Network Energy Efficiency (CNEE)

I

Amount of energy to deliver a single bit of information CNEE =

Power Consumed by Network Equipment Effective Network Throughput Capacity

Internet

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

8 of 15

Energy Proportionality Coefficient (EPC)

I

Devices do not consume energy proportionally to the workload

Energy Consumed

π/2

EPC=0

1

EPC=1

−1

=1

C EP

1

α

π

0

EPC=1 α 0

EPC=0 −1

1

Load

1

3π/2

From: http://www.spec.org

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

9 of 15

Energy Proportionality Coefficient (EPC)

I

Devices do not consume energy proportionally to the workload

Energy Consumed

π/2

EPC=0

1

EPC=1

−1

=1

C EP

1

α

π

0

EPC=1 α 0

EPC=0 −1

1

Load

1

3π/2

From: http://www.spec.org

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

9 of 15

Energy Proportionality Coefficient (EPC)

I

Devices do not consume energy proportionally to the workload

Energy Consumed

π/2

EPC=0

1

EPC=1

−1

=1

C EP

1

α

π

0

EPC=1 α 0

EPC=0 −1

1

Load

1

3π/2

From: http://www.spec.org

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

9 of 15

Energy Proportionality Coefficient (EPC)

I

Devices do not consume energy proportionally to the workload

Energy Consumed

π/2

EPC=0

1

EPC=1

−1

=1

C EP

1

α

π

0

EPC=1 α 0

EPC=0 −1

1

Load

1

3π/2

From: http://www.spec.org

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

9 of 15

Energy Proportionality Coefficient (EPC) Energy Proportionality Coefficient

Energy Consumption Profile

Power Consumption P

π/2

dP dl

Ppeak

−1

1

α Observed Pidle

Ideal

0

π

−1

1

0

1

Normalized Load l

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

3π/2

10 of 15

Energy Proportionality Coefficient (EPC) Energy Proportionality Coefficient

Energy Consumption Profile

Power Consumption P

π/2

dP dl

Ppeak

−1

1

α Observed Pidle

Ideal

0

π

−1

1

0

1

Normalized Load l

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

3π/2

10 of 15

Energy Proportionality Coefficient (EPC) Energy Proportionality Coefficient

Energy Consumption Profile

Power Consumption P

π/2

dP dl

Ppeak

−1

1

α Observed Pidle

Ideal

0

π

−1

1

0

1 3π/2

Normalized Load l

I

EPC =

R1 0

sin 2α dl =

R1

2 tan α 0 1+tan2 α

dl

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

10 of 15

Energy Proportionality Coefficient (EPC) Energy Proportionality Coefficient

Energy Consumption Profile

Power Consumption P

π/2

dP dl

Ppeak

−1

1

α Observed Pidle

Ideal

0

π

−1

1

0

1 3π/2

Normalized Load l

I

EPC =

R1 0

sin 2α dl =

R1

2 tan α 0 1+tan2 α

dl

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

10 of 15

The proposed framework of metrics

Power

Performance

I

Network Power Usage Effectiveness (NPUE)

I

Communication Network Energy Efficiency (CNEE)

I

Energy Proportionality Coefficient (EPC)

I

Uplink/Downlink Communication Latency (UDCL)

I

Inter-Server Communication Latency (ISCL)

I

Average Server Degree Connectivity (ASDC)

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

11 of 15

The proposed framework of metrics

Performance

I

How does the network perform?

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

11 of 15

Performance-related metrics

I

Uplink/Downlink - Inter-Server Communication Latency (UDCL - ISCL) Internet Uplink Downlink Communication Latency

Gateway Router

Core Layer

Inter-Server Communication Latency

Aggregation Layer

Access Layer

Computing Servers

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

12 of 15

Performance-related metrics I

Average Server Degree of Connectivity (ASDC) I I

Relevant for Hadoop and parallel distributed tasks Effective in distributed data center architectures

BCube DCell

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

13 of 15

The proposed framework of metrics

Power

Performance

I

Network Power Usage Effectiveness (NPUE)

I

Communication Network Energy Efficiency (CNEE)

I

Energy Proportionality Coefficient (EPC)

I

Uplink/Downlink Communication Latency (UDCL)

I

Inter-Server Communication Latency (ISCL)

I

Average Server Degree Connectivity (ASDC)

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

14 of 15

Conclusion

Contribution I

Definition of set of metrics for data center networks I I I

Power, Performance Essential for Data Center Industry Standardization with ISO/ILNAS

Ongoing Work I

Inclusion in GreenCloud Simulator

I

Resource Allocation Scheme I

Exploiting information provided by metrics

Claudio Fiandrino | IEEE CLOUD 2015 | Performance Metrics for Data Center Communication Systems

15 of 15

Thank You! Claudio Fiandrino