You are on page 1of 52

AC & DC Power Distribution for

Data Centers
Configuration Availability Level Comparison
Bill Campbell
Power Sub Work Group Member, Emerson Network Power
Harry Handlin
Power Sub Work Group Member, Technical Committee
Vice-Chair, GE Energy Systems
Mark Murrill
Power Sub Work Group Member, Emerson Network Power

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012

Agenda

Introduction
Review Industry Standards for data center availability levels
BICSI Standard as the AC Reference
Examine AC Single & Multi Module UPS Systems and
analogous DC systems
BICSI Availability Class Comparisons AC to DC
Alternate DC solutions
Summary
Q&A

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Introduction

Tier I-IV availability terminology (1st introduced by The Uptime


Institute) is the defacto shorthand method to convey basic AC power
distribution / availability architecture for a data center

Tier I-IV concepts have been adopted by other industry organizations


(eg: TIA; BICSI), sometimes applying alternate but similar
terminologies

Growing interest in the possible performance features of DC power


for data centers has led potential users to makeperformance inquiries
of industry AC power system suppliers regarding DC power
distribution solutions in terms of generic availability levels

Purpose: Suggest a data center power distribution AC DC


availability comparison approach and encourage industry discussion

The Uptime Institute, founded 1993 ; representing data center owners interests
http://www.uptimeinstitute.com
BICSI-002: Building Industry Consulting Service International, Inc., founded 1977
https://www.bicsi.org
TIA-942: Telecommunications Industry Association founded 1988 - merger
http://www.tiaonline.org
The Uptime Institute, similar to The Green Grid, recommends best-practices. BICSI & TIA are standards writing
organizations.

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Method
Compares basic AC v DC topology & qualitative
availability levels
References are AC topologies
Framework: ANSI/BICSI Standard-002-2011
Assumptions:
Basic AC system: 480 VAC, 3, 3 or 4 W, + Gnd
Basic DC system: 380 VDC, 2W + Gnd

380 V DC solutions are offered as suggestions


Not yet a standard

Not covered: comparisons of efficiency, costs or


relative merits
Leaving these for future comparative and quantitative analysis
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction

ANSI/BICSI 002-2011, Data Center Design and


Implementation Best Practices
BICSI-002
Rev 1, 2010
BICSI-002
Rev 2, 2011
BICSI-002
Rev 3, 2014
Expected

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
BICSI Data Center Design Classes
Topology Class

Key Power path Feature

Class F0

Single Power Path w/o UPS or Alternate AC source

Class F1

Single Power Path with UPS,


Non-redundant components

Class F2

Single Power Path with UPS,


Some redundant components

Class F3

Multiple Independent Power Paths, some with UPS,


Concurrently maintainable & operable

Class F4

Multiple Independent Power paths with UPS,


Fault Tolerant

BICSI-002-2011, 9.1.6.1

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
Determining BICSI Design Classes

BICSI-002-2011, Table B1

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
Determining BICSI Design Classes

BICSI-002-2011, Table B3

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
BICSI Class Definitions & Feature Checklist Review
Performance
Feature

Class F0

Class F1

Class F2

Industry Description
Module Redundancy
System Redundancy
Power Paths to
Critical Load
UPS sources to
Critical Load
Full Maintenance
under load
Alternate long Term
Energy (Genset)
Alternate Short Term
Energy (Battery)
Fault tolerance
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F3

Class F4

BICSI-002 Introduction
Class F0 Data Center Single Path, No UPS

BICSI-002-2011, Fig 14

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
Class FI Basic Data Center

BICSI-002-2011, Fig 15

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
Class F2 Redundant Components

BICSI-002-2011, Fig 16

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
12
Copyright 2012, The Green Grid

BICSI-002 Introduction
Class F3 Concurrently Maintainable

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012

BICSI-002-2011, Fig 17b


Copyright 2012, The Green Grid

BICSI-002 Introduction
Class F4 Fault Tolerant

BICSI-002-2011, Fig 18
BICSI-002-2011, Fig 17b
BICSI-002-2011, Fig 18

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
AC Static Switch
Static Switch applications in multiple
power path topologies
A Bus

A Bus

B Bus
Dual Input IT Load

B Bus

AC Load
Single Input
IT Load

AC Load
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI Definitions & Feature


Checklist Review
Performance
Feature

Class F0

Class F1

Class F2

Class F3

Class F4

Industry Description

Single
Path

Single
Path

Single Path +
Redundant
Components

Dual Path,
Concurrently
Maintainable

Dual Path,
Fault
Tolerant

Module Redundancy

None N

None N

N+1

N+1

2(N+1)

System Redundancy

None N

None N

Limited N+1

Limited N+1

2(N+1)

Power Paths to
Critical Load

One

One

One

Two

Two

UPS sources to
Critical Load

None

One

One

One

Two

Full Maintenance
under load

No

No

Limited

Yes

Yes

Alternate long Term


Energy (Genset)

No

Option

Yes

Yes

Yes

Alternate Short Term


Energy (Battery)

No

Yes

Yes

Yes

Yes

Fault tolerance

No

No

Limited

Limited

Yes

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI-002 Introduction
DC Solutions
BICSI-002 DC Power Systems

Next: Suggested AC DC Comparative Power Topologies

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI Basic UPS Module


Configurations

AC UPS N System
(Single Module System)

BICSI-002-2011, Fig 21

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI Basic UPS Module


Configurations

AC UPS N System

DC UPS

(Single Module System)


N

Main

Input Distribution
Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution
BICSI-002-2011, Fig 21

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

BICSI Basic UPS Module


Configurations

AC UPS N System

DC UPS

(Single Module System)

(AC SMS N System Equivalent)


N

Main Bypass

N+1
Input Distribution

Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution
BICSI-002-2011, Fig 21

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

BICSI Basic UPS Module


Configurations

AC UPS N System

(Single Module System)

(AC SMS N System Equivalent)

Main Bypass

DC UPS
N

Maint Byp

N+1

N+m optional

Input Distribution
Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution
BICSI-002-2011, Fig 21

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

BICSI Basic UPS Module


Configurations

AC UPS N+1 System


(Multi-Module System)

BICSI-002-2011, Fig 22

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

BICSI Basic UPS Module


Configurations

AC UPS N+1 System

DC UPS

(Multi-Module System)
N
N
Input Distribution

Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution

BICSI-002-2011, Fig 22

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

BICSI Basic UPS Module


Configurations

AC UPS N+1 System

DC UPS

(Multi-Module System)

(AC MMS N+1 System Equivalent)


N

N+1

N+1

Input Distribution

Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution

BICSI-002-2011, Fig 22

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

BICSI Basic UPS Module


Configurations

AC UPS N+1 System

DC UPS

(Multi-Module System)

(AC MMS N+1 System Equivalent)


N

N+1

Bypass

N+1

Maint Byp

N+m
optional

Input Distribution

Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution

BICSI-002-2011, Fig 22

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

BICSI Topology Diagrams


Comparative AC & DC Topology Diagrams
Sequence: AC Diagram; Changes Needed; DC Diagram
Only suggestions for DC; no accepted conventions as yet

Symbols indicate where differences appear


Remove this AC component for DC applications
AC-to-DC component changes
AC / DC Rectifier - configurations:
Modular or Monolithic; 5 kW to > 1 MW rectifier units
Plug-in (may be hot-swappable) or hard-wired I/O
Input to Output isolated or non-isolated
o Isolation Xfmr: power line frequency or high frequency
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F0 Basic Data Center


Class F0 Single Path; No UPS
AC

Performance
Feature

Class F0

Industry Description

Single Path

Module Redundancy

None N

System Redundancy

None N

Power Paths to
Critical Load

One

UPS sources to
Critical Load

None

Full Maintenance
under load

No

Alternate long Term


Energy (Genset)

No

Alternate Short Term


Energy (Battery)

No

Fault tolerance

No

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F0 Basic Data Center


Class F0 Single Path; No UPS
AC

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F0 Basic Data Center


Class F0 Single Path; No UPS

AC

DC

N Rect
No Batt

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F1 Basic Data Center


Class F1 Single Path with UPS
AC

Performance
Feature

Class F1

Industry Description

Single Path

Module Redundancy

None N

System Redundancy

None N

Power Paths to Critical


Load

One

UPS sources to Critical One


Load
Full Maintenance
under load

No

Alternate long Term


Energy (Genset)

Option

Alternate Short Term


Energy (Battery)

Yes

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fault tolerance

No

Class F1 Basic Data Center


Class F1 Single Path with UPS
AC

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F1 Basic Data Center


Class F1 Single Path with UPS
AC

DC

N+1 Rectifiers;
Modular
or
Monolithic

Fully, Partial or non-

redundant
Celebrating 5 Years of Leading the Industry to Resource Efficient
IT battery

The Green Grid Forum 2012


Copyright 2012, The Green Grid

Class F2 Redundant Components


Class F2 Single Path UPS with Redundant Components
AC

Performance
Feature

Class F2

Industry Description

Single Path +
Redundant
Components

Module Redundancy

N+1

System Redundancy

Limited N+1

Power Paths to Critical


Load

One

UPS sources to Critical


Load

One

Full Maintenance under


load

Limited

Alternate long Term


Energy (Genset)

Yes

Alternate Short Term


Energy (Battery)

Yes

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fault tolerance

Limited

Class F2 Redundant Components


Class F2 Single Path UPS with Redundant Components
AC

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Class F2 Redundant Components


Class F2 Single Path UPS with Redundant Components
AC

DC

N+m
Rectifiers;
Modular or
Monolithic

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or nonredundant battery

Class F3 Concurrently Maintainable


Class F3 Dual Path; Concurrently Maintainable
AC
x2

x2

x2

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum
Dual2012
or single
Cord IT Loads

Copyright 2012, The Green Grid

Performance
Feature

Class F3

Industry Description

Dual Path,
Concurrently
Maintainable

Module Redundancy

N+1

System Redundancy

Limited
N+1

Power Paths to
Critical Load

Two

UPS sources to
Critical Load

One

Full Maintenance
under load

Yes

Alternate long Term


Energy (Genset)

Yes

Alternate Short Term


Energy (Battery)

Yes

Fault tolerance

Limited

Class F3 Concurrently Maintainable


Class F3 Dual Path; Concurrently Maintainable
AC
x2

x2

x2

x2

x2

Celebrating 5 Years
of Leading the Industry to Resource Efficient IT
Dual or single
Cord IT Loads

The Green Grid Forum 2012


Copyright 2012, The Green Grid

x2

Dual or single
Cord IT Loads

Class F3 Concurrently Maintainable


Class F3 Dual Path; Concurrently Maintainable
AC

DC
x2

x2

x2
x2

N+m
Rectifiers;
Modular or
Monolithic
x2

N Rect
Mod or
Mono
x2

Fully, Partial or

Celebrating 5 Dual
Years
of Leading the Industry to Resource Efficient
IT
or single
non-redundant
Cord IT Loads

The Green Grid Forum 2012


Copyright 2012, The Green Grid

battery

Dual or single
Cord IT Loads

Class F4 Fault Tolerant


Class F4 Dual Path; Fault Tolerant
AC

Performance
Feature

Class F4

Industry Description

Dual Path,
Fault
Tolerant

Module Redundancy

2(N+1)

System Redundancy

2(N+1)

Power Paths to
Critical Load

Two

UPS sources to
Critical Load

Two

Full Maintenance
under load

Yes

Alternate long Term


Energy (Genset)

Yes

Alternate Short Term


Energy (Battery)

Yes

Fault tolerance

Yes

x2

x2

x2

Dual or single

Cord IT Loads
Celebrating 5 Years
of Leading the Industry to Resource Efficient IT

The Green Grid Forum 2012


Copyright 2012, The Green Grid

AC Input-to-PDU bypass is also


available with AC

Class F4 Fault Tolerant


Class F4 Dual Path; Fault tolerant

x2

x2

x2

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Dual or single
Cord IT Loads

Class F4 Fault Tolerant


Class F4 Dual Path; Fault tolerant
DC
x2

x2

N+m
Rectifiers;
Modular or
Monolithic

N+m
Rectifiers;
Modular or
Monolithic

x2

Fully, Partial or
non-redundant
battery

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery
Dual or single
Cord IT Loads

BICSI-002 Introduction
AC Static Switch
Static Switch applications in multiple
power path topologies
A Bus

A Bus

B Bus
Dual Input IT Load

B Bus

AC Load
Single Input
IT Load

AC Load
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

Static Switch Applications

Static Switch applications in multiple power path topologies


o Single-corded IT loads

A Bus

B Bus

A Bus

B Bus

DC Load
AC Load

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Static Switch Applications


A Bus

B Bus

Static Switch applications in


multiple power path topologies
o

Dual-corded IT loads

A Bus

B Bus

AC Load
DC Load

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Alternate DC Solutions

There are also other alternate DC topologies in use that do


not fit directly into the Class F0 F4 structure.

Two basic alternative topologies are reviewed, both of which


have several variations.

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

DC Solutions - Review

AC UPS N+1 System

DC UPS

(Multi-Module System)

(AC MMS N+1 System Equivalent)


N

N+1

Bypass

N+1

Maint Byp

N+m
optional

Input Distribution

Rectifier
Cabinet

Battery
Plug-in Modules Illustrated

Output Distribution
BICSI-002-2011, Fig 22

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Fully, Partial or
non-redundant
battery

To Critical Load

Rectifiers;
Modular or
Monolithic

Alternate DC Solutions
AC Power Source A

Battery
Internal
or
External,
Redundant
or
Non-Redundant

Alternate AC Power Source B

Rectifier Cabinet(s)
N+M Modules

Output
Distribution
A

380VDC Distribution
or
48VDC Distribution

DC PSU

Output
Distribution
B

DC PSU

IT load
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

Rectifier modules
may be dedicated to
either A or B source,
or switchable
between the two

Alternate DC Solutions
AC Power Source A

Battery
Internal
or
External,
Redundant
or
Non-Redundant

Alternate AC Power Source B

Rectifier Cabinet(s)
N+M Modules

DC Output
Distribution
A

380VDC Distribution
or
48VDC Distribution

DC PSU

AC Output
Distribution
B

AC PSU

IT load
Celebrating 5 Years of Leading the Industry to Resource Efficient IT
The Green Grid Forum 2012
Copyright 2012, The Green Grid

Rectifier modules
may be dedicated to
either A or B source,
or switchable
between the two

Summary

Driven by AC user inquiries, suggested DC Class F0 F4 Availability


Level power distribution topologies have been qualitatively reviewed in
terms of accepted AC topologies.

Practical DC equivalents are available, as well as other alternatives


All DC solutions require rectifiers in the primary and alternate power paths
Distribution static transfer switch functions are simpler to implement in DC
Existing AC-based standards may not be the best method to present and
compare DC solutions. The DC power industry is encouraged to propose
alternatives.

Because of the many variations possible in both AC and DC topologies,


quantitative presentations of key performance parameters such as
availability, reliability, efficiency and costs, are beyond the scope of this
introduction.

The Green Grid, as it is focused on improving the performance of data


centers in these key areas, encourages further quantitative analysis for
the benefit of its industry members.

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

AC DC Availability Level
Comparisons
Questions?

Be sure to attend the AC DC Roundtable


discussion by industry leaders following this
presentation.

BICSI-002 material used with permission

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Contributors
Thanks to the following for their support:
The Green Grid Power Sub-Working Group Participants

Pam Lembke - IBM


Jim Spitaels - Schneider Electric
Lynn Simmons - Dell
Dusty Becker - Emerson
Brad Thrash - GE
George Navarro Eaton
Shaun Harris - Microsoft Keith Klesner - TUI
John Collins Eaton
Steve McCluer Schneider
Electric

BJ Sonnenberg - Emerson

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012
Copyright 2012, The Green Grid

Thank you for attending


The Green Grid Forum 2012
Join The Green Grid Forum conversation on Twitter!
As you are tweeting, use #TGGForum12.

Celebrating 5 Years of Leading the Industry to Resource Efficient IT


The Green Grid Forum 2012

You might also like