Next generation transport network - Carrier Ethernet

Mobile Backhaul / Consumer Broadband / Enterprise Services

Ramakrishnan Subramanian
Cisco Systems
Agenda

Evolution and Trends in Mobile Networks

Mobile Backhaul with Unified MPLS
Unified MPLS introduction and architectures
2G/3G, LTE Backhaul Services
Synchronization
Fast Convergence

Consumer Broadband Services

Enterprise Services
Summary

2014 Cisco and/or its affiliates. All rights reserved.

Backhaul Network Challenges
Support of Multi-Technology over Transport Network. Mobile (2G, 3G, LTE),
Enterprise, Consumer Services
SDH based network is having lack of scalability for growing BW needs with low
Capex. High Cost of backhaul Network
Large Scale
Fast Convergence
Quality of Service
Frequency Synchronization and Phase Synchronization
Backhaul Network capacity is limiting the growth/expansion

2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
 Service Node Bandwidth per Node
Category
2G BTS Larger Cities 2-4 E1.
Smaller Town: 1 2 E1
3G NB Voice: 1 E1
Data: 42MB in Large City
14-20MB in smaller Town
4G / LTE eNB 100Mbps

SP Wifi AP 4MB
Consumer DSLAM / OLT 1G / 10G
Broadband

Enterprise WiMax 7MB Per Sector.

Service No. of Sector: 3 to 4 Per Location

Microwave Hybrid Vary from 25 or 50 or 400Mbps

Backhaul

2014 Cisco and/or its affiliates. All rights reserved.

Mobile Backhaul with Unified MPLS
Unified MPLSclassical MPLS with a few
additions Classical
MPLS

IGP/LDP Flex
Domain RFC BGP Access LFA BGP E2E
isolation 3107 filtering L2/IGP/BGP/MPLS-
TP/LDP DoD
R-LFA PIC OAM

Unified
MPLS
Architecture

Scalability Security Simplification Multi-Service

Routing + MPLS Design
Divide & Conquer Game Plan
Disconnect & Isolate IGP domains
No more end-to-end IGP view
Leverage BGP for infrastructure (i.e. PE) routes
Also for infrastructure (i.e. PE) labels (e.g. RFC3107)

BGP for Services (e.g. L2, L3)

BGP for Infrastructure Prefixes
Isolated IGP & LDP Isolated IGP & LDP Isolated IGP & LDP

Access Aggregation Region1 Backbone Region 2 Aggregation Access

.

.
.

ISIS Level 1 ISIS Level 2 ISIS Level 1

BGP BGP

Or (+Label)
Or (+Label)
Or
R
OSPF Area Y .
OSPF Area 0 OSPF Area X
PE21
PE21
PE11 PE31

2014 Cisco and/or its affiliates. All rights reserved.

 U-MPLS Classical

Unified MPLS Architecture (RFC 3107) IGP/LDP Label

BGP3107 Label
MPLS

Service Label

iBGP/eBGP EPC Gateway

Access Node Pre-Aggregation
Node
Access Core Network
Aggregation Network
Network
Access Node Core ABR
Aggregation Node Centralised RR

IGP/LDP IGP/LDP IGP/LDP

2014 Cisco and/or its affiliates. All rights reserved.

 Sample E2E Unified MPLS Architecture
Routing Isolation and Label Stack for LSP between Pre-Agg. Node Loopbacks
Aggregation Aggregation Access
Access Core Network
Network Network Network
Network Core ABR
Core ABR MPC
(Inline RR) Agg. Node Pre-Agg.
Pre-Agg. Agg. Node (Inline RR) Gateway
Node
Node
ISIS Level 1/OSPF x ISIS Level 2/OSPF 0 ISIS Level 1/OSPF x L2
L2

Core ABR Access

Access Core ABR
Agg. Node (Inline RR) Centralised RR Agg. Node Node
Node (Inline RR)
IGP/LDP Label Push Swap Pop Push Swap Pop

BGP3107 Label Push Swap Swap Swap Pop

Service Label

LDP LSP LDP LSP LDP LSP

BGP LSP

No IGP route is propagated from Aggregation to the Core. IGP area has routes for that area only plus routes to core
ABRs. Only the core ABRs are propagated from L2 to L1
LDP labels are used to traverse each domain and reach core ABRs
BGP labels are used by Labeled BGP PEs & ABRs to reach Labeled BGP PEs in remote areas
Service (e.g. PW) labels are used by Label BGP PEs
2014 Cisco and/or its affiliates. All rights reserved.
 Unified MPLS Model 1
MPLS support in the Core, Aggregation with TDM, uWave or L2 in the access
Access Aggregation Core Network Aggregation Access
Network Network Core ABR MPC Core ABR Network Network
Agg. Node (Inline RR) Gateway (Inline RR) Agg. Node Pre-Agg.
Pre-Agg.
Node Node
L2
Core ABR Core ABR
Agg. Node (Inline RR) Centralised RR (Inline RR) Agg. Node

LDP LSP LDP LSP LDP LSP

L2/TDM/uWave L2/TDM/uWave
iBGP Hierarchical LSP

The Mobile Core and Aggregation Networks enable Unified MPLS Transport

The Core and Aggregation Networks are organized as independent IGP/LDP domains

The network domains are interconnected with hierarchical LSPs based on RFC 3107, BGP IPv4+labels. Intra
domain connectivity is based on LDP LSPs

The Aggregation Node enable Mobile and Wire line Services. The Mobile RAN Access is based on TDM,
Packet Microwave or pt-to-pt L2 connectivity
2014 Cisco and/or its affiliates. All rights reserved.
 Unified MPLS Model 2
MPLS support in the Core, Aggregation and Access Network
Access Aggregation Core Network Aggregation Access
Network Network Core ABR MPC Core ABR Network Network
Access Agg. Node (Inline RR) Gateway (Inline RR) Agg. Node Access
Pre-Agg. Pre-Agg.
Node Node
Node Node

Core ABR Core ABR

Access Agg. Node Centralised RR Agg. Node Access
(Inline RR) (Inline RR)
Node Node
LDP LSP LDP LSP LDP LSP LDP LSP LDP LSP

iBGP Hierarchical LSP

The Mobile Core, Aggregation, Access Network enable Unified MPLS Transport

The Core, Aggregation, Access are organized as independent IGP/LDP domains

The network domains are interconnected with hierarchical LSPs based on RFC 3107, BGP IPv4+labels. Intra
domain connectivity is based on LDP LSPs

The Access Network Nodes learn only the required labelled BGP FECs, with selective distribution of the MPC
and potentially neighbouring RAN labelled BGP communities
2014 Cisco and/or its affiliates. All rights reserved.
 Unified MPLS Model 3
MPLS in the Core, Aggregation with IGP/LDP in the access
Access Core Network Aggregation Access
Aggregation
Network Network Network
Network Core ABR MPC Core ABR
Pre-Agg.MPC
Redistribute
Access iBGP community Agg. Node (Inline RR) Gateway (Inline RR) Agg. Node Access
Node
into RAN Access IGP Pre-Agg.
Node Node
Node

Redistribute Core ABR Core ABR

Access CSN Loopbacks Agg. Node Centralised RR Agg. Node Access
(Inline RR) (Inline RR)
Node into iBGP Node
LDP LSP LDP LSP LDP LSP
LDP LSP LDP LSP
iBGP Hierarchical LSP

The Core and Aggregation are organized as distinct IGP/LDP domains

Inter domain hierarchical LSPs based on RFC 3107, BGP IPv4+labels which are extended out to the Pre-
aggregation

Intra domain LSPs based on LDP

The inter domain Core/Aggregation LSPs are extended in the Access Networks by distributing the RAN IGP into
the inter domain iBGP and distribute the necessary labelled iBGP prefixes (MPC gateway) into RAN IGP (via BGP
communities)
2014 Cisco and/or its affiliates. All rights reserved.
Unified MPLS Service Infrastructure
 2014 Cisco and/or its affiliates. All rights reserved.
 LTE
LTE MPLS VPN Service
Scale Control for S1 and X2 communication
Export: RAN Y RT, Common RT
Export: RAN W RT, Common RT Import RAN Y RT, MPC RT
Import RAN W RT, MPC RT Core Domain
MME Aggregation Domain
VRF Aggregation Domain VRF
VRF

VRF MTG VRF

SGW/PGW
MTG
VRF LTE Transport VRF
VRF VRF
VRF MPLS VPNv4/v6 VRF
VRF
MTG
SGW/PGW

VRF VRF VRF VRF

Export: MPC RT
Export: RAN X RT, Common RT Import: MPC RT, Common RT
Export: RAN Z RT, Common RT
Import RAN X RT, MPC RT Import RAN Z RT, MPC RT

Unified MPLS transport with a common MPLS VPN for LTE S1 from all CSGs and X2 per LTE region
Mobile Transport GWs import all RAN & MPC Route Targets, and export prefixes with MPC Route Target
CSGs (and Pre-Aggregation Node) in a RAN region import the MPC and neighboring RAN Route Targets:
Enables S1 control and user plane with any MPC locations in the core
Enables X2 across CSGs in the RAN region
2014 Cisco and/or its affiliates. All rights reserved.
Unified MPLS with Microwave Access
Integration with Microwave Adaptive Code Modulation (ACM)

The IP/MPLS Access Network adapts intelligently to

the Microwave Capacity drops

Microwave Adaptive Code Modulation changes due

to fading events are signaled through an Y.1731
Aggregation Node VSM to the MPLS Access Node

Aggregation Node
The MPLS Access Node adapts the IGP metric of
Policy Logic that updates the link to the new capacity, triggering optimized
IP/MPLS the IGP metric on the SPFs that account for the capacity drops
interface IP/MPLS interface
Degraded Link Cost = [n +1- n*CB/NB] * Original Link Cost
Where: CB = Current BW, NB = Nominal BW, n = nodes in the ring
Y.1731
VSM
Signals the
In addition the Access Node can change the
Microwave Hierarchical QOS policy on the interface with the
link speed microwave system allowing EF traffic to survive
Microwave Fading
despite of the capacity drop.
2014 Cisco and/or its affiliates. All rights reserved.
Network Synchronization
 Synchronization Needs for different applications
Technology Frequency Phase or Time Synchronization
Read: better than Read: less than
Macro BS: 50 ppb
GSM N/A
Pico BS: 100 ppb
WideArea BS: 50 ppb
Medium/LocalArea BS: 100 ppb
WCDMA (and LTE) FDD N/A
Home BS: 250 ppb
OBSAI: 16 ppb
WideArea BS: 50 ppb
WCDMA TDD 2.5 s between base stations
LocalArea BS: 100 ppb
WideArea BS: 50 ppb
TD-SCDMA 3 s between base stations
LocalArea BS: 100 ppb
WideArea BS: 50 ppb 3 s between base stations
LTE TDD
LocalArea BS: 100 ppb May range from 0.5s to 50s
Macro Cell BS: 50 ppb ToD (UTC) sync should be less than 3 s and
CDMA2K
Pico Cell BS and Femto Cell: 100 ppb shall be less than 10 s
Up to 1 ppb
WiMAX Mobile Usual values between 0.5s and 5s
Average target : 15 ppb
CoMP, relaying function, carrier aggregation
LTE-Advanced Services 5 ppb (CoMP)
0.5 s [ 1 s]
Multi-Media Bcast SFN Service 50ppb 1 s
DVB SFN Up to 1 ppb General agreement : 1 s
TDM transmission G.823/G.824/G.8261 N/A
1 to 100 s ToD synchronization
Network Monitoring N/A
for 10 s to 1 ms measurement accuracy

2014 Cisco and/or its affiliates. All rights reserved. 18

 Synchronisation Requirements
Clocking Mechanisms Comparison

Clocking Mechanism Advantages Disadvantages

Reliable PRC
Antenna required
GPS Relatively cheap
US Govt owned
Frequency and phase

Reliable PRC No Phase

PRC/BITS Generally Available Need to maintain TDM in all Ethernet deployment

Requires Master w/ PRC

Packet Based
1588-2008 (Frequency and Phase)
Performance influenced by network
Undefined Profiles in SP environments

Physical layer No Phase

SyncE/ESMC (Frequency) Every node in chain needs to support

Not as robust as 1588-2008

Packet Based
NTPv4 (Frequency and Phase)
Open standard
Some proprietary implementations

2014 Cisco and/or its affiliates. All rights reserved.

UMMT Synchronization Distribution
TDM(SDH)
SyncE
SyncE, ESMC TDM(SDH)
1588 PTP
Non-SyncE aware
BSC, ATM RNC PRC/PR
S

IP/MPLS Transport Network

External
1588 BC Synchronization
1588 Phase Interface (Frequency)
External
Synchronization 1588 PMC
Interface (ToD and Packet Master Clock
Ethernet Fiber Phase) Phase

Global Navigation Satellite System (e.g. GPS,

GLONASS, GALILEO)- PRTC, Primary Reference
Mobile Packet Core Network
Time Clock

Mobile Access Aggregation Network Core Network

Network
Mobile Transport
Gateway (MTG) ASR-
9000
IP/MPLS Transport IP/MPLS Transport Aggregation
Cell Site Gateway IP/MPLS Transport
(CSG) Pre-Aggregation Node Node Core Node Core Node
ASR-901, 2941 ME-3800X, 3600X, ASR-903 ASR-9000 CRS-3, ASR-9000 CRS-3, ASR-9000
Fiber or uWave Link, Ring DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Fiber Rings, Mesh Topology

2014 Cisco and/or its affiliates. All rights reserved.

 2
C D
10 Backbone
2
A 2 B 1
4
A1 A2
8
E F
C1 C5
E1
TE-FRR
Backup tunnel
C2 NH protection C4
A1 A2
C3
Remote-LFA
C1 C5 tunnel to
Access Region PQ node

C2 C4
http://tools.ietf.org/html/draft-shand-remote-lfa

Simple, Minimum Configuration

C3
No need for additional protocols overhead like (RSVP TE)
RFC-5286 defines the baseline LFA-FRR Simpler for capacity planning then TE-FRR
2014 Cisco and/or its affiliates. All rights reserved.
Remote LFA FRR - Protection

C2s LIB
C1s label for FEC A1 = 20 Backbone
C3s label for FEC C5 = 99
C5s label for FEC A1 = 21 A1 A2
On failure, C2 sends A1-destined traffic onto an LSP
destined to C5 C1 Directed LDP C5
E1
20 session
Swap per-prefix label 20 with 21 that is expected by C5 for that 21
prefix, and push label 99
C2 21 C4
When C5 receives the traffic, the top label 21 is the
one that it expects for that prefix and hence it forwards 99 C3
21 X
it onto the destination using the shortest-path avoiding 21 99
the link C1-C2. Access Region

2014 Cisco and/or its affiliates. All rights reserved.

 What Is PIC or BGP FRR?
Core

100000

10000
PIC
LoC (ms)

1000
no PIC
100

10

1
12 0

15 0

17 0

20 0

22 0

25 0

27 0

30 0

32 0

35 0
00
0

10 0
1

0
00

00

00

00

50

00

50

00

50

00

50

00

50

00
25

50

75

Prefix

msec
1000000

100000

250k PIC
10000
250k no PIC
500k PIC
1000
500k no PIC

100

10

1
50000

100000

150000

200000

250000

300000

350000

400000

450000

500000
0

Prefix

2014 Cisco and/or its affiliates. All rights reserved.

Wholesale Consumer Broadband and Enterprise Services
 Centralized BNG
Consumer Broadband Services Distributed BNG

Subscriber Access Aggregation Network Core Network

Residential Cable/CMTS

Agg Switch Agg Switch Edge Router

DSL/DSLAM MPLS/IP
Corporate Network

Fiber / OLT
MPLS/IP
Network
Wireless
Ethernet

Agg Switch Agg Switch Edge Router

Cell Phones Mobility

Internet

Dynamic/Controlled/Accounting Stability/Performance

2014 Cisco and/or its affiliates. All rights reserved. 25

Enterprise VPN and Internet Service (Option-1)
Subscriber Access Aggregation Network Core Network

Residential Cable/CMTS
Enterprise
Agg Switch Agg Switch Edge Router
DSL/DSLAM MPLS/IP
Corporate Network

Fiber / OLT
MPLS/IP
Network
Wireless
Ethernet

Agg Switch Agg Switch Enterprise

Edge Router
Cell Phones Mobility
Internet

Pseudo-wire 802.1Q
L2/L3 VLAN

2014 Cisco and/or its affiliates. All rights reserved.

 Access PE (A-PE) Service PE (S-PE) Internet
CE e.g.: DSLAM, OLT, e.g: PW-HE-L3-PE Peering
U-PE PW-HE-BNG

Aggregation LDP LDP Core /

domain Business L3 Internet Core L3PE CE
VPNs

Pseudo-wire Headend Architecture benefits:

Supports Seamless MPLS end-to-end Architecture: Flexible Edge placement
Simpler resiliency between L3 PE and aggregating network
Easy-to-operate service High-Availability through MPLS based network convergence
Eliminates operationally cumbersome VLAN hand-off
2014 Cisco and/or its affiliates. All rights reserved.
Summary

Metro Ethernet requirements fundamentally change with LTE/LTE-A and

Converged Backhaul.
One Network & Many Services
Mobile (2G/3G/LTE), Enterprise and consumer
Large Scale
Can support 100K+ Devices
Fast Convergence
IGP FC: Simple, sub-second, always required in all areas
LFA FRR and Remote LFA FRR: simple <50ms Link and Node
BGP PIC : innovation enabling BGP to scale the IGP with simplicity

2014 Cisco and/or its affiliates. All rights reserved.