Download MPLS - APNOMS

Management of
MPLS-based VPNs
2003. 10. 1.
Youngtak Kim
Advanced Networking Technology Lab. (ANTL)
Dept. of Information & Communication Engineering,
Yeungnam University, Korea
(ytkim@yu.ac.kr)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
1
Outline
 This tutorial goes through …
 Framework of MPLS-based VPNs: L3VPN, L2VPN, VPLS
 Traffic Engineering based on DiffServ-aware-(G)MPLS
 Management Framework of MPLS Network, MPLS MIBs
 MPLS OAM for the Management of MPLS-based VPNs
 Commercial MPLS-VPN Management Systems: Cisco VPN Solution,
SheerBOS, Wandl’s IP/MPLSview
 Experiences in the design and implementation of a Management System for
DiffServ-aware-MPLS (DoumiMan)
 Conclusions and Discussions
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
2
Framework of MPLS-based VPNs
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
3
VPN (Virtual Private Network)
 What is VPN (Virtual Private Network) ?
 Definition of VPN in RFC 2764 (A Framework for IP Based Virtual Private
Networks) : “VPN is an Emulation of a private wide area network (WAN)
facility using IP facilities (including the public Internet or private IP
backbones).”
 CPE-based VPN
 Network-based VPN
 General Requirements of VPNs
 Opaque packet transport
 Data Security
 Quality of Service Guarantees
 Tunneling Mechanism
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
4
VPN Types
 Types of IP based Virtual Private Networks (RFC 2764)
 Virtual Leased Lines (VLL)
 Virtual Private Dial Network (VPDN)
 Virtual Private Routed Network (VPRN)
 Virtual Private LAN Segment (VPLS)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
5
VPN Types (1): VLL
 Virtual Leased Lines (VLL)
 Point-to-point link provided to a customer, connecting two CPE devices
 the link layer type used to connect the CPE devices to the ISP nodes can be
any link layer type: e.g. ATM VCC, Frame Relay circuit
 ISP tunnel between two edge ISP nodes
IP backbone
network
CPE
ATM
VCC
ISP
edge
node
IP Tunnel
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
ISP
edge
node
ATM
VCC
CPE
6
VPN Types (2): VPDN
 Virtual Private Dial Network (VPDN)
 allows a remote user to connect on demand through an ad hoc tunnel into
another site; the user is connected to a public IP network via a dial-up PSTN
or ISDN
 Layer 2 Tunneling Protocols (L2TP)
 PPP session on the dial-up connection and L2TP tunnel
Host
dialup
connection
LAC
NAS
(Network
LNS
IP
Backbone Network
Gateway
Corp.
Network
L2TP Tunnel
PPP Session
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
7
VPN Types (3): VPRN
 Virtual Private Routed Networks (VPRN)
 Emulation of a multi-site wide area routed network using IP facilities
 CPE-based VPRN or network-based VPRN
 packet forwarding is carried out at the network layer
 a mesh of IP tunnels between ISP routers with VPN-specific
routing/forwarding tables
CPE
Stub
Link
ISP
edge
node
ISP
edge
node
IP Tunnel
Stub
Link
CPE
IP backbone
network
ISP
edge
node
Stub
Link
CPE
Stub
Link
CPE
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
8
VPN Types (4): VPLS
 Virtual Private LAN Segment (VPLS) (1)
 Emulation of LAN segment over IP using Internet facilities, with a
Transparent LAN Service (TLS)
 A case of L2VPN service distinguished by the support of L2 broadcast
 Can be used to interconnect multiple stub CPE nodes, either bridges or
routers, in a protocol transparent manner
 Essentially equivalent to a VPRN, except that each VPLS edge node
implements link layer bridging rather than network layer forwarding
 CPE routers would peer transparently across a VPLS with each other
without requiring any router peering with any nodes within the VPLS
 VPLS topology can be





point-to-point
point-to-multipoint (hub and spoke)
any-to-any (full mesh)
mixed (partial mesh)
hierarchical
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
9
Virtual Private LAN Segment (VPLS) (2)
Stub
Link
CPE
VPLS A
CPE
Logical Bridge
Stub
Link
ISP
edge
node
ISP
edge
node
IP Tunnel
IP backbone
network (Service
Provider backbone)
CPE
VPLS A
Access
Network
VPLS B
CPE
VPLS B
ISP
edge
node
Stub
Link
VPLS
B
CPE
Stub
Link
CPE
VPLS
B
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
10
MPLS-based VPNs (1): BGP/MPLS IP VPNs
 Multiple VRFs (VPN Routing and Forwarding tables) in PEs
 PE-CE attachment circuit is associated with exactly one VRF
 Carrier’s Carriers case
 a VPN provided by an SP which is offering VPN services to its customers
 CE routers should support MPLS
 PE routers should distribute , to the CE routers, labels for the routes they
distribute to the CE routers
 Routers at the different sites should establish BGP connections among
themselves for the purpose of exchanging external routes
 Multi-AS backbone
 two sites of a VPN are connected to different Autonomous Systems
 IBGP is used to distribute routing information within an AS
 EBGP re-distribute routing information among (labeled VPN-IPv4 routes)
from AN to neighboring AS
 Multi-hop EBGP redistribution of labeled VPN-IPv4 routes between source
and destination ASs.
 VRF-to-VRF connections at the AS border routers
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
11
MPLS-based VPNs (2): L3PPVPN (Provider
Provisioned VPN) /MPLS
 Provider Edge (PE) (in PE-based VPN) or Customer Edge (CE) (in CE-based VPN)
determine how to route VPN traffic by looking at the IP and/or MPLS headers of the
packets they receive from the customer’s edge devices
 MPLS LSP is used as the tunnel among PE-PE (in PE-based VPN), or CE-CE (in CEbased VPN)
PE
device
VPN
tunnel
PE
device
Tunnel
(MPLS LSP)
VPN
tunnel
PE
device
CE
device
PE
device
SP Network A
CE
device
dual
homing
dual
homing
VPN
tunnel
PE
device
SP Network B
Backdoor
link
VPN
tunnel
Tunnel
PE (MPLS LSP) PE
device
device
PE
device
CE
device
SP Network C
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
12
MPLS-based VPNs (3): L2PPVPN (Provider
Provisioned VPN) /MPLS
 Provides pseudo wire or emulated LAN service on provider network
 Virtual Private Wire Service (VPWS): each CE device is presented with a
set of Point-to-Point virtual circuit
 Virtual Private LAN Service (VPLS): each CE device has one or more LAN
interfaces that lead to a “virtual backbone” to make multipoint-to-multipoint
VPN (LAN emulation service)
CE 1
L2 VPN A
CE 2
Logical Switching Instance
(provides Pseudo wire or emulated LAN)
PE
device
L2 VPN A
Service Provider
Backbone
PE
device
CE 4
L2 VPN B
PE
device
Access
Network
CE 5
L2 VPN B
CE 3
L2 VPN A
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
13
L2PPVPN Provisioning Models
 Overlay Model
Service Provider Network
Customer
Site A CE
(Hub)
PE
PE
Customer
CE Site D
(Spoke)
Customer
Site B CE
(Hub)
PE
PE
Customer
CE Site E
(Spoke)
 Peer-to-peer Model
Routing information is
exchanged between customer
and service provider routers
Customer
Site A CE
Customer
Site B CE
Customer
CE Site C
(Spoke)
Service Provider Network
PE
Customer
CE Site C
PE
Customer
CE Site D
PE
Service provider routers
exchange customer routes
through the core network
PE
Routing information is
exchanged between customer
and service provider routers
Customer
CE Site E
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
14
Traffic Engineerings based on
DiffServ-aware-(G)MPLS Network
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
15
NGI with IP, MPLS and WDM Optical Network
IP Layer network
IP
Router
IP
Router
IP
Router
IP
Router
MPLS, MSPP
Layer network
GbE
SW
GMPLS/DWDM-OXC
layer Network
TDM
SONET/SDH
(Circuit Switched
Service)
GbE
VPN
LSP
GbE
SW
GbE
SW
Multimedia/
Video
Archives
Multimedia/
Video
Storage Access Network Archives
MPLS, MSPP/MSPP
(SAN)
GMPLS OXC-LSR
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
16
Objectives of Traffic Engineering in NGI (1)
 Guaranteed Bandwidth & QoS
 Bandwidth:
 Committed Data rate (CDR)/ Committed Burst Size (CBS), Excess Burst Size (EBS)
 Peak Date Rate (PDR)/ Peak Burst Size (PBS)
 End-to-end Packet Transfer Delay: Propagation delay + Queuing delay
 Limited Jitter (delay variation)
 Limited End-to-end Packet loss
 Differentiated Service provisioning with Different priority/weight
 Premium service, controlled service
 Best effort service
 Hierarchical traffic engineering with TE-Tunnels (LSPs) for extremely
broadband networking with WDM optical lambda/fiber switching
 Maximized utilization of available bandwidth & resources
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
17
Objectives of Traffic Engineering in NGI (2)
 Two major objectives may be conflicting
 Guaranteed Bandwidth & QoS
 Maximized resource utilization
 in order to guarantee strictly bandwidth and QoS, strict bandwidth &
resource reservation is required
 if bandwidth & resource are strictly reserved and not used, underutilization
problem occurs => general phenomenon in current telephone network
 Solution to get both objectives ?
 controlled bandwidth borrowing among service class-types within a TE-LSP
 controlled redistribution of extra-available bandwidth among TE-LSP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
18
MPLS (Multi-Protocol Label Switching)
IP payload
IP header (destAddr=B, srcAddr=A)
Ingress Node label i
i LSR 10
IP datagram
LSR 30
LER 31
LER 11
label j
source
(IP address A)
destination
(IP address B)
j
LER 12
LER 41
LSR 20
k
LSR 40
m
label k
LER 21
IP datagram
LER 42
label m
Egress Node
MPLS Domain Network
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
19
MPLS Label
32-bit (4-bytes)
20
Shim Header
Label
3
1
Exp S
8
TTL
Label: Label Value, 20 bits (0-16 reserved)
Exp.: Experimental, 3 bits (was Class of Service)
S: Bottom of Stack, 1 bit (1 = last entry in label stack)
TTL: Time to Live, 8 bits
Layer 2 Header
(eg. ATM VC/VP, label stack n
PPP,
(s=1)
802.3 MAC)
•••
label stack 1 IP Header
(s=0)
IP Payload
MPLS ‘Shim’ Headers
(Label Stacking)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
20
Traffic grouping with Label Stacking
LSP
level (k)
LSP
level (k-1)
Packet Flow
P1
P2
LSP 111
LSP
level (k+1)
LSP
level (k)
LSP
level (k-1)
LSP 111
LSP 110
LSP 110
Packet Flow
P1
P2
LSP 100
LSP 121
LSP 111
ingress
(push a label)
R1
LSP 120
LSP 110
ingress
(push a label)
R2
LSP 120
LSP 100
LSP 100
ingress
egress
(push a label)
(pop a label)
swapping

Ri
Ri+1
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
LSP 121
LSP 110
egress
(pop a label)
LSP 111
egress
(pop a label)
Rn-1
Rn
21
GMPLS-based Optical Transport Networking
Internet control & management protocols
(RIP, OSPF, BGP, DVMRP, MOSPF)
Traffic engineering with fault management & performance management
for Internet Transit Network
Application
GMPLS-Signaling + OAM/LMP
GMPLS-Signaling for optical network
TCP/UDP
IP
IP
IP
LSP
MPLS
NIC
O-NIC
NIC
(WDM)
Host A
IP Router
Metro-GbE
Net
GbE
SW
MainFrame
PSTN
HDN
SDH/
SONET
MPLS
O-NIC O-NIC
(WDM) (WDM)
PSC-LSR
(Edge)
GMPLS
LCAS Signaling
O-NIC
(WDM)
OXC
OXC
O-NIC
(WDM)
O-NIC
(WDM)
OXC-LSR
(Core)
fiber
bundle
PSC-LSR
(Optional Core)
OXC-LSR
(Core)
GFP-F O-NIC
GFP-T (WDM)
MSPP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
22
QoS-guaranteed Service Provisioning in NGN
QoS-guaranteed VPN/VPLS Service
QoS-guaranteed Broadband Multimedia Service
QoS-guaranteed Broadband Content Distribution Network / Storage Access Network
Customer Premises
Network A CE
(IP Router)
Narrowband
Multimedia/
PSTN
Narrowband
Multimedia/
Cellular/
Mobile
Broadband Content
Distribution Network
(CDN/SAN)
Customer Premises
CE Network B
(IP Router)
GMPLS Core Network
PE
(VPLS-aware
MPLS LER)
TGW
Edge Node
(DiffServ-aware
MPLS LER)
AGW
Edge Node
(DiffServ-aware
MPLS LER)
MPLS
LSR
OXC/
OADM
OXC/
OADM
MPLS
LSR
MPLS
LSR
OXC/
OADM
OXC/
OADM
MPLS
LSR
MPLS
LSR
OXC/
OADM
OXC/
OADM
MPLS
LSR
GMPLS/Broadband Transport Network
(All Optical, O-O-O)
(DiffServ-aware-GMPLS)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
PE
(VPLS-aware
MPLS LER)
Edge Node
(DiffServ-aware
MPLS LER)
Edge Node
(DiffServ-aware
MPLS LER)
TGW
AGW
Narrowband
Multimedia /
PSTN
Narrowband
Multimedia /
Cellular/
Mobile
Broadband Content
Distribution Network
(CDN/SAN)
23
Control Plane and Management Plane of QoS-guaranteed
NGN/(G)MPLS
Management Plane
Resource
Manager &
GMPLS
OAM/NMS
Inter-AS
QoS Negotiation
BGP-TE
Resource
Manager &
GMPLS
OAM/NMS
Resource
Manager &
GMPLS
OAM/NMS
Inter-AS
QoS Negotiation/
BGP-TE
Control Plane
QoS/call Admission
End-user Request control &
application Resource Connection
platform Allocation Control
agent
QoS Request &
Admission Resource
End-user
control & Allocation
Connection Notification application
Control
platform
agent
QoS Request (GMPLS Signaling)
Resource Allocation (GMPLS Signaling)
Customer
Premises
Network (CPN) A
CE
Customer
Premises
Network (CPN) B
UNI
PSTN,
SAN/CDN
Broadband
Access
Network
Wireless/
Mobile
Wireless
Access
Network
Access Network QoS
EN
EN
UNI
NNI
NNI
EN
EN
EN
EN
Autonomous
Autonomous
Autonomous
System (AS) 2
System (AS) 1
System (AS) 3
QoS-guaranteed NGN Backbone Network
DiffServ-aware-GMPLS/OXC 광전달망
NGN Backbone Network Performance/QoS
CE
Broadband
Access
Network
PSTN,
SAN/CDN
Wireless
Access
Network
Wireless/
Mobile
Access Network QoS
End-to-End QoS
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
24
MPLS Traffic Engineering
 Fast packet switching
 Fast packet switching by using fixed short label, instead of long address
matching in IP packet routing
 based on existing fast data link layer switching technologies (e.g. ATM, FR)
 Traffic engineering with Connection-oriented LSP (Label
Switched Path)
 more predictable network control and management
 Constraint-based Routing; Constraint-based Shortest Path First (CSPF)
 Forwarding Equivalent Class (FEC)
 source/destination IP address range : min, max
 source/destination port range : min, max
 Type of Service (ToS)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
25
Service Level Agreement (SLA)
 Service Level Agreement (SLA)
 A contract between a service provider and a customer
 Specifies, usually in measurable terms, what QoS the service provider will
provide
 Traffic Parameters: Committed Data Rate (CDR)/CBS+EBS
 QoS Parameters: Delay, Jitter, Packet Loss Rate
 Service Availability: Mean Time Between Failures (MTBF)/Mean Time to
Restoration of Service (MTRS)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
26
Constraint-based Routing in MPLS
 Traffic parameters of the constraint-based routing for LSP
 bandwidth of LSP : peak data rate, committed data rate
 Modification of Link State Database for constraint-based routing
 traffic parameter
 available bandwidth at each link : number of lambda channels, bandwidth of each lambda
channels
 Additional QoS parameter
 propagation delay
 Combined cost metric
 Modification of OSPF shortest path routing
 constraint-based routing with traffic parameters: bandwidth, QoS, resource class,
class of failure protection
 SRLG (Shared Risk Link Group)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
27
Example of Constraint-based Routing
Seattle
1
1144
20M
Rapid city
828000
10M
820
5M
657
Salt Lake City 10M
San Francisco
2
4
745
10M
521000
50M
3
Los Angels
389
50M
Denver
6
688
10M
380
5M
5
816
10M
381
10M
7
Phoenix
Physically shortest path.
But can not provide the
requested 7 Mbps
bandwidth !!
1067
50M
611
10M
Boston
Minneapolis
8
20
Detroit
834 10M
409
211 5M
10M Chicago 15
640
19
920
14 286
5M
New York
297
50M
10M
534
10M
237 5M
10M
18
861000
St. Louis
845
Washington
50M
10M
13
D.C.
285000
632
780
10M
10M
100M
394
Memphis 12
5M
17 Atlanta
Dallas
454
393000
9
100M
10M 473
246
661
10M
5M
10M
352
10
11
10M
861000
Houston
New Orleans 10M
16
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
Miami
28
Example of SRLG-disjoint Backup Path Routing
Seattle
Shared Risk Link Group
(SRLG) – disjoint backup
path with
1
1144
20M
820
5M
Rapid city
828000
10M
657
Salt Lake City 10M
San Francisco
2
380
5M
3
Los Angels
4
745
10M
521000
50M
5
389
50M
Denver
6
688
10M
816
10M
381
10M
7
Phoenix
1067
50M
Constraint-routed shortest
path that can provide 7
Mbps bandwidth !!
611
10M
Boston
Minneapolis
8
20
Detroit
834 10M
409
211 5M
10M Chicago 15
640
19
920
286
14
5M
New York
297
50M
10M
534
237 5M
10M
10M
18
861000
St. Louis
845
Washington
50M
10M
13
D.C.
285000
632
780
10M
10M
100M
394
Memphis 12
5M
17 Atlanta
Dallas
454
393000
9
100M
10M 473
246
661
10M
5M
10M
352
10
11
10M
861000
Houston
New Orleans 10M
16
Miami
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
29
Factors on End-to-End Transfer delay, Jitter
 Queuing delay in M/D/1 queue
tw 

2(1   )
s 

2(1   )

B
R
 : link utilization
 Mean time in Queue
 

(2   ) B


tq  t w  s  
 1  s 

2(1   ) R
 2(1   ) 
 Packet loss and buffer size calculated by heavy traffic
approximation:

 1   

Pr{Systemsize  x}  Q( x)  exp  2 x

  
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
30
Bandwidth Borrowing among LSPs within an
TE-LSP
Borrowing/re-allocation of
available/unused bandwidth
TE-LSP
Excess available
bandwidth
needs more
bandwidth
LSP i (weight = x)
LSP j (weight = y)
under utilization
under utilization
LSP k (weight = z)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
31
Re-distribution of Extra Available Bandwidth
among Tunnel (TE)-LSP
availableBW _ LSPi 
wi
 extraAvailableBW
 wk
k
availableBW _ LSPij 
wi j
w
 availableBW _ LSPi
im
m
Available Excess
Bandwidth
extraAvailableBW
LSPi1(wi1)
LSPi
(wi)
LSPi2(wi2)
LSPj1(wj1)
PHY LINK
LSPj
(wj)
LSPj2(wj2)
(a) Controlled Bandwidth Redistribution/Borrowing
User LSP Inner Tunnel LSP
Outer Tunnel LSP
(b) Hierarchical/Recursive Redistribution of
Available Bandwidth
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
32
Differentiated Service (DiffServ)
 DiffServ Packet Processing Model
Smoothing
(averaging)
Metering, Action, Algorithmic Dropping
IP Packet
flow input
Packet Classifier
Buffer depth
NCT
(Network Control Traffic)
Packet
Scheduling
Traffic Shaping
Expedited Forwarding (EF)
Assured Forwarding (AF)
Best Effort Forwarding (BEF)
Packet
Discarding
(algorithmic
dropping)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
Packet Transmission
with Link Speed X
(LSP : PDR/PBS,
CDR/CBS+EBS)
33
Example of DiffServ Class-type and
Performance Objectives
Jitter
packet
Loss
Ratio
Bandwidth
definition
DSCP
100
msec
U
10-3
Peak rate
111 000 /
110 000
VoIP
100
msec
50
msec
10-3
Peak rate
101 110
Jitter sensitive,
real-time high
interaction
Video
conference
400
msec
50
msec
10-3
Committed
rate
100 000
AF3
Transaction
data,
interactive
Terminal
session
Custom app
400
msec
U
10-3
Committed
rate
011 000
AF2
Transaction
data
Data base
Web
400
msec
U
10-3
Committed
rate
010 000
AF1
Low loss bulk
data
FTP
E-mail
1
sec
U
10-3
Committed
rate
001 000
BE
Best effort
Best effort
service
U
U
10-3
U
000 000
Classtype
Objective
Example
Delay
NCT1/
NCT0
Minimized error,
high priority
RIP, OSPF,
BGP-4
EF
Jitter sensitive,
real-time high
interaction
AF4
(Note : a) U : undefined, b) Drop precedence of AF4~AF1 : 010, 100, 110)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
34
Per Hop Behavior (PHB)
 Per-Hop Behavior (PHB)
 The externally observable forwarding behavior applied at a DS-compliant
node to a DS behavior aggregate
 The means by which a node allocates resources to behavior aggregates
 Defines hop-by-hop resource allocation mechanism
 Example of PHB
 Guarantee minimal bandwidth allocation ( x % of a link or tunnel)
 Guarantee minimal bandwidth allocation (x % of a link or tunnel) with
proportional fair sharing of any excess link capacity
 Buffer allocation
 Priority relative to other PHBs
 PHBs are specified as a group (PHB group) for consistency
 PHBs are implemented in nodes by means of some buffer management and
packet scheduling mechanisms
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
35
Metering & Marking
 Parameters for Metering & Marking
Parameters
Single Rate
Three Color Marker
(SRTCM)
CDR/CBS+E
BS
Two Rate
Three Color Marker
(TRTCM)
PDR/PBS
CIDR/CBS
Red
Yellow
Green
TE(t)-B < 0
TP(t)-B  0
and TE(t)-B 
0
TC(t) –B  0
TP(t)-B < 0
TP(t)-B  0
and
TC(t) –B < 0
TC(t) –B  0
(Note: B: arrived packet size, TE(t): token count of excess rate token bucket,
TC(t): token count of committed rate token bucket, TP(t): token count of peak rate token bucket)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
36
Integrated Traffic Engineering for
DiffServ-aware-MPLS
 Guaranteed Quality of Service (QoS) Provisioning
 Traffic parameters
 Peak Rate
 Average rate, Sustainable rate with burst tolerance
 Minimum rate
 Frame rate with max. frame size
 QoS Parameters
 End-to-end transfer Delay
 Delay variance (Jitter) tolerance
 Bit/Packet/Frame error rate
 Maximized bandwidth & resource utilization
 Bandwidth over-booking
 Bandwidth sharing, borrowing
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
37
Per Class-Type Queuing (1):
RED (Random Early Detection) Queue
Buffer level
TH min
TH max
0
Discard
Probabilistic
packet drop
Discard with increasing
probability Pa
Do not discard
Drop Probability
1
Pmax
Pmin
THmin
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
THmax
Average Queue Length
38
Per Class-Type Queuing (2):
WRED (Weighted Random Early Detection) Queue
Drop Probability
1
(Note: THmin(i) =
(1/2 + i/8)*THmax
Pmax
(0..7)
Average Queue Length
THmin(0)
THmin(7) THmax(0…7)
(a) Default WRED Drop Probability Configuration
Drop Probability
Drop Probability
1
1
Pmax(0)
Pmax(0)
Pmax(7)
Average
Queue
Length
THmin(0)
THmin(7) THmax(0…7)
Average
Queue
Length
Pmax(7)
THmin(0) THmax(0)
(b) WRED case 1
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
THmin(7) THmax(7)
(c) WRED case 2
39
DiffServ Packet Scheduler
 Hierarchical Packet Scheduler
priority
NCT1
priority
NCT0
EF
Min rate
AF4
Min rate
AF3
Min rate
AF2
Min rate
Rate-based
scheduler
(WRR or WFQ)
priority
Priority
Scheduler
Traffic Shaper
priority
shaping rate
(PDR/PBS,
CDR/CBS+EBS)
AF1
priority
BF
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
40
DiffServ-aware-MPLS Traffic Engineering
Packet Dropping
packet
(algorithmic drop according
scheduling
to averaged buffer depth) traffic shaping
NCT1
Single Rate Three Color
Marker (CIR/CBS+EBS)
drop
?
NCT0
Single Rate Three Color
Marker (CIR/CBS+EBS)
drop
?
EF
Single Rate Three Color
Marker (CIR/CBS+EBS)
drop
?
AF 4
AF 3
Two Rate Three Color
Marker (PIR/PBS,
CIR/CBS+EBS)
Two Rate Three Color
Marker (PIR/PBS,
CIR/CBS+EBS)
user B
drop
?
AF 2
Two Rate Three Color
Marker
(PIR/PBS, CIR/CBS+EBS)
drop
?
AF 1
Two Rate Three Color
Marker (PIR/PBS,
CIR/CBS+EBS)
drop
?
drop
?
BF
User C
drop
?
rt/nrt-VBR traffic
CBR realtime traffic
VPN control message
rt/nrt-VBR traffic
CBR realtime traffic
VPN control message
Priority-based packet scheduler
Per-Class-type
Metering/Marking
Rate-based packet scheduler
IP Packet
Stream
Packet Classifier
User(UserGroup) A
Multi-field Packet
Classification
Policy-based MPLS Traffic Trunk (TE-LSP)
Management, Load Balancing
CR-LSP
(Traffic Parameters :
- Peak Data Rate(PDR)
- Peak Burst Size (PBS)
- Committed Data Rate (CDR)
- Committed Burst Size (CBS)
- Excess Burst Size (EBS)
- Weight
- Resource Class / Color =“gold”)
Maximum
Capacity/
Aggregate BW
Allocated BW
Un-reserved BW
BE (default)
AF1, 2, 3, 4
EF (or AF1)
NCT 0/1
CR-LSP
(Traffic Parameters,
Resource class
= “silver”)
BE (default)
AF1, 2, 3, 4
EF (or AF1)
NCT 0/1
CR-LSP
(Traffic Parameters,
Resource class
= “bronze”)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
TE-LSP
41
Traffic Policing and Traffic Shaping
Per-class
committed
rate
Aggregated
committed
rate
Token
bucket
Token
bucket
Incoming
packets
Outgoing packets
WFQ/FIFO
Configured rate
Classify
Measure
Packet
Scheduler
Metering/Marking
No
match
Queuing method
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
42
Management Framework of MPLS
Network
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
43
DiffServ-aware-MPLS Traffic Engineering for QoSguaranteed Service Provisioning
QoS-guaranteed
Realtime Multimedia
Service Request/
Subscription
Service Level
Agreement (SLA)
- QoS parameter
- Traffic Parameter
(QoS/SLA Standards)
Long-term
optimization
Network Planning & Provisioning
Mid-term
optimization
(Re-) configuration of logical topology,
Network load balancing
GMPLS/OXC TE-LSP (traffic trunk)
Real-time
per-flow
optimization
DiffServ-aware-G/MPLS
Router parameter setting
(Bandwidth allocation, Queuing, packet scheduling)
Customer
Premises
Network (CPN) A
Intra
-net
Collection &
Analysis
of Performance
Measurement
results
O-UNI
CE
Customer
Premises
Network (CPN) B
DiffServ-awareGMPLS/OXC
Network
PE
(AS 1)
O-NNI
PE
DiffServ-awareGMPLS/OXC
Network
PE
(AS 2)
PE
O-UNI
CE
Intra
-net
QoS-guaranteed GMPLS/OXC Backbone Network
Access Net
QoS
Node & Link, DiffServ-aware-ELSP QoS
performance monitoring
Access Net
QoS
End-to-end QoS & performance measurement
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
44
ITU-T I.371 Traffic Management Framework
User-Network Interface
(UNI)
CPN
Optional Traffic
Shaping
Network A
- CAC
UPC
- RM
- PC
- Others
Inter-Network
(NNI)
Network B
CPN
UPC: Usage Parameter Control
CAC: Connection Admission Control
PC: Priority Control
- CAC
- RM
- PC
- Others
NPC
NPC: Network Parameter Control
RM: Resource Management
Others: Spacing, Framing, Shaping, etc
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
45
Network Performance related Standards (1)
 I.356 ATM Bearer Service QoS Standard
CTD
2-pt.CDV
Class 1
(stringent class)
400msec
Class 2
(tolerant class)
CLR0+1
CLR0
CER
3msec
none
default
U
U
none
default
Class 3
(stringent class)
U
U
U
default
Class 4
(stringent class)
400msec
6msec
none
default
U Class
U
U
U
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
U
U
46
Network Performance related Standards (2)
 ITU-T Y.1540/1541 IP QoS Standards
Network
Performance
Parameter
QoS Class
Service Class
Class 0
Class 1
Class 2
Class 3
Class 4
Class 5
un-specified
Packet Transfer
Delay
100ms
400ms
100ms
400ms
1s
U
Packet Delay
Variance
50ms
50ms
U
U
U
U
Packet Loss
Rate
1×10-3
Packet Error
Rate
1 × 10-3 1 × 10-3 1 × 10-3 1 × 10-3
1 × 10-4
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
U
U
47
Network Management System(NMS) for NGN
Configuration management
Connection management
Fault management
Performance management
SML-ConfM
SSM
SML-FM
SML-PM
SML
CSM
LNTC
NML-PM
NML-Monitoring
NML-FM
CC
NML-FC
NML
LNC
NML-TC
NML-AM
NML-TDS
NML-Tuning
NML-CP
EML-TC
EML
NML-Analysis
& Control
EML-CP
EML-FM
EML-AM
EML-FC
EML-TDS
EML-PM
Management Interface: CLI, CORBA, XML, SNMP, TMN/CMIP
CPN A
(IP Router)
CE
VPN A
(GbE)
CE
CPN A
(SONET/SDH,
Highspeed Leased Line, SDH
GbE)
SAN A
(Fiber Channel, ESCON, SDH
FICON, DVI)
DiffServ-aware
MPLS LER
PE
(VPLS-aware
MPLS LER)
NG-SDH/SONET
(GFP, Virtual
Concatenation)
GMPLS Core Network
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
OXC/
OADM
NG-SDH/SONET
(GFP-T)
DiffServ-aware
MPLS LER
PE
(VPLS-aware
MPLS LER)
CE
CE
CPN
B
(IP Router)
VPN B
(GbE)
CPN B
NG-SDH/SONET
(GFP, Virtual
Concatenation)
(SONET/SDH,
SDHHighspeed Leased Line,
GbE)
NG-SDH/SONET
(GFP, Virtual
Concatenation)
SDH Video/Multimedia
Database Archive
Provider Network
(NG-SDH/SONET Network)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
48
QoS-guaranteed NGN Networking Model
IIOP/
QoS-guaranteed
CORBA
IP networking
System
(CPN)
SNMP/CLI
Customer Premises
Network A CE
(IP Router)
Narrowband
Multimedia/
PSTN
Narrowband
Multimedia/
Cellular/
Mobile
광대역 멀티미디어
분배망 서비스
(CDN/SAN)
QoS-guaranteed
IP networking
System
(ISP)
IIOP/ QoS-guaranteed IIOP/
IIOP/
QoS-guaranteed
QoS-guaranteed
CORBA IP networking CORBA
CORBA
IP networking
IP networking
System
System
System
(ISP)
(ISP)
(CPN)
SNMP/
CLI
SNMP/
CLI
SNMP/
CLI
Customer Premises
CE Network B
(IP Router)
GMPLS Core Network
Provider Edge
(VPLS-aware
MPLS LER)
TGW
Edge Node
(DiffServ-aware
MPLS LER)
AGW
Edge Node
(DiffServ-aware
MPLS LER)
AS 1
SNMP/
CLI
AS 2
MPLS
LSR
OXC/
OADM
OXC/
OADM
MPLS
LSR
MPLS
LSR
OXC/
OADM
OXC/
OADM
MPLS
LSR
MPLS
LSR
OXC/
OADM
OXC/
OADM
MPLS
LSR
GMPLS/광전달망(All Optical, O-O-O)
(DiffServ-aware-GMPLS)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
Provider Edge
(VPLS-aware
MPLS LER)
Edge Node
(DiffServ-aware
MPLS LER)
Edge Node
(DiffServ-aware
MPLS LER)
TGW
AGW
Narrowband
Multimedia /
PSTN
Narrowband
Multimedia /
Cellular/
Mobile
광대역 멀티미디어
분배망 서비스
(CDN/SAN)
49
Distributed Traffic & Network Management System for
multiple Autonomous Systems (AS)
NMS
CPN
A
EMS
EMS
EMS
DiffServ
-aware
MPLS
LER
Constraint-based
Shortest Path First
(CSPF) Routing
MPLS
Transit
LSR
Autonomous System 1
MPLS
Transit
LSR
Autonomous
System 2
MPLS
Transit
LSR
Constraint-based
Shortest Path First
(CSPF) Routing
DiffServ
-aware
MPLS
LER
CPN
B
Autonomous System 2
DiffServ-aware MPLS Network
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
50
Interactions among MPLS Management Modules
NMS
Configuration
Mgmt
Connection
Mgmt
Performance
Mgmt
Fault
Mgmt
Performance
Mgmt
Fault
Mgmt
IIOP
EMS
Configuration
Mgmt
Connection
Mgmt
IIOP
Generic Adapter
Service
Service
Object
Object
Generic
Adapter
NE interface
CLI
interface
SNMP
interface
TELNET
RMA
interface
SNMP
Socket
DNS
RMA
Customer
Premise
Network
CPN(Intranet)
MPLS
Transit
Network
(AS 2)
Customer
Premise
Network
CPN(Intranet)
MPLS Transit Network (AS 1)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
51
Management Interfaces
(EMS-Agent, EMS-NMS)
 Command Line Interface (CLI)
 proprietary CLI definition by each vendor
 most detailed operations and management information
 CORBA(Common Object Request Broker Architecture)/OMG
 distributed object computing infrastructure
 Manager-to-manager connection
 XML (eXtensible Markup Language)
 XML-RPC
 SOAP
 SNMP (Simple Network Management Protocol)
 SNMP MIBs for MPLS-based VPN/VPLS
 Delayed update compared with data access by CLI (Command Line Interface)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
52
Standards of MPLS Network Managements (1)
1) MPLS Management Overview:
- Related document: Multiprotocol Label Switching (MPLS) Management Overview, draft-ietf-mplsmgmt-overview-08.txt, August 2003.
- Overview of MPLS Network Management and Related MIB
- MPLS MIB의 OID (Object Identifier) tree structure:
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
53
Standards of MPLS Network Managements (2)
2) TC-MIB
- Related document: Definitions of Textual Conventions for Multiprotocol Label
Switching (MPLS) Management, draft-ietf-mpls-tc-mib-05.txt, Nov. 2002.
- Describes textual conventions for use in definitions of management information for
MPLS networks
3) LSR-MIB
- Related document : Multiprotocol Label Switching (MPLS) Label Switching Router
(LSR) Management Information Bases, draft-ietf-mpls-lsr-mib-09.txt, Oct. 2002.
- Describes MOs for modeling MPLS LSR (Label Switch Router) LSR
- interface configuration table (mplsInterfaceConfTable)
- in-segment (mplsInSegmentTable), out-segment (mplsOutSegmentTable) tables
- cross-connect table (mplsXCTable)
- label stack table (mplsLabelStackTable)
- traffic parameter table (mplsTrafficParamTable): index, MaxRate, MinRate,
MaxBurstSize
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
54
Standards of MPLS Network Managements (3)
4) TE-MIB
- Related document : Multiprotocol Label Switching (MPLS) Traffic Engineering
Management Information Base, draft-ietf-mpls-te-mib-09.txt, Nov. 2002.
- ping (ICMP echo request) based hop-by-hop fault localization and path tracing
- in ping mode (basic connectivity check), ping packet is sent through user packet
delivery LSP, the egress LSR delivers the ping packet to control plane
- in traceroute mode (fault isolation), ping packet is sent to the control plane of each
transit LSR node, which performs various checks and returns further information that
helps check the control plane against the data plane
5) LDP-MIB
- Related document : Definitions of Managed Objects for the Multiprotocol Label
Switching (MPLS) Label Distribution Protocol (LDP), draft-ietf-mpls-ldp-mib-09.txt,
Oct. 2002.
- Defines 4 MIBs for Label Distribution Protocol (LDP) establishment and monitoring :
MPLS-LDP-MIB, MPLS-LDP-Generic-MIB, MPLS-LDP-ATM-MIB, MPLS-LDPFrame-Relay-MIB
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
55
Standards of MPLS Network Managements (4)
6) FTN-MIB
- Related document : Multiprotocol Label Switching (MPLS) Forward Equivalency
Class-to-Next Hop Label Forwarding Entry Management Information Base, draft-ietfmpls-ftn-mib-05.txt, Oct. 2002.
- Defines MIBs of the mapping and related operations of MPLS FEC (Forwarding
Equivalence Class) and NHLFE (Next Hop Label Forwarding Entry)
7) Bundle MIB
- Related document : Link Bundling Management Information Bases, draft-ietf-mplsbundle-mib-04.txt, Nov. 2002.
- Defines MIBs for grouping TE Links into a bundled link
8) VPN-MIB
- Related document : MPLS/BGP Virtual Private Network Management Information Base
using SMIv2, draft-ietf-ppvpn-mpls-vpn-mib-05.txt, Nov. 2002.
- Defines the MIB for MPLS/BGP VRF (VPN Routing and Forwarding) based VPN
configuration
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
56
MPLS Network Configuration Management
 MPLS Configuration Management
 Installation support
 support the installation of equipment and related software
 installation operations, sequencing and scheduling the operation to achieve maximum
efficiency and minimum interference with ongoing operations
 Provisioning
 a set of procedures that bring already installed equipment into service
 NE configuration
 Initialization of Network Topology resource and activations
 Network resource reservation and locking/unlocking for service provisioning
 Status and control
 Status request & report of network resource
 Network resource maintenance
 Network Resource Auto-discovery (optional)
 dynamic resource discovery
 automatic configuration & topology mapping
 real-time map generation
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
57
MIBs for Configuration Managements
 MPLS LSR MIB
 mplsInterfaceConfTable, PerfTable
 mplsInSegmentTable, PerfTable
 mplsOutSegmentTable
 mplsXCTable
 mplsLabelStackTable
 mplsTrafficParamTable
 MPLS TE MIB
 mplsTunnelTable, ResourceTable, HopTable, ARHopTable, CHopTable
 mplsTunnelPerfTable, CRLSPResTable
 MPLS TE-Link MIB
 teLinkTable, DescriptorTable,SrlgTable, BandwidthTable
 componentLinkTable, DescriptorTable,SrlgTable, BandwidthTable
 MPLS LDP MIB
 MPLS LDP Generic MIB
 MPLS LDP ATM MIB, FrameRelay MIB
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
58
Example of MPLS Network Configuration MOs (1)
Managed Objects
Node
Attributes
Example
Router Name
7204_G
Router Version
Cisco 7200
IOS version (Cisco Router)
12.2(8)T
Routing Protocol
OSPF, BGP
MPLS Signaling protocol
Fast Ethernet Port
Serial Port
Total number of activated slots/ports
1 Fast Ethernet
4 Serial network interface
1 Packet_over_Sonet (POS) network interface
address
165.229.167.201
status
Port Up, line protocol up
QoS class map
EF, AF1, AF2, AF3, AF4
QoS status
Drop ratio 0 bps, packets marked
address
10.0.70.2
Status
Operational-yes
QoS class map
Class-default
QoS queue
Weighted fair queuing
QoS bandwidth
620 [kbps]
Serial port name
Serial 1/1 (connected with xxx)
Loopback address
10.0.0.7
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
59
Example of MPLS Network Configuration MOs (2)
Managed Objects
PoS port
(Packet over
SONET)
Neighbors
Attributes
Example
address
10.10.2.2
Status
Shutdown
QoS class map
Class-default
QoS queue
Weighted fair queue
QoS bandwidth
55000[kbps]
Serial port name
Pos4/0
Loopback address
10.0.0.6
Neighbor equipment
Router, bridge_switch
Neighbor router name
3620_B
Neighbor router serial port name /
address
Serial 0/0 (3620_B port) / 10.0.30.1
Neighbor loopback address (TDP id)
10.0.0.2 (3620_B의 loopback address)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
60
MPLS Connection Managements
 MPLS Tunnel LSP (TE-LSP) Connection Managements
 MPLS Tunnel LSP Establishments and Maintenance
 Constraint-based Shortest Path First (CSPF) routing for Constraint-based LSP
Setup
 Request MPLS LER/LSR to set up LSP: Automatic routing mode or explicit
routing mode
 Set up LSP traffic parameter and QoS parameter
 Update of Traffic parameter and QoS parameter of MPLS Tunnel LSP
 Modification of traffic parameter and QoS parameter of tunnel LSP
 Establishment of backup LSP for MPLS Fault Management
 SRLG-disjoint backup path routing
 Establishment of working LSP for backup LSP: explicit routing mode
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
61
Connection Management for
DiffServ-over/aware-MPLS on Optical Internet
NMS
Configuration
Mgmt
Connection
Mgmt
Performance
Mgmt
Fault
Mgmt
Performance
Mgmt
Fault
Mgmt
IIOP
EMS
Configuration
Mgmt
Connection
Mgmt
IIOP
DiffServawareLER
LSR
OXC
fiber link
traffic trunk
(tunnel LSP)
fiber link
OXC
fiber link
fiber link
optical path
(lambda channels)
OXC
OXC
fiber link
LSR
DiffServawareLER
fiber link
LSR
DiffServawareLER
OXC
fiber link
DiffServawareLER
fiber link
fiber link
DiffServawareLER
fiber link
OXC
fiber link
WDM Optical Domain Network
MPLS Domain network
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
DiffServawareLER
LSR
DiffServawareLER
DiffServawareLER
62
Example of MPLS LSP MOs (1)
MO
Attribute
Example
Tunnel name
Tunnel_0104_1
Source address
10.0.0.2
Destination address
10.0.0.4
Next addresses (explicit route)
10.0.30.2, 10.0.40.1
Traffic param - priority
Setup priority 1
Holding priority 1
Traffic param – bandwidth
9 [kbps]
Traffic param – MTU
1514 bytes
Traffic param - delay
500,000 usec (default) – modifiable
Affinity
0x0 ~ 0xFFFFFFFF
Auto-bandwidth (optional)
Freq, Min [kbps], Max [kbps]
LSP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
63
Example of MPLS LSP MOs (2)
MO
Attribute
Example
LSR ID (Transmitter)
Link/Port ID
Interface address
LSR and Port
Link State
Neighbor LSR ID (Receiver)
Link type
Fast Ethernet, Serial Port, POS
Administration status
Active
Operational status
Operational-yes
Total capacity
Link total capacity in [Mbps]
Available bandwidth
Available bandwidth in [Mbps]
Reserved bandwidth
Allocated bandwidth in [Mbps]
Propagation & processing delay
Propagation delay according to the physical distance,
and packet processing delay including MPLS packet
switching, port buffering at LSR
Jitter
Jitter at LSR with MPLS packet switching
Residual bit error rate
Bit error rate at Physical link
SRLG_ID
Shared risk link group ID
Physical backup type
Protection functions provided at Physical Layer
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
64
Parameters for Constraint-based LSP Establishment
MO
Traffic
Parameter
QoS Parameter
Service
Category
Attribute
Example
Bandwidth
Peak data rate(PDR)/Peak Burst Size (PBS)
Committed Data Rate(CDR)/Committed Burst Size (CBS),
Excess Burst Size (EBS)
End-to-end delay
End-to-end delay
Jitter bound
Allowable jitter boundary
Packet loss ratio
Allowable packet loss ratio
Service class
Platinum, gold, silver, bronze
Priority
Setup priority, holding priority
Weight
Weight for Weighted Fair Scheduler
Backup_type
1+1, 1:1, M:N, 1:N, on-demand
SRLG
SRLG-disjoint backup LSP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
65
MPLS Network Performance Management
 Performance monitoring of MPLS Tunnel LSP
 Measurement of Throughput at End-to-End LSP and Boundary of Autonomous System (AS)
 Measurement of delay, jitter at End-to-End LSP and Boundary of Autonomous System (AS)
 Measurement of packet loss at End-to-End LSP and Boundary of Autonomous System (AS)
 Performance analysis of MPLS Tunnel LSP
 Compare and analyze LSP’s SLA (service level agreement) performance parameters and the
monitored results
 Determine any seriously deteriorated performance
 performance control & tuning of MPLS Tunnel LSP
 Update/Reallocation of operational Parameters (Bandwidth, Link Utilization) to maintain the
performance of End-to-end LSP and LSP segments of Autonomous System (AS) : Adjustment of
allocated bandwidth, Queue buffer size or scheduler parameter
 Rerouting of LSP route
 Overall Network Load Balancing
 MPLS VPN Performance Management
 Measurements of Aggregated Throughput, Packet Transfer Delay, Packet Loss Rate at MPLS VPN
Interfaces (CE-PE, PE-PE)
 Measurements of Packet Mis-delivery Ratio among MPLS VPN
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
66
MPLS Network Fault Management (1)
 Establishment of Backup LSP for MPLS working tunnel LSP
 SRLG disjoint back LSP routing and LSP setup
 Allocation of Backup LSP resource for 1+1, 1:1, M:N, 1:N mode
 Fault Detection and Notification
 Fault detection ad notification at Physical Layer Link, port or Node
 Fault detection ad notification by MPLS signaling and packet forwarding module
 Notification of Seriously deteriorated MPLS LSP Performance
 Analysis and Localization of Faults
 Fault correlation and localization
 Find Root Cause of the Faults
 Find the location of root cause
 Determine the Affected tunnel LSP and VPN
 Fault Recovery
 Fault Recovery by Protection switching or restoration
 Protection Switching of User Traffic using Backup LSP
 Establish a new back LSP
 Redefine the function and the route of working LSP and backup LSP at Fault restoration
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
67
MPLS Fault Management (2)
 Differentiated Backup Path Reservations (Example)
MPLS Service
Class
Bandwidth
Reservation
Setup
Priority
Preemption
Priority
Application
Platinum
100%, 1+1
Highest
Highest
High Priority VPN
Gold
100%, 1:1
Higher
Higher
VPN
Silver
100%, M:N
Normal
Normal
Premium service
Bronze
100%, 1:N
Lower
Lower
Controlled traffic
Best effort
0
Lowest
Lowest
Best Effort
 Backup Path Utilization
 Reservation with NO Traffic
 Reservation with Lower Priority Traffic of possible preemption
 Fault Restoration
 Use Span(segment) Protection
 Restoration is based on the Subnetwork(Segment)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
68
Example of Seriously Deteriorated Performance
Traffic / QoS parameter
Available bandwidth
End-to-end delay
Jitter
Packet loss
Threshold of severe degradation
Remarks
Less than 80% of CDR (committed data rate)
More than 120% of agreed end-to-end delay limit
More than 200% of agreed jitter limit
More than 10% of transmitted data
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
69
Fault Detection Functions of LSR Node
Module
MPLS Switching
Module
Port/Link
Node failure
Fault Type
Fault Detection (Example)
Faults in Switching Elements
Faults in packet/ label processing
MPLS signaling module (CR-LDP,
RSVP)의 hello message
Packet mis-delivery
Loss of Light
Fiber cut
Lambda channel fault
Network Interface Card (NIC) fault
monitoring
Power degradation
Switching capability loss
Malfunctioning components
Excessive temperature
MPLS signaling module hello
message
Degraded packet throughput,
increased packet loss rate
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
70
MPLS Fault Recovery Objectives (Example)
Function
Fault Recovery Parameter
Target Values
Fault Detection at Physical Layer
Fault Detection at LSP
Fault Detection at LSR
Physical Layer: 50 ns
MPLS LSP: 150 ms
MPLS LSR: 3 sec
Fault Notification
Fault notification to ingress LER / egress LER
50 ms
Protection Switching
to Backup LSP
Protection Switching of user traffic from faulty
working LSP to Backup LSP
50 ms
Fault Detection
Total Fault
Restoration
Time
Total allowable time from fault occurrence to
complete fault restoration
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
250 ms
71
Standards related to MPLS Fault Management
 IETF Draft MPLS-based fast reroute
 IETF Draft MPLS recovery framework
 IETF Draft MPLS RSVP-LSP Fast reroute
 MPLS OAM Requirements
 RFC 2925, Remote Ping, Trace Route, Lookup
 RFC 3479, Fault Tolerance for the LSP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
72
MPLS OAM for the Management of
MPLS-based VPNs
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
73
MPLS OAM
 OAM (Operation, Administration, Maintenance)
 Layer Management Protocol for Network Layer, Data Link Layer, Physical
Layer: e.g. ATM VP/VC Layer OAM, Physical Layer OAM, SONET OAM
 Fault OAM for fault monitoring, fault notification




alarm indication signal
remote defect indication (RDI)
continuity check (CC)
loopback test
 Performance OAM for performance monitoring, performance analysis
 Forward monitoring
 Backward monitoring
 Configuration OAM for administrative configuration of links, operational
status monitoring
 link configuration and status management
 neighbor discovery
 e.g Layer Management Protocol (LMP) of WDM Optical Link
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
74
Related Works on MPLS OAM
 Current Standardization Status of MPLS OAM
 General framework
 Major considerations
 No detailed implementation methods
 IETF Internet Draft, “A Framework for MPLS User Plane OAM,” David
Allen (ed.), February 2003.
 Implications for fault management: connectivity verification, etc.
 Implications for performance management: line quality monitoring, etc.
 IETF Internet Draft, “OAM Requirements for MPLS Networks,” Thomas
Nadeau et. al., February 2003.




service level agreement (SLA) measurement: availability, latency, packet loss, jitter
alarm suppression and layer coordination
support for OAM interworking for fault notification
error detection and recovery
 IETF Internet Draft, “Detecting Data Plane Liveness in RSVP-TE”, Oct. 2001.
 LSP Ping
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
75
Requirements of MPLS OAM Functions
 Basic Requirements of MPLS OAM functions
 Fault management OAM should be able to provide fault detection, ondemand verification, fault localization, notification of LSP failure
information
 Performance management OAM should be able to provide performance
monitoring to check the provisioning of traffic throughput & QoS (end-toend delay, jitter, packet loss rate) that is defined in service level agreement
 Interactions of MPLS signaling and User-plane OAM
 User plane OAM: based on in-band OAM packets to monitor real status of
user plane connections
 MPLS signaling: out-of-band signaling, separated connections from the user
plane connections
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
76
Design of MPLS Performance Management
OAM Functions
 Performance Monitoring OAM of User Plane Data Path
 Throughput
 total delivered data size / unit time interval
 Delay
 d(n) = Tarrival(n) – Tdeparture(n)
 Jitter (variance of transfer delay)
 j(n) = |d(n) – d(n-1)|
 Packet loss rate
 (total transmitted packets – total delivered packets) / total transmitted packets
 Severely degraded performance
 e.g. excessive delay at realtime interactive communication, excessive
packet loss, excessive jitter
 should be handled in the same manner of fault
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
77
Proposed Format of Performance Monitoring OAM
Packet
1
2
3
0
01234567890123456789012345678901
OAM Type
OAM Function
PDU Length
Ingress LSR Identifier
Egress LSR Identifier
LSP Identifier
Sequence Number
Time Stamp
Number of Total Transmitted Packets
Total Transmitted Data Size [Byte]
Optional Information
(LSR: Label Switched Router; LSP: Label Switched Path)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
78
Design of MPLS Fault Management OAM
Functions
 Fault Detection
 by fault management OAM packet: continuity check
 by lower protocol layer: e.g. loss of light (LOL), loss of signal (LOS)
 Fault Notification by MPLS OAM packet
 Forward Defect Indication (FDI)
 Backward Defect Indication (BDI)
 Egress LER(Label Edge Router) -to-Ingress LER notification
 Fault Notification by MPLS Signaling
 RSVP-TE notify message
 CR-LDP notification message
 Fault notification by intermediate LSR that detected link fault by
network interface card (NIC); Note) in Wavelength Division
Multiplexing (WDM) network, it is very hard to insert OAM packets
by intermediate node
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
79
Scenario of Fault Notification by MPLS signaling
TCP/UDP
IP
MPLS
PHY
LER 110
(ingress node)
PHY
LSR 120
LSR 121
working LSP
backup LSP
TCP/UDP
IP
MPLS
PHY
LSR 220
TE Agent
OSPF-TE/
BGP
CR-LDP
link failure
detection
OSPF-TE/
BGP
CR-LDP
TCP/UDP
IP
MPLS
PHY
LSR 221
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
OSPF-TE/
BGP
CR-LDP
TCP/UDP
IP
MPLS
TE Agent
PHY
TCP/UDP
IP
MPLS
link failure
notification
TE Agent
TE agent
controls
the rerouting
OSPF-TE/
BGP
CR-LDP
TE Agent
OSPF-TE/
BGP
CR-LDP
TE Agent
TCP/UDP
IP
MPLS
TE Agent
OSPF-TE/
BGP
CR-LDP
PHY
LER 211
(egress node)
80
Loopback Test OAM
LSR120
LSR130
LSR140
LER
110
LER
150
timeout
(a) Node-by-node sequential loop-back test
timeout
(b) Roll-call loop-back test
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
81
Proposed Format of Loopback Test OAM
Packet
1
2
3
0
01234567890123456789012345678901
OAM Type
OAM Function
PDU Length
Loop-back start LSR Identifier
Loop-back end LSR Identifier
LSP Identifier
Loop-back operation mode (sequential or roll-call)
Optional data
Note) Loopback test operation mode:
0: node-by-node sequential loop-back test
1: roll-call loopback test mode
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
82
Implementations and Experiments
Network Simulation Environment:
 NIST (National Institute of Standard and Technology)
GMPLS Simulator (GLASS: Gmpls Lightpath Agile
Switching Simulator): http://dns.antd.nist.gov/glass/
 Networking Simulator for Generalized Multi-Protocol
Label Switching (GMPLS)




DiffServ-over-MPLS
MPLS Networking
WDM Optical Switching
General Internet Applications over TCP/UDP, IP
 Included MPLS OAM functions to monitor, analysis
network operational status
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
83
Network Simulation for
DiffServ-over-MPLS
 Network Configuration
Server
Client
100
150
152
LSR120
LER
150
(WFQ Sched)
154
200
202
LER
111
LSR 121
(Priority Sched)
(WFQ Sched)
LER
210
LSR 220
LER
212
(WFQ Sched)
13.2Mbps
104
LER
110
13.2Mbps
102
101 (EF, 1 Mbps)
103 (AF, 2 Mbps)
105 (BF, 3 mbps)
LSR 221
17.6 Mbps
(WFQ Sched)
LER
151
151 (EF, 1 Mbps)
153 (AF, 2 Mbps)
155 (BF, 3 Mbps)
(WFQ Sched)
LER
211
201 (AF, 4Mbps)
LER
213
203 (AF, 4 Mbps)
Note : the transit link between LSR 220 and LSR 221 has been designed to be bottleneck !!
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
84
Traffic Generation
Src - Dest
Traffic
type
100 – 101
EF
102 – 103
AF
104 – 105
BE
150 - 151
EF
152 – 153
AF
154 – 155
BE
200 – 201
AF
202 - 203
AF
Traffic
Parameters
(LSP) [kbps]
PDR = 1,500
CDR = 1,000
PDR = 3,000
CDR = 2,000
PDR = 4,500
CDR = 3,000
PDR = 1,500
CDR = 1,000
PDR = 3,000
CDR = 2,000
PDR = 4,500
CDR = 3,000
PDR = 6,000
CDR = 4,000
PDR = 6,000
CDR = 4,000
Priority/Weight
(DiffServ)
Packet
Scheduling
(DiffServ)
Traffic Generation
duration
[simulation time in sec]
P=5
Priority
50 ~ 500
P=3
Priority
50 ~ 500
P=1
Priority
50 ~ 500
W=1
WFQ
100 ~ 450
W=2
WFQ
100 ~ 450
W=3
WFQ
100 ~ 450
W=4
WFQ
100 ~ 400
W=4
WFQ
200 ~ 350
(EF: Expedited Forwarding, AF: Assured Forwarding, BE: Best Effort Forwarding)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
85
Bandwidth Monitoring of DiffServ Traffic
DiffServ Traffic Monitoring (Node160, WFQ scheduling)
7000000
6000000
6000000
sum(WFQ)
time (sec)
(a) Priority Scheduling
535
476
417
526
468
410
352
294
236
0
178
0
120
1000000
62
1000000
358
2000000
299
sum(PRI)
2000000
Node150
3000000
240
Node100
3000000
Node152
181
Node102
Node154
4000000
122
4000000
5000000
63
Node104
4
5000000
bandwidth (bps)
7000000
4
bandwidth (bps)
DiffServ Traffic Monitoring (Node 110, Priority Scheduling)
time (sec)
(b) WFQ scheduling
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
86
End-to-end delay, Jitter
DiffServ End-to-End Delay
Node 160 (WFQ Scheduler)
DiffServ End-to-End Delay
Node 110 (Priority Scheduler)
(a) E-to-E Delay, Priority Scheduling
time(sec)
(a) Jitter, Priority Scheduling
10
548
480
412
0
344
540
473
406
339
272
205
138
0
20
276
20
10
Node154(Rat
io)
Node152(Rat
io)
Node150(Rat
io)
30
208
30
40
140
40
50
72
Node104(Rat
io)
Node102(Rat
io)
Node100(Rat
io)
4
60
50
DiffServ Packet Loss Ratio
Node 160 (WFQ Scheduler)
Packet Loss Ratio(%)
70
71
524
(b) E-to-E Delay, WFQ scheduling
DiffServ Packet Loss Ratio
Node 110 (Priority Scheduler)
4
459
time(sec)
time(sec)
Packet Loss Ratio(%)
394
4
524
459
394
329
264
199
69
134
4
0
329
0.2
264
0.4
Node154
Node152
Node150
199
Node104
Node102
Node100
0.6
1.8
1.6
1.4
1.2
1
0.8
0.6
0.4
0.2
0
134
0.8
delay(sec)
delay(sec)
1
69
1.2
time(sec)
(b) Jitter, WFQ scheduling
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
87
Notifications on Severe Performance
Degradation
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
88
Link Failure Detection and Notification
 Simulation scenario
LSR120
LSR130
LSR140
LER
110
LER
150
Physical link error at 250 sec
 Failure detection by NIC, Continuity check OAM
(a) Failure Detection by NIC
(b) Failure Detection by Continuity Check
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
89
Loop-back Test
5ms
10ms
15ms
15ms
10ms
15ms
Link Error at 250sec
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
90
MPLS-VPN Performance Management
Intranet
Management
(EMS/NMS)
SPN(Backbone)
Management
(EMS/NMS)
Intranet
Management
(EMS/NMS)
PE
PE
CE
CE
Tunneled LSP
CE
LSR
Penultimate
Hop LSR
PE
VLAN/Ethernet
Penultimate
Hop LSR
SPN’s MPLS Backbone
PE
CE
VC(Virtual Circuit) LSP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
91
MPLS-VPN PM Examples
Customer A
Customer B
Customer C
(a) Throughput
Customer A
Customer B
Customer C
(b) Delay
Customer A
Customer B
Customer C
Customer A
Customer B
Customer C
(c) Jitter
(d) Packet Loss Ratio
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
92
Test Network Configuration for
Controlled Bandwidth Borrowing
Bottleneck
link
LER A
LSP 1
LSR X
20M
LER B
LSR Y
10M
LSP 3
20M
20M
LSP 7
20M
20M
LER C
LSP 5
LER D
LSP between A and B (4 Mbps)
LSP between A and D (4 Mbps)
LSP between C and B (4 Mbps)
LSP between C and D (2 Mbps)
LSR-LSR : 20Mbps
LSR-LSR : 10 Mbps
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
Host-LSR : 5 Mbps
93
Dynamic Bandwidth Re-distribution
 Scenario
 Trigger bandwidth redistribution after 170sec
 Trigger bandwidth rollback at 400sec
 Bandwidth is not allocated to LSP 1,5 because of bottleneck link
 However, LSP 3,7 are allowed to get extra-bandwidth.
(a) Throughput of LSP1, 3
(a) Throughput of LSP5,7
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
94
Commercial MPLS-VPN Management
Systems: Cisco VPN Solution, SheerBOS,
Wandl’s IP/MPLSview
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
95
Cisco VPN Solution (1)
 Cisco VPN Solution Center Architecture API and Life-cycle
Management
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
96
Cisco VPN Solution Center (2)
 Cisco VPN Solution Center 2.2: MPLS Solution (1)
 provides management of IP VPN services throughout the service life cycle
including service provisioning and activation on customer-edge and
provider-edge routers, service auditing and service-level agreement (SLA)
 provides external operations support systems (OSSs) access to the full
capabilities of the Cisco VPN Solution Center using well-defined CORBA
APIs
 Operators and upstream systems can add, delete, or modify customer MPLS
VPNs and define associated VPN service topology (hub-and-spoke, fullmesh and extranet)
 Major functions:
 Fault – Cisco Info Center
 Configuration – Cisco Provisioning Center
 Performance – Concord Network Health Monitor
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
97
Cisco VPN Solution Center (3)
 Cisco VPN Solution Center 2.2: MPLS Solution (2)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
98
Cisco VPN Solution Center (4)
 Key features of Cisco VPN Solution Center
 Realtime provisioning
 flexibly service activation
 high-performance service auditing
 service quality assurance
 SLA monitoring and reporting
 QoS provisioning and measurement for service differentiation
 Templates for streamlined provisioning
 Application integration and flow-through provisioning
 OSS interface – CORBA APIs, TIBCO event bus, Java and XML
 fault management
 performance and other extended management functionality
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
99
SheerTMBOS (1)
 SheerTM Broadband Operating Supervisor (SheerTMBOS)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
100
SheerTMBOS (2)
 SheerTMBOS Solutions for Network Services
 DSL over ATM
 ATM over Optical
 IP
 IP over ATM
 IP Services over Optical
 L2TP and MPLS VPN over Optical core over ATM
 L2TP and MPLS IPVPN
 VLAN
 VLAN and MPLS/L2TP/IP
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
101
SheerTMBOS (3)
 SheerTMBOS Supported NEs
Manufacturer
Alcatel
Cisco
Copper Mountain
ECL
Lucent
Network Element (NE)
36170(Newbridge) ATM Switch, ASAM DSLAM, MiniRam DSLAM
6400 SSG, UBR 7200 CMTS, 7x00 Router, GSR 1200 Router, Catalyst,
Tdsoft Hunt8200 Router, BPX ATM Switch, 6100 DSLAM, 6160 DSLAM
CE150 DSLAM, CE200 DSLAM
HiFocus DSLAM
CBX500 ATM Switch, GX550 ATM Switch
Marconi
200 ATM Switch, 1000/4000 ATM Switch
Motorola
2000 CMTS
Nortel
Shasta SSG, IMAS DSLAM, Passport ATM Switch
Nokia
D50 DSLAM
Redback
SMS 500 SSG, SMS 1800 SSG
Siemens
Unisphere SSG
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
102
SheerTMBOS (4)
 SheerTMBOS Auto Discovery of Topology, Inventory and Services
 Discovery of the network elements and the corresponding layered entities that exist
within them (e.g. interfaces, forwarding components)





Existing modules, ports/interfaces
Existing logical entities
MPLS labels
Contexts/Virtual Routers
Routing Tables, Forwarding Tables, VRF Tables, Label Swapping Tables
 Discovery of the relationships that exist between the entities in each layer




(VC, VP, Ethernet MAC, PPPoA, 1483, 1Q tag) => Port
(IP interface) => (1483R, Ethernet, .1Q, PPPoA, PPPoE)
(Vbridge) => (Group of Interfaces)
(VRF/Virtual Router) => (Group of Interfaces)
 Discovery of the multi-layer network topology






Physical Topology
ATM (PVC, SVC, SPVC) Topology
Ethernet, VLANs Topology
IP Topology
MPLS Topology
VPN Topology
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
103
SheerTMBOS (5)
 SheerTMBOS – Managing IP-VPN Services over Broadband
Networks
 Network Inventory Auto-discovery
 MPLS IP-VPN logical inventory




P and PE Global Label Forwarding Table
PE Interface Specific Label Forwarding Table
List of VPNs (PE)
VPN Properties (PE)
–
–
–
–
VPN VRF Table
VPN Route Target: Import/Export
VPN Router Distinguisher
VPN Site list & Properties for each VPN Site
 Network Topology Auto-discovery
 Service Activation Operations
 Create/Delete VPN
 Add/Remove Site to VPN
 Required identification parameters: VPN identifiers, connection point, site
subnets (in case of static route is used between CE-to-PE)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
104
Wandl’s IP/MPLSview (1)
 Features of Wandl’s IP/MPLSview
 Hardware Device Models Supported: Cisco, Juniper, Riverstone, Foundry,
and generic router types.
 IP/MPLS-Configuration/Performance Management
 IP/MPLS-Network Planning
 VPN
 BGP
 MPLS-FRR
 Extensive Report Generation - Aids all aspects of planning, designing, and
troubleshooting IP/MPLS Core Backbones.
 Flexible and friendly Graphical User Interface
 Fully web-enabled User Interface
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
105
Wandl’s IP/MPLSview (2)
 IP/MPLS Network Planning with Wandl’s IP/MPLSview
















IP network configuration, LSP tunnel and traffic collection
Delta configuration generation for MPLS TE provisioning
Multi-layer, Multi-protocol modeling according to exact equipment details
LSP tunnel path placement and provisioning
Fast reroute (FRR)
End-to-end path protection
MPLS LSP path generation/network grooming
Multi-period traffic load analysis
Basic design from scratch
Incremental design
Diversity/Resiliency design
Bottleneck analysis
Capacity planning / traffic growth
Multi-layered failure simulation and analysis
What-if simulation
Standard or customizable tariff databased
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
106
Wandl’s IP/MPLSview (3)
 IP/MPLS Configuration and Performance Management














Network centric operation of the MPLS traffic network
Automated data collection – automatic discovery and incremental discovery
Automatic discovery of network topology
Web-accessible event browser tracks changes in network status
Intelligent multi-vendor IP/MPLS parsing
Physical and logical topology views
Dynamic reconfiguration of MPLS tunnels
Near real-time network monitoring: resource utilization, global network topology and
traffic information display, interface/tunnel statistics, data collection via SNMP
Network performance management and diagnostics
History reports and historical traffic data replay
Configuration and version control and archiving
Configuration conformance validation
Network inventory reports from SNMP polling
Integrity checking
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
107
Wandl’s IP/MPLSview (3)
 Additional Features
 Border Gateway Protocol (BGP) model
 Differentiated Services
 VPN Model
 State-of-Art Network Graphics
 Fully Web-enabled User Interface
 Wep reports
 Extensive report generations
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
108
Experiences in the Design and
Implementation of Management System for
DiffServ-aware-MPLS
 DoumiMan (DiffServ-over-universal mpls
internet Manager)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
109
Layered Network Management in DoumiMan (DiffServover-universal mpls internet Manager)
IPNetwork
IP Subnetwork
& VPN
Network
PMHandler
ForPort
FaultManagerHandler
IPSubnetwork
PMHandler
ForLSP
IPRouter
IPMPLSRouter
IPConnectivity
DiffServELSP
MPLS
Layer
Network
MPLSNetwork
MPLSLSR
TELSP
MPLSLSP
1
0..*
Router
PhysicalNetwork
Physical
Layer
Network
PhysicalNode
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
Port
Link
110
O-O Design & Implementation for Extensibility
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
111
Auto-discovery of Physical Topology Information
through Telnet CLI (Command Line Interface)
Pivot router
NMS
① show ip vrf
7204_H
7204_F
② no VRF related information
③ show cdp entry*,
show cdp neighbors,
show tag-switching tdp discovery
④ Information about Neighbors
⑤ show ip vrf
⑥ Information of VRF table
⑦ show ip route vrf vrf-name
show ip protocols vrf vrf-name
⑧ Detailed information of VRF table
(IP routing table on VRF,
routing protocol on VRF)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
112
Configuration Management GUI
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
113
DiffServ-aware-ELSP Connection Management
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
114
DiffServ-aware-ELSP Performance Management
Service type
NCT : Guaranteed BW
DiffServ 적용 구간
Best- effort : No QoS
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
115
MPLS Fault Managements with NMS
NMS/EMS
CE
(Customer Edge)
Establish
Backup LSP
(Rerouting)
CE
(Customer Edge)
Fault
Notification
(notification)
AS: 300
AS: 200
Link Failure
CE
(Customer Edge)
PE
(Provider Edge)
PE
(Provider Edge)
AS: 500
Service Provider
Backbone (AS: 100)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
CE
(Customer Edge)
AS: 400
116
Example of Fast Reroute in Cisco Routers
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
117
VPN GUIs
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
118
DiffServ-aware-MPLS VPN GUIs
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
119
Concluding Remarks
 We discussed
 Framework of MPLS-based VPNs: L3VPN, L2VPN, VPLS
 Traffic Engineering based on DiffServ-aware-(G)MPLS
 Management Framework of MPLS Network, MPLS MIBs
 MPLS OAM for the Management of MPLS-based VPNs
 Commercial MPLS-VPN Management Systems: Cisco VPN Solution,
SheerBOS, Wandl’s IP/MPLSview
 Experiences in the Management of DiffServ-aware-MPLS VPN
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
120
References
[1] RFC 2764, A Framework for IP based Virtual Private Networks, February 2000.
[2] IETF Internet Draft, draft-ietf-l3vpn-rfc2547bis-00.txt, BGP/MPLS IP VPNs, May 2003.
[3] IETF Internet Draft, draft-ietf-l3vpn-framework-00.txt, A Framework for Layer 3 Provider Provisioned
Virtual Private Networks (PPVPNs), March 2003.
[4] IETF Internet Draft, draft-ietf-l3vpn-vpn-vr-00.txt, Network based IP VPN Architecture using Virtual
Routers, May 2003.
[5] IETF Internet Draft, draft-ietf-l2vpn-l2-framework-00.txt, L2VPN Framework, Feb. 2003.
[6] IETF Internet Draft, draft-ietf-l2vpn-requirements-00.txt, Service Requirements for Layer 2 Provider
Provisioned Virtual Private Networks, Jan. 2004.
[7] IETF Internet Draft, draft-ietf-l2vpn-vpls-requirements-00.txt, Requirements for Virtual Private LAN
Service (VPLS), Oct. 2002.
[8] IETF Draft, draft-lasserre-vkompella-ppvpn-vpls-02.txt, Virtual Private LAN Services over MPLS, June
2002.
[9] RFC 3272, Overview and Principles of Internet Traffic Engineering, May 2002.
[10] RFC 3564, Requirements for Support of Differentiated Services-aware MPLS Traffic Engineering, July
2003.
[11] IETF Internet Draft, draft-ietf-mpls-mgmt-overview-08.txt, Multiprotocol Label Switching (MPLS)
Management Overview, August 2003.
[12] IETF Internet Draft, draft-ietf-mpls-te-mib-12.txt , Multiprotocol Label Switching (MPLS) Traffic
Engineering Management Information Base, August 2003.
[13] IETF Internet Draft, draft-ietf-mpls-tc-mib-09.txt, Definitions of Textual Conventions for Multiprotocol
Label Switching (MPLS) Management, August 2003.
[14] IETF Internet Draft, draft-ietf-mpls-oam-requirements-01.txt, OAM Requirements for MPLS Networks,
June 2003.
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
121
[15] ITU-T Rec. Y.1710, Requirements for MPLS OAM.
[16] ITU-T Rec. Y.1711, OAM Mechanisms for MPLS Network.
[17] ITU-T Rec. Y.1720, Protection Switching for MPLS Networks.
[18] ITU-T Draft Rec. Y.mplsperf, MPLS Performance.
[19] IETF RFC3289, Differentiated Services MIB module
[20] IETF draft-ietf-snmpconf-diffpolicy-07.txt, Differentiated Services Configuration MIB.
[21] IETF RFC 3512, Configuring Networks and Devices With SNMP.
[22] IETF RFC 3410, "Introduction and Applicability Statements for Internet- Standard Management
Framework ",
[23] IETF RFC 3289 Management Information Base for the Differentiated Services Architecture", , May 2002.
[24] IETF RFC3411, "An Architecture for Describing Simple Network Management Protocol (SNMP)
Management Frameworks", Harrington, D., Presuhn, R. and B. Wijnen, December 2002.
[25] IETF draft-ietf-snmpconf-pm-13.txt, "Policy-based Management MIB", Work in Progress, Waldbusser, S.,
J. Saperia, and T. Hongal, March 2003.
[26] IETF draft-ietf-psamp-framework-03.txt, A Framework for Passive Packet Measurement, June 2003.
[27] IETF draft-ietf-psamp-sample-tech-02.txt, Sampling and Filtering Techniques for IP Packet Selection,
June 2003.
[28] Tanja Zseby, “Deployment of Sampling Methods for SLA Validation with Non-Intrusive Measurements,”
Proceedings of Passive and Active Measurement Workshop (PAM 2002), Fort Collins, CO, USA, March
25-26, 2002.
[29] IETF draft-ietf-psamp-mib-00.txt, Definitions of Managed Objects for Packet Sampling,
[30] IETF draft-ietf-mpls-telink-mib-02.txt, Traffic Engineering Link Management Information Base, May
2003.
[31] IETF RFC 3209, RSVP-TE: Extensions to RSVP for LSP Tunnels, December 2001.
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
122
[32] IETF RFC 3469, Framework for Multi-Protocol Label Switching (MPLS)-based Recovery, February
2003.
[33] IETF draft-ietf-mpls-rsvp-lsp-fastreroute-03.txt, Fast Reroute Extensions to RSVP-TE for LSP Tunnels,
[34] IETF draft-ietf-mpls-lsp-ping-03.txt, Detecting MPLS Data Plane Failures.
[35] IETF draft-ietf-mpls-fastreroute-mib-01.txt, Multiprotocol Label Switching (MPLS) Traffic Engineering
Management Information Base for Fast Reroute, November 2002.
[36] IETF RFC 3479, Fault Tolerance for the Label Distribution Protocol (LDP), February 2003.
[37] IETF RFC 2702, Requirements for Traffic Engineering Over MPLS, September 1999.
[38] IETF draft-ietf-mpls-oam-requirements-01.txt, OAM Requirements for MPLS Networks, June 2003.
[39] IETF RFC draft-ietf-mpls-bgp-mpls-restart-02.txt, Graceful Restart Mechanism for BGP with MPLS,
October 2002.
[40] IETF draft-ietf-policy-qos-device-info-model-10.txt, Information Model for Describing Network Device
QoS Datapath Mechanisms, May 2003.
[41] IETF draft-ietf-policy-core-schema-16.txt, Policy Core LDAP Schema, October 2002.
[42] IETF RFC 3060, Policy Core Information Model -- Version 1 Specification,
[43] IETC RFC 3198, Terminology for Policy-Based Management, November 2001.
[44] IETF RFC 3460, Policy Core Information Model (PCIM) Extensions, January 2003.
[45] IETF draft-ietf-netconf-prot-00, NETCONF Configuration Protocol, August 11, 2003.
[46] IETF RFC 2925, Definitions of Managed Objects for Remote Ping, Traceroute, and Lookup Operations,
September 2000.
[47] IETF draft-ietf-disman-alarm-mib-14.txt, Alarm MIB, June 2003.
[48] IETF draft-ietf-disman-event-mib-v2-02.txt, Event MIB, June 2003.
[49] IETF draft-ietf-rmonmib-raqmon-framework-02.txt , Real-time Application Quality of Service
Monitoring (RAQMON) Framework, June 2003.
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
123
[50] IETF draft-ietf-rmonmib-raqmon-pdu-02.txt, Real-time Application Quality of Service Monitoring
(RAQMON) Protocol Data Unit (PDU), June 2003.
[51] IETF draft-ietf-rmonmib-raqmon-mib-01.txt, Real-time Application Quality of Service Monitoring
(RAQMON) MIB, June 2003.
[52] IETF draft, Application Performance Measurement MIB draft-ietf-rmonmib-apm-mib-10.txt, August 6,
2003.
[53] IETF draft-ietf-rmonmib-tpm-mib-09.txt, Transport Performance Metrics MIB, June 26, 2003.
[54] IETF draft-ietf-rmonmib-sspm-mib-07.txt, Definition of Managed Objects for Synthetic Sources for
Performance Monitoring Algorithms, June 2003.
[55] Thomas D. Naeau, MPLS Network Management – MIBs, Tools and Techniques, Morgan Kaufmann
Publishing Co., 2003.
[56] NIST GMPLS Simulator – A Scalable Discrete Event Simulator for the GMPLS-based Next Generation
Optical Internet, http://dns.antd.nist.gov/glass/.
[57] MPLS Forum Super Demo 2002 – Test Plan & Results.
[58] Petri Aukia et al., “RATES: A Server for MPLS Traffic Engineering,” IEEE Network Magazine, Mar./Apr.
2000.
[59] Wandal IP/MPLSView, http://www.wandl.com/html/mplsview/MPLSview_new.cfm.
[60] Differentiated Services – Network Configuration and Management (DISCMAN), EURESCOM, 2000.
[61] Sheer Broadband Operating Supervisor (BOS), Sheer Networks,
http://www.sheernetworks.com/solutions/overview.shtml.
[62] TS Choi, SH Yoon, HS Chung, CH Kim, JS Park, BJ Lee, TS Jeong, “Wise<TE>: Traffic Engineering
Server for a Large-scale MPLS-based IP Networks,” NOMS2002, April 2002.pp. 251 ~ 264.
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
124
[63] Cisco MPLS Tunnel Builder Pro,
http://www.cisco.com/en/US/products/sw/netmgtsw/ps4731/prod_technical_reference09186a0080107b3
a.html.
[64] Cisco VPN Solution Center 2.2, http://www.cisco.com/en/US/products/sw/netmgtsw/ps2327/.
[65] Youngtak Kim, “DoumiMan (DiffServ-over-universal-MPLS Internet Manager) for Guaranteed QoS
Provisioning in Next Generation Internet,” ITRC Forum 2003, June 4, 2003.
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
125
Thank You !!!
Youngtak Kim, Ph.D., Associate Professor
Dept. of Information and Communication Engineering,
College of Engineering, Yeungnam University
(Tel: +82-53-810-2497, Fax: +82-53-814-5713,
E-mail: ytkim@yu.ac.kr)
APNOMS2003 Tutorial, Youngtak Kim, Advanced Networking Technology Lab. (ANT Lab.), YeungNam Univ.
126