Cisco - Introduction to Capacity & Performance Management 609

609 1042_05F9_c2

1

© 1999, Cisco Systems, Inc.

Introduction to Capacity and Performance Management Session 609

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

2

1

Agenda

• Introductions/Goals • Capacity Planning Model • Capacity Data Collection Tools and Reporting • Best Practices for Capacity Planning • Q&A 609 1042_05F9_c2

3

© 1999, Cisco Systems, Inc.

Network Life-Cycle Model

Solution Deployment

Security Management

Configuration

// ngg nniin nn n n a g a g PPll eessii DD

IIm mp Management plle em me enn ttaa ttiioo nn

Operation Operation

Performance and Capacity Management

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

Fault Management

4

2

Performance Management and Capacity Planning Definitions • Capacity planning The process of determining the likely future network resource requirements to prevent a performance impact on business critical applications

• Performance management The practice of managing network service response time, consistency and quality for individual services and services overall 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

5

Increasing Importance of Capacity Planning • Frequent application deployment failure • Increased reliance on network services for business applications • Exponential growth in business and nonbusiness related traffic • Network Failure is typically capacity related 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

6

3

Capacity Related Risks

• Network degradation and failure • Application timeouts and failure • Application performance degradation

609 1042_05F9_c2

7

© 1999, Cisco Systems, Inc.

Effective Capacity Management Performance Baselining

Gather Configuration and Traffic Observe Statistics Information Collect Capacity Data Analyze Traffic

Implement Changes

Solve Problems Plan Changes Evaluate What-if Analysis

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

8

4

Resource Constraints or Bottlenecks • CPU • Memory • Buffering, queuing and latency • Interface and pipe sizes • Speed and distance • Application characteristics 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

9

Collecting and Reporting Capacity Information

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

10

5

Collecting and Reporting Capacity Information • Development of information collection plan

Gather Configuration and Traffic Information

Observe Observe Statistics Statistics Collect Collect Capacity Capacity Data Data Analyze Analyze Traffic Traffic

• Tools for collecting capacity information • Defining capacity areas • Reporting and interpreting results

609 1042_05F9_c2

Performance Baselining

Implement Changes

Solve Problems Plan Changes Evaluate What-if Analysis

11

© 1999, Cisco Systems, Inc.

Information to Collect • Link utilization • CPU • Memory • Performance (ping response time)

• Frame Relay DE, FECN, BECN, traffic-shaping parameters • NetFlow statistics • RMON

• Queue/buffer drops • Broadcast volume 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

12

6

Link Utilization

609 1042_05F9_c2

Resource

Address

Segment

Avg. Util (%)

Peak Util (%)

JTKR01S2

10.2.6.1

128 Kbps

66.3

97.6

JYKR01S0

10.2.6.2

128 Kbps

66.3

97.8

FMCR18S4/4

10.2.5.1

384 Kbps

51.3

109.7

PACR01S3/1

10.2.5.2

384 Kbps

51.1

98.4

13

© 1999, Cisco Systems, Inc.

CPU Utilization Polling Resource Address

609 1042_05F9_c2

Avg. Util (%)

Peak Util (%)

FSTR01

10.28.142.1

60.4

80

NERT06

10.170.2.1

47

86

NORR01

10.73.200.1

47

99

RTCR01

10.49.136.1

42

98

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

14

7

Performance (Ping Response Time) AvRes T (mS) AvRes T (mS) AvRes T (mS) AvRes T (mS) 09-09-98 09-09-98 09-24-98 10-01-98

Resource

Address

AADR01

10.190.56.1

469.1

852.4

461.1

873.2

ABNR01

10.190.52.1

486.1

869.2

489.5

880.2

APRR01

10.190.54.1

490.7

883.4

485.2

892.5

ASAR01

10.196.170.1

619.6

912.3

613.5

902.2

ASRR01

10.196.178.1

667.7

976.4

655.5

948.6

ASYR01S

503.4

AZWRT01 10.177.32.1 BEJR01

609 1042_05F9_c2

10.195.18.1

460.1 1023.7

444.7 1064.6

1184

1021.9

15

© 1999, Cisco Systems, Inc.

RMON Collection • RMON traps/collectors • RMON router commands rmon event 1 trap MSTrap description "CPU Util>75%" rmon event 2 trap MSTrap description "CPU Util<75%" rmon event 3 trap MSTrap description "CPU Util>90%" rmon event 4 trap MSTrap description "CPU Util<90%" rmon alarm 75 lsystem.56.0 10 absolute rising-threshold 75 1 falling-threshold 75 2 rmon alarm 90 lsystem.56.0 10 absolute rising-threshold 90 3 falling-threshold 90 4

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

16

8

Netsys Service Level Management • Performance baseline • End-to-end traffic baseline with RMON collectors, SNMP and NetFLow statistics • Define service level performance policies • Assess service level policy performance 609 1042_05F9_c2

17

© 1999, Cisco Systems, Inc.

Internet Performance Monitor • WAN troubleshooting Complements CiscoWorks 2000 Measures hop-by-hop response time and availability Evaluates thresholds and generates alarms Web Server, File Server Provides real-time, and or End User historical reports

IPM

Configure Collect M ea Present su re

• Utilizes RTR agent embedded in Cisco IOS ® No extra management hardware required Leverages large installed base of Cisco routers 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

RTR

M

e easur

Cisco Router

18

9

IPM Hop-by-Hop Reports

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

19

IPM—Historical Reports

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

20

10

IPM—Real-Time Reports

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

21

Capacity and Performance Best Practices

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

22

11

What-If Analysis • Simulation applications • Lab application modeling Protocol analyzer, WAN emulator, packet generator, NETSYS performance analyzer

Gather Configuration and Traffic Information

• Lab network modeling NVS/NVT, lab network modeling

609 1042_05F9_c2

Implement Changes

Performance Baselining Observe Statistics Collect Capacity Data Analyze Traffic Solve Problems Plan Changes Evaluate

What-if Analysis

23

© 1999, Cisco Systems, Inc.

Frame Relay Subscription Parameters

Boston 256 Kbps Port Host

Host

New York 512 Kbps Port

New York to Boston PVC 128 Kbps CIR Boston to New York PVC 32 Kbps CIR New York to Dallas 64 Kbps CIR Dallas to New York 32 Kbps CIR New York to Atlanta 96 Kbps CIR Atlanta to New York 32 Kbps CIR 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

Dallas 128 Kbps Port

Atlanta 128 Kbps Port

24

12

Service Level Management • Define performance requirements • Define Upgrade criteria by capacity area • Measure capacity and performance • Review thresholds and baseline • Take action! 609 1042_05F9_c2

25

© 1999, Cisco Systems, Inc.

Service Level Management

609 1042_05F9_c2

Threshold

WAN

LAN

CPU

75-90%

75-90%

Link

80-90%

40-90%

Memory

50%

50%

Output Queue

200

25

Buffer Misses

Any

Any

Broadcast Vol

10/Sec

300/Sec

FECN/BECN

10/Sec

N/A

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

26

13

Peak and Average Utilization • Solution to narrow collection interval • Low collection interval = high overhead (Threshold) • Recommend >=5 minutes

Capacity Parameter

• Peak values not quite what they seem • Close to threshold indicates likely exceed condition 609 1042_05F9_c2

Green Bar Represents SNMP Value Returned

Time in Collection Intervals

© 1999, Cisco Systems, Inc.

27

Capacity Exception Management

• Alarm critical capacity thresholds (CPU, critical link) • Develop notification, escalation and action plan for threshold violations • Take action!

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

28

14

Performance and Capacity Baselining • Interface utilization • Device CPU, memory, buffer, I/O utilization • Network overhead • Raw performance characteristics • Monthly or quarterly baseline report 609 1042_05F9_c2

Gather Configuration and Traffic Information

Performance Performance Baselining Baselining

Observe Statistics Collect Capacity Data Analyze Traffic

Implement Changes

Solve Problems Plan Changes Evaluate What-if Analysis

29

© 1999, Cisco Systems, Inc.

Upgrade Planning

• Understand lead times for circuits, equipment, planning and design • upgrade criteria based on service level management

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

30

15

QoS Management

• Prioritize applications by business impact • Understand networked application behavior (packet size, timeouts, flows, bandwidth requirements) • Develop QoS management plan 609 1042_05F9_c2

31

© 1999, Cisco Systems, Inc.

WAN Subscription Parameters

PBX

PBX 13

1

3

2

1

Carrier Cloud UBR Virtual Path CBR Virtual Circuit UBR Virtual Circuit VBR-RT Virtual Circuit 609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

PBX

32

16

Please Complete Your Evaluation Form Session 609

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

33

609 1042_05F9_c2

© 1999, Cisco Systems, Inc.

34

Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr

17