|
|
This chapter focuses on common symptoms associated with poor performance in internetworks, possible causes of those symptoms, and general suggestions for identifying, isolating, and resolving problem causes. The symptom modules in this chapter pertain to performance-related problems for the various protocols and technologies addressed in this publication.
Performance symptoms discussed in this chapter include the following:
Symptom: Connectivity to AppleTalk services over an internetwork is unpredictable and generally slow. Table 15-1 outlines possible causes and suggested actions when service availability is unpredictable and performance is slow on an AppleTalk internetwork.
Symptom: Users complain of slow host response and dropped connections. Bridging traffic itself might not be heavy, but links also might be routing other protocols. Measurable symptoms include input and output drops, increasing 5-minute input/output rates, and unusually high increases in collision counts. Table 15-2 outlines possible causes and suggested actions when bridging performance is poor over WAN links.
| Possible Causes | Suggested Actions |
|---|---|
| Overutilized serial line bandwidth | Step 1 Use the show interfaces EXEC command to determine whether output drops are occurring; check the output for high values in the 5-minute input and output packet rate fields.
If any output drops are found, bandwidth is probably insufficient. If the input and output rates indicate values close to the media maximum throughput for the line, the line is saturated. Step 2 Use bridging filters to reduce traffic. Step 3 If local-area transport (LAT) is being bridged and the problem persists, try LAT compression. Step 4 Increase bandwidth or add parallel lines (combined with the bridge-group group circuit number interface configuration command) to increase available bandwidth. |
| Excessive traffic on LAN | Step 1 Use the show interfaces EXEC command to determine whether output drops are occurring; check the 5-minute input and output packet rate for unusually high values; see if the collision counter is incrementing at a high rate.
If any output drops are found, bandwidth is probably insufficient. Collisions and unusually high 5-minute input and output rates also indicate that the media is saturated. Step 2 Segment the network using internetworking devices (either routers or bridges, depending on your network and the situation). Step 3 Implement bridging filters to prevent unnecessary traffic from flooding local segments. |
| Unstable media, or network device has hardware problem | Step 1 Use the show interfaces EXEC command to determine whether interface resets are occurring or whether transition counters are incrementing.
Step 2 Check the physical connections of all suspect devices; check modems for proper attachment and functionality; check for noisy lines; check appliques and other router or bridge hardware. Refer to the media and hardware troubleshooting discussions in the "Troubleshooting Router Startup Problems" and the "Troubleshooting Serial Line Problems" chapters. Step 3 Remove and replace defective network interface cards or other devices. |
Symptom: Users complain of slow host response and dropped connections. Table 15-3 outlines possible causes and suggested actions when DECnet performance is poor over serial lines or LAN.
| Possible Causes | Suggested Actions |
|---|---|
| Overutilized bandwidth | Step 1 Use the show interfaces EXEC command to determine whether input and output queues are full.
Step 2 Use the show decnet traffic EXEC command to determine whether packets are being received and forwarded. If the number of received packets is greater than the number of forwarded packets and if the queues are full, congestion is probably the problem. Step 3 To reduce traffic overhead, increase hello timer or update timers to the same value on all routers in the network. Step 4 Implement the priority queuing and buffer changes described in the section "Slow Host or Network Response over a WAN or Serial Link" later in this chapter. |
| Network device has hardware problem and is sending out large amounts of incorrect data over LAN | Step 1 Use a LAN traffic monitor to collect information about the amount and type of data transferred from and received by each node in the network for a period of time.
Step 2 Compare data from all systems. Step 3 Use a network analyzer (or perform a binary search) to isolate the problem nodes that are generating excessive data. Step 4 Remove and replace defective network interface cards or devices. |
Symptom: Users complain about connection loss at peak traffic periods when trying to connect to resources on the other side of a router configured for remote source-route bridging (RSRB). Table 15-4 outlines a possible cause and suggested actions when performance is slow and connectivity is intermittent over RSRB connections.
Symptom: Users complain about poor performance and slow response in a large ISO Connectionless Network Service (CLNS) network. Table 15-5 lists possible causes and suggested actions when performance is slow over an ISO CLNS network.
Symptom: Users complain that sessions drop at peak traffic periods when they are trying to connect to resources on the other side of a router configured to route Novell Internetwork Packet Exchange (IPX). Table 15-6 outlines possible causes and suggested actions when a Novell server performs poorly over a router in a Novell IPX LAN internetwork.
Symptom: Users complain about sessions dropping at peak traffic periods when trying to connect to resources on the other side of a router configured to route Novell IPX over a WAN or serial link. Table 15-7 outlines a possible cause and suggested actions when a Novell server performs poorly over a router in a Novell IPX WAN internetwork.
| Possible Cause | Suggested Actions |
|---|---|
| Other protocol dominates CPU time | Step 1 Use the show processes EXEC command to look for large numbers appearing in the Runtime (ms) and Invoked fields for certain protocols. A protocol that has a value that is 10 times or greater than the value indicated for Novell traffic is a likely suspect.
When this kind of condition exists, Novell traffic is not getting adequate access to the CPU, and performance is affected. Step 2 Use the show interfaces EXEC command to look for a high level of output drops. Step 3 If you see output drops, and another protocol is dominating CPU time (indicated in the show processes Runtime (ms) field), use priority queuing to force the router to give priority to Novell traffic. More information about priority queuing is provided in the "Troubleshooting Serial Line Problems" chapter. Step 4 If priority queuing does not improve performance, add bandwidth by implementing a higher-speed line or by adding additional lines of the same speed. If you add additional lines, use the ipx maximum-paths global configuration command to specify the number of paths. |
Symptom: TCP/IP internetwork performance is slow, with poor host response, spotty connection service, and generally slow file transfers. Packets might be dropped. Table 15-8 outlines possible causes and suggested actions when performance is slow in a TCP/IP internetwork.
| Possible Causes | Suggested Actions |
|---|---|
| Bad network link, which results in dropped or lost packets | Step 1 Issue the ping command along entire length of the path to determine where packets are being dropped.
Step 2 Perform serial debugging or other media debugging. For media and hardware diagnostic information, refer to the "Troubleshooting Router Startup Problems" chapter. For more specific information about serial debugging, refer to the "Troubleshooting Serial Line Problems" chapter. Step 3 Replace hardware or add bandwidth as necessary. |
| Access list applied to one link, but not another (when there are multiple paths to a destination) | Step 1 Refer to the section "Slow TCP/IP Performance Despite Multiple Paths" later in this chapter. |
| Congested link | Step 1 Determine whether the link is indeed congested. For media and hardware diagnostic information, refer to the "Troubleshooting Router Startup Problems" chapter. For more specific information about serial debugging, refer to the "Troubleshooting Serial Line Problems" chapter.
Step 2 Apply priority queuing if feasible. Step 3 If you cannot implement priority queuing or if priority queuing does not help, add bandwidth or additional routers. |
Symptom: Despite multiple paths from one network to another and apparently sufficient bandwidth, performance over the links is poor, and traffic does not appear to be getting through some of the links. Although this can be considered a connectivity problem, it manifests itself as a performance issue. Table 15-9 outlines possible causes and suggested actions when TCP/IP performance is slow despite multiple paths.
| Possible Causes | Suggested Actions |
|---|---|
| Misconfigured access lists where multiple paths and one or more access lists block access to one or more routes | Step 1 Use the ping and trace EXEC commands to determine where traffic is stopping. This procedure works best when standard access lists are used.
Step 2 If ping or trace packets are stopped along the way, check the specific router for access lists. Step 3 If an access list is found, disable the list and monitor traffic through the router, using the ping and trace EXEC commands. Step 4 If ping and trace packets get through after removing the access list, you might need to add explicit permit statements to the access list to allow the blocked traffic type. If extended access lists are specified, ping and trace packets might get through, even though intended traffic is not getting through. Step 5 If ping packets get through, attach a network analyzer along the path where problems occur to see where the dropped packet type was last seen. The next node is the most likely suspect. Step 6 Remove any access list, use the protocol being blocked, and monitor traffic through the router. |
| Bad interface or media hardware | Step 1 For media and hardware diagnostic information, refer to the "Troubleshooting Router Startup Problems" chapter. For more information about serial debugging, refer to the "Troubleshooting Serial Line Problems" chapter.
Step 2 Perform serial debugging or other media debugging. Step 3 Replace hardware or add bandwidth as necessary. |
| Load balancing problem (see Figure 15-1, following this table) | Step 1 Use the show interfaces and show ip traffic EXEC commands and ping out to the destination to determine where traffic is being dropped.
Step 2 At the point of congestion, relieve traffic problems by adding a router in parallel or by increasing the bandwidth of the link. Step 3 If you cannot add a router or bandwidth, try adjusting the hop count on the congested router. This is done using the offset-list router configuration command to add a hop to a route received from a particular router. Step 4 Use the distance router configuration command to set the administrative distance for a particularly slow route. |
Figure 15-1 illustrates a situation where two routes might be equivalent in terms of hop count from Host-D to Far-Net, but due to the level of traffic (associated with Router-B and the Data Center), the route through Router-A is administratively preferred. In this case, both routes look equally good to Host-D, so without any configuration modifications, Host-D can use either Router-A or Router-B to communicate with Far-Net. However, as outlined in the load balancing problem discussion in
Table 15-9, several options are available to force traffic from Host-D (intended for Far-Net) to go through Router-A.

Symptom: As with similar loss of connection problems, users complain about very slow host and network responsiveness at peak traffic periods over a WAN or serial link.
Obtain the following information when troubleshooting load-related connection problems:
Table 15-10 outlines possible causes and suggested actions when host or network response is slow over a WAN or serial link.
| Possible Causes | Suggested Actions |
|---|---|
| Noisy serial line | Step 1 Use the show interfaces serial EXEC command to determine whether input errors are increasing.
Step 2 If input errors appear and are increasing, diagnose the serial line as described in the "Troubleshooting Serial Line Problems" chapter. |
| Overutilized bandwidth | Step 1 Use the show interfaces serial EXEC command to determine whether input errors are increasing.
Step 2 If input errors do not appear, the problem is related to congestion. Step 3 Turn off fast switching on the affected interface. Step 4 Check the applications that are being run, especially for very large file transfers scheduled at particular times of day. Step 5 If large transfers occur, set up priority queuing. (Priority queuing requires that the protocol allow flow control.) Step 6 Rearrange the timing of file transfers so that links are not overused during normal business hours. Step 7 Add bandwidth and consider using dial backup over the new link for applications that are taking excessive bandwidth on existing links. Step 8 Adjust buffer size. For details, see the section "Adjusting Buffers to Ease Overutilized Serial Links," in the "Troubleshooting Serial Line Problems" chapter. |
| Hardware in the serial link is unreliable | Step 1 Use a serial analyzer to troubleshoot the serial line or perform the tests described in the sections "Using Extended ping Tests to Troubleshoot Serial Lines" and "CSU and DSU Loopback Tests" in the "Troubleshooting Serial Line Problems" chapter.
Step 2 Replace hardware as necessary. |
| Carrier is automatically rerouting T1 trunk lines | Step 1 Contact the long-line carrier service to determine whether rerouting is occurring.
Step 2 Ensure that the carrier provides a dedicated circuit if automatic switching is causing performance problems. |
Symptom: Users complain about dropped connections and the inability to make host connections at peak traffic periods. One example of this problem is in an environment that features bridged DEC LAT traffic and multiple routed protocols. Data entry input (or other application requests) from users might be getting buffered at the end of an already long input queue and eventually one end of the connection times out. Table 15-11 outlines possible causes and suggested actions when connections are dropped over a serial or WAN interconnection.
| Possible Cause | Suggested Actions |
|---|---|
| Noisy serial line | Step 1 Use the show interfaces serial EXEC command to determine whether input errors are increasing.
Step 2 If input errors appear and are increasing, diagnose the serial line as described in the "Troubleshooting Serial Line Problems" chapter. |
| Overutilized bandwidth | Step 1 If input errors do not appear, the problem is related to congestion.
Step 2 Turn off fast switching on the affected interface. Step 3 Check the applications being run, especially for very large file transfers scheduled at particular times of day. Step 4 If you find large, scheduled file transfers, set up priority queuing. (Priority queuing requires that the protocol allow flow control.) Step 5 When bridging LAT, consider using the bridge-group group lat-compression interface configuration command to reduce bandwidth by implementing LAT compression. Step 6 Rearrange the timing of file transfers so that links are not overused during normal business hours. Step 7 Add bandwidth and consider using dial backup over the new link for applications that are taking excessive bandwidth on existing links. Step 8 Adjust buffer size. For details, see "Adjusting Buffers to Ease Overutilized Serial Links," in the "Troubleshooting Serial Line Problems" chapter. |
| Hardware in the serial link is unreliable | Step 1 Use a serial analyzer to troubleshoot the serial line or perform the tests described in the sections "Using Extended ping Tests to Troubleshoot Serial Lines" and "CSU and DSU Loopback Tests" in the "Troubleshooting Serial Line Problems" chapter.
Step 2 Replace hardware as necessary. |
| Inadequate bandwidth | Step 1 After checking all of the above, examine the output of the show interfaces serial EXEC command.
If, after these actions, load is still about 80 percent, the line is inadequate for traffic requirements. Step 2 Add another serial line. |
Symptom: Users complain about sessions dropping at peak traffic periods when trying to connect to resources on the other side of a router configured to route XNS. Table 15-12 outlines possible causes and suggested actions when XNS server performance is poor over a router in a LAN internetwork.
Symptom: Users complain that sessions drop at peak traffic periods when they are trying to connect to resources on the other side of a router that is configured to route XNS over a WAN or serial link. Table 15-13 outlines a possible cause and suggested actions when an XNS server performs poorly over a router in a WAN internetwork.
| Possible Cause | Suggested Actions |
|---|---|
| Another protocol dominates CPU time | Step 1 Use the show processes EXEC command to look for large numbers in the Runtime (ms) and Invoked fields for certain protocols. An example would be a protocol that has a value that is 10 times or greater than the value indicated for XNS traffic.
When this kind of condition exists, XNS traffic is not getting adequate access to the CPU, and performance is affected. Step 2 Use the show interfaces EXEC command to look for a high level of output drops. Step 3 If you see output drops and another protocol is dominating CPU time (indicated in the show process Runtime [ms] field), use priority queuing to force the system to handle XNS traffic over other protocols. More information about priority queuing is provided in the "Troubleshooting Serial Line Problems" chapter. Step 4 If priority queuing does not improve performance, add bandwidth by implementing a higher-speed line or by adding additional lines of same speed. If you add additional lines, use the xns maximum-paths global configuration command to specify the number of paths |
The overall performance of the network can vary according to the switching mechanism used for a given protocol, interface type, software version, or encapsulation method. Furthermore, the type of switching that is available on a particular platform depends on the version of the installed software and on the individual cards installed in the router.
The following matrices compare protocols and network media types, and define the switching methods available for each combination based on the particular Cisco Internetwork Operating System (Cisco IOS) release you are running.
| Ethernet | Token Ring | Serial | ||
|---|---|---|---|---|
| IP | Fast | Fast | Fast | |
| IPX | Fast | Fast | Fast | |
| DECnet | Fast | Process | Fast | |
| OSI | Fast | Process | Fast | |
| AppleTalk | Fast | Fast | Fast | |
| Bridging | Fast | Fast | Fast | |
| SRB/RSRB | Fast | Fast | Fast | |
| VINES | Fast | Fast | Fast |
| Ethernet | Token Ring | FDDI | Serial | |
|---|---|---|---|---|---|
| IP | Fast | Fast | Fast | Fast | |
| IPX | Fast | Fast | Fast | Fast | |
| DECnet | Fast | Process | Fast | Fast | |
| OSI | Fast | Process | Process | Fast | |
| AppleTalk | Fast | Fast | Process | Fast | |
| Bridging | Fast | Fast | Fast | Fast | |
| SRB/RSRB | Fast | Fast | Fast | Fast | |
| VINES | Fast | Fast | Fast | Fast |
| Ethernet Interface Processor (EIP) | Token Ring Interface Processor (TRIP) | FDDI Interface Processor (FIP) | Fast Serial Interface Processor (FSIP) | HSSI Interface Processor (HIP) | ATM Interface Processor (AIP) | |
|---|---|---|---|---|---|---|---|
| IP | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | |
| IPX | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Fast | |
| DECnet | Fast | Process | Fast | Fast | Fast | Process | |
| OSI | Silicon | Silicon | Silicon | Silicon | Silicon | Process | |
| AppleTalk | Fast | Fast | Fast | Fast | Fast | Process | |
| Bridging | Silicon/ Autonomous | Fast | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Process | |
| SRB/RSRB | Fast | Silicon/ Autonomous | Fast | Fast | Fast | Process | |
| VINES | Fast | Fast | Fast | Fast | Fast | Fast |
| Multiport Ethernet Controller (MEC) | ciscoBus Token Ring Card (CTR) | FDDI Communications Interface Translational (FCIT) | High-Speed Communications Interface (HSCI) | |
|---|---|---|---|---|---|
| IP | Autonomous | Autonomous | Autonomous | Autonomous | |
| IPX | Autonomous | Autonomous | Autonomous | Autonomous | |
| DECnet | Fast | Process | Fast | Fast | |
| OSI | Fast | Fast | Fast | Fast | |
| AppleTalk | Fast | Fast | Fast | Fast | |
| Bridging | Autonomous | Fast | Autonomous | Autonomous | |
| SRB/RSRB | Fast | Autonomous | Fast | Fast | |
| VINES | Fast | Fast | Fast | Fast |
| Ethernet | Token Ring | Serial | |
|---|---|---|---|---|
| IP | Fast | Fast | Fast | |
| IPX | Fast | Fast | Fast | |
| DECnet | Fast | Process | Fast | |
| OSI | Fast | Process | Fast | |
| AppleTalk | Fast | Process | Fast | |
| Bridging | Fast | Fast | Fast | |
| SRB/RSRB | Fast | Fast | Fast | |
| VINES | Fast | Fast | Fast |
| Ethernet | Token Ring | FDDI | Serial | |
|---|---|---|---|---|---|
| IP | Fast | Fast | Fast | Fast | |
| IPX | Fast | Fast | Fast | Fast | |
| DECnet | Fast | Process | Fast | Fast | |
| OSI | Fast | Process | Process | Fast | |
| AppleTalk | Fast | Process | Process | Fast | |
| Bridging | Fast | Fast | Fast | Fast | |
| SRB/RSRB | Fast | Fast | Fast | Fast | |
| VINES | Fast | Fast | Fast | Fast |
| Ethernet Interface Processor (EIP) | Token Ring Interface Processor (TRIP) | FDDI Interface Processor (FIP) | Fast Serial Interface Processor (FSIP) | HSSI Interface Processor (HIP) | ATM Interface Processor (AIP) | |
|---|---|---|---|---|---|---|---|
| IP | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | |
| IPX | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Silicon/ Autonomous | Process | |
| DECnet | Fast | Process | Fast | Fast | Fast | Process | |
| OSI | Silicon | Silicon | Silicon | Silicon | Silicon | Process | |
| AppleTalk | Fast | Fast | Fast | Fast | Fast | Process | |
| Bridging | Silicon/ Autonomous | Fast | Fast | Silicon/ Autonomous | Silicon/ Autonomous | Process | |
| SRB/RSRB | Fast | Silicon/ Autonomous | Fast | Fast | Fast | Process | |
| VINES | Fast | Fast | Fast | Fast | Fast | Process |
|
|