The Myths Of Network Utilization
The Interpath Technologies Networking Myths Series™
This artilce is also availabe as a Podcast of "The Sniffer Guy" though iTunes.
Mythology is not fantasy or lies. It describes a basic truth-but as metaphor. If you understand that it is describing a fundamental reality-by telling a story-you know to look for the reality behind the story. If you believe the story-you will chase your tail until you decide to ignore everything. So, when I say that automated testing and metrics like utilization are myths, I mean that they are metaphors-stories that can direct you to the truth. They are not the truth in themselves.
What is the IT person's mission? The mission is to keep a set of instructions (apps) interfacing with humans (users), over an enormously complex environment (enterprise networks and the Internet itself). Many senior and seasoned IT professionals have developed a sense over the years that something isn't quite right. There is too much "hoping" going on and not enough "knowing."
An IT support person is attempting to visualize the transport of discrete units of data flowing across an "Interpath" between all the applicable components--for hundreds of applications and thousands of users. How is that done? Black magic mostly--and a bag of black box tools.
Often these tools are purchased by less technical management and the support personnel receive little training. Even if they do receive training, that training is focused on how to manipulate the console and install the product. Seldom is there much raw technology exchanged. Let's face it, most of the time we don't really know what the tool is doing--only how to run it--yet we take their results as law.
Tools poll and push and query and ask a selection of the components involved to report in about themselves. Then, by algorithms known to only a few people at the vendor's office, (if they are still employed there), the data is SUMMARIZED and presented to you, the IT professional who has received that week of training.
Once you think about the fact that the information is just a summarization--the problem--and mythology--begins to come clear.
Picture a business user sitting at a PC workstation in a remote office of your company. Many times a day--a network transaction that should take 15 seconds--instead takes 90 seconds--maybe longer.
You have an automated tool that "simulates" that transaction every hour. In 24 polls we see the following:
* 4 Samples show 10 seconds (much faster than normal)
* 16 Samples show 15 seconds (expected)
* 4 Samples show 90 seconds (long enough to drive a user crazy.)
* The average is 26.7 seconds.
Would an alarm sound in your monitoring system? With an expectation of 15 seconds--would you be concerned enough to escalate this issue? Sure, it's nearly double what is expected--but there are times that are quite excellent and anyway--it's still not even 30 seconds! Maybe it's not so critical...
It is Critical--to that user experiencing 90 second delays from time to time--or more frequently!
What is your Polling Interval? Hourly? -- Does that include night-time hours? If so, your metrics are already mostly useless (unless you have equal activity at night as during the day).
If it is hourly--and day time only hours--it still means that 4 out of 24 business hour polls are 90 seconds. That does NOT mean 4 times--it means 4 times "POLLED." What about in-between polls? It is happening many more times than the 4--that were able to be seen!
It could be happening more than enough to significantly damage production and good will.
Is the logic in your automated tool really taking this into account? If so, what does it really tell you anyway? It can't say why--and it can't say how. It's a fire alarm that only rings if you pull it at the right time and frequently enough.
That discussion opens the door to wondering about metrics in general.
What does it mean when a tool tells you that your network/segment/WAN is 42% utilized? Does it mean that the wire is only used 42%? No.
If you are measuring a transport medium, that medium is utilized 100%--whenever it is used. If you put an electrical current on a wire-can you use only 42% of that wire? No. It is either hot or cold. On or off.
Does it mean that you only used it 42% of the time? No.
It is getting closer though. To say that it means that the segment is 100% utilized-but only 42% of the time-is ALMOST correct. Time is the key word here. How is it measuring time? Is it always monitoring or is it polling? It is polling--probably.
(Sorry--polling and metrics are always hand-in-hand).
What is your polling interval? Every 10 minutes-every hour-once per day? How long do you monitor between polls? Is it a "continuous" value or is it only checked on every hour? Is it an interval that the manufacturer has never even disclosed or acknowledged?
For the sake of discussion--let's answer these questions.
Imagine we have a tool that monitors a wire for 1 minute every hour. That tool reports that your "Utilization" is 42%.
That means that for the one minute every hour--that your wire is monitored--for that one minute ONLY-- it is 100% utilized. In other words--42% of those polls showed 100% (rather than 0%) utilization-for 1 minute per hour.
Does that mean that it has 58% more room and all is well? No.
So, what do you know about the utilization of your wire that can help you? Not as much as the monitoring tool's manufacturer would like you to think.
Are you attempting to reconcile the results of two different tools? That is extremely difficult--impractical--and possibly ruinous.
How much money are you spending-not only on the tool itself-but on decisions made as a result of that tool's reports? However, this doesn't mean that there is no point to those metrics. They are signpost pointing towards reality--fire alarms. Nevertheless, you should certainly not quote them when reality seems to imply different things. Reality is going to be more accurate that such metrics-every time.
This is the reason for the Interpath Transactional Analysis approach to monitoring and reality based testing.
About the Author
Barry Koplowitz founded
Interpath Technologies Corporation
in 1999. He was an instructor for Network General and NAI traveling around the USA teaching for Sniffer University ® and is a consultant to large enterprise environments in the area of Network & Application Analysis and Troubleshooting. He is the writer and host of
The Sniffer Guy
TGO Review Ironclad General Utility Gloves
General Utility Worker (Passbooks)
Smart Power Anniversary Edition: Climate Change, the Smart Grid, and the Future of Electric Utilities
Few industries in the U.S. are as stuck in the past as our utilities are. In the face of growing challenges from climate change and the need for energy security, a system and a business model that each took more than a century to evolve must now be extensively retooled in the span of a few decades. Despite the need, many of the technologies and institutions needed are still being designed or teste...
The Utility and Importance of Creeds and Confessions: An Introductory Lecture, Delivered at the Opening of the Summer Session of the Theological ... Princeton, July 2, 1824 (Classic Reprint)
The character and situation of one who is preparing for the Sacred Office, are interesting bejond the power of language to express. Such an one, like the Master whom he professes to love and serve, is set for the fall and rising again of many in I srael. In all that he is, and in all that he does, the temporal and eternal welfare, not only of himself, but of thousands may be involved. On every sid...
Youngstown Glove 03-3060-80-XL General Utility Plus Performance Glove XLarge, Black
Working gloves need to be tough and durable, but comfortable to wear and use. Youngstown gloves are made of the highest quality, man made materials to create a glove that is form fit, lightweight, breathable, washable, comfortable and tough. They are designed to be the best working gloves youve ever owned. General Utility Plus: The perfect combination of quality, comfort, durability and wear-abili...
Rothco General Purpose Utility Rope (100-Feet/3/8-Inch, Black)
Rothco's 3/8" general purpose rope is constructed with a 100% polypropylene sleeve and a 100% nylon core. It's a high quality rope that is made in the USA and has a tensile strength of 1200 lbs and a working load of 120 lbs....
Youngstown Glove 05-3080-70-L General Utility Lined with KEVLAR Glove Large, Gray
The world's first cut-resistant high-performance work glove! This is an all-purpose, abrasion-resistant and cut-resistant performance work glove. Lined with 100% Kevlar fiber. Designed for abrasive work where cut resistance is needed. Ideal for construction, industrial, military, arbor, landscape, HVAC, glass, recycling and warehouse applications. Color: Black/Gray, Lining: Kevlar fiber, Machine W...
General Tools & Instruments 415 Utility Tweezers
Curved Pointed End Tweezer, Made With Precision Steel, 6-1/2" Overall Length....
Ironclad General Utility Gloves GUG-04-L, Large
All-purpose performance gloves made of breathable spandex with synthetic leather reinforced palm and fingers. With so many jobs to do in a day, you need a glove that's reliable and comfortable. This high-performance glove is ready for a variety of tasks, including construction, shop work, equipment operation and rigging. Double-stitched synthetic reinforcements on palm, saddle and fingers. Padded ...
DeWalt DPG200 Large General Utility Performance Glove, Large
DEWALT DPG200 General Utility Performance Work Glove, Available Sizes DeWalt DPG-200 General Utility Performance Glove - Large...