If You Could Only Have One Metric
8
“Crafty” analysts will often ask, “If you could only have one metric, what would it beâ€. I have a hard time answering this because I think it’s a dangerous proposition. When you only look at one metric you don’t get a holistic picture of your website. For instance, I’ve heard practitioners say, “Bounce is not importantâ€. By itself, no, it’s not that important because you don’t really know what the metric is telling you. I’ve also heard, “Conversion is the only metric you need to worry about.â€Â Again, not true. If my conversion is up +25% month over month, why? I need more info.
Pairing metrics is crucial to analysis. If you don’t, you’re simply regurgitating a data point to your listener. You cannot glean actionable insights from a single metric. Further, you can cause unwarranted panic if you just speak about a single metric. “Our Average Order Size dropped -20% last week!â€Â “Oh man!†… “Oh my gosh, what does that mean?â€
So now you ask, “Ok, what metrics do you recommend that I pair together?â€Â It can definitely vary depending on what you are trying to determine, but here are some of my more frequently used pairings:
- Traffic, conversion, AOS, and then by segment (new / return; organic / paid, etc) – mostly used when analyzing total site (ecommerce sites)
- Bounce, time on page, traffic and then by marketing source and by browser for top 5 entry pages – bounce segmentation can indicate if a certain traffic source is not being directed to the right page on your site, and as well can tell you if you might have some technical issues with a particular browser
- When measuring a video engagement: traffic to area, video category total starts, video category total completions (and thus an overall completion rate); top viewed videos by starts; top completed videos; videos viewed per visitor. Also depending on your analytics provider you can get more specific such as pauses, average completion percentage (i.e. how many completed 50% of video or 75% of video) etc.
There are tons of metric pairings that help give you deeper insight into your projects. My philosophy is to ponder whether the glass is half empty or half full, if I feel that it’s half empty, I look for other metrics to glean additional insights; if I feel that it’s half full and I’ve already dug deep enough, I stop before I succumb to paralysis by analysis. Again, my key point is using one metric to analyze something is a dumb idea. So don’t do it.



April 12th, 2010 at 11:39 am
I agree that pairing metrics and tracking relative or derivative metrics is the best solution. However, single metrics can serve as a canary for many issues. If you see a sky-rocketing Bounce Rate you should be looking at the site for technical issues, not looking or a pairing. Same thing with a suddenly disappearing top page.
Smart use of single metrics can save you time when you are under a time crunch.
April 15th, 2010 at 9:15 am
Carlos, I agree that single metrics can serve as an alarm and I don’t think that your argument disagrees with my stance. I do think though, that if your bounce rate does sky rocket, you are going to need to figure out why, and one important step may be to segment the bounce by browser. It may be that your site is not optimized for a particular browser and thus all visitors to that page from a particular browser are getting a page that looks crazy (but not rendering an error) and thus they run away scared. If you just look at bounce by itself and decide that the page is bad and change it, you may be doing unnecessary work.
Maybe I should say, that you can’t “just” use single metrics, but they can alert you to dig into your data more intensely.