Showing posts with label Metrics. Show all posts
Showing posts with label Metrics. Show all posts

Sunday, February 19, 2012

Analytics


If you don't measure it, you can't improve it.” On of the first-order axioms of management, and a mantra of spreadsheet jockeys everywhere.

Benchmarking. Balanced Scorecard. SEO. What do they have in common – they are indirect measures of effectiveness.

For an artist, which is more important – the tack hammer or the paint brush? The paint brush is used to create the masterpiece; the tack hammer is used to stretch the canvas in preparation.

Does canvas stretching contribute directly to the quality or success of the artwork? It is true that a taut canvas permits the artist to be more precise in creating fine detail than does a loose canvas – so there is some value added by proper stretching. Would knowing that the short side of a canvas has an average of five tacks and the long side has eight, add anything to masterpiece or its value?

As a result of a promotion, I received twice each month a senior management detailed analytic report which was a quarter inch thick. I eagerly read the entire first copy and discovered only two items in it were useful to me and both were incorrect. Later, I instructed the report compilers to stop publishing it and not notify any recipients. After two months without any comment about the absence of this report, I canceled it.

The chart below was presented with an interpretation that our website needed CPR, when viewed against the comparator site. Our website has visitors from a restricted group who read the page about the meeting and then go to another page to register, triggered by a monthly announcement of the coming meeting. The other site is an eCommerce site for internet sales and traffic is driven to it continuously by numerous sources.

The results merely show that sites with different purposes do not generate the same traffic pattern or flow.

Analytics help us measure performance and other factors by direct, indirect, and comparative means. Comparative analytics view statistics from your organization with those of other organizations, or compare your statistics over time.

Metrics and analytics can be useful to set a baseline or measure progress – as long as they are chosen appropriately and recognized for the value they offer.

The artist's production tool is the paint brush and that is the focal point for creativity which produces the value as perceived by the buyer.

The report recipients get information elsewhere or go without as they manage their functional areas, because the content does not provide benefit.

The page views of a different website does little to improve planning or delivery unless the site functions are virtually identical.

When all is said and done, analytics are like observing the wake of a boat underway – they provide some feedback about how smooth the course has been, but say nothing about the progress toward the goal or destination. Planning and execution get us there.

As leaders we must use our resources effectively to achieve results – focus them on doing rather than curating.

What are your thoughts?

Monday, January 9, 2012

Metrics, Analytics, And Common Sense


A tenet of Leadership is if you don't measure you won't change.

There's plenty of software and tools available to measure just about anything and provide statistics as well.

Some items can be counted – like responses to a survey questions. Other items can be measured by the responses – click-through sales. Sometimes an indirect approach is required – effect of a sales campaign by measuring gross sales before, during , and after the campaign.

There are some situations which are not quantifiable and effectiveness must be inferred – like the effect of print advertisements on sales.

A key to useful metrics and analytics is identifying what you want to learn and how best to measure it - by direct or relative measurement.

Trends are direct measurement candidates – here's my baseline of x-units over y-timeframe ...the measure is the change in volume of units for each time block.

Effectiveness can be measured on a relative basis – here's the volume and outcome of the target compared to the volume and outcome of other comparator producers or the norms of the group – like traffic on a website related to on-line orders.

Since the computer can be tasked with the slicing and dicing unlimited amounts of data, we can get hundreds of statistics from even simple measurements. When we had to pay for to compile data, the amount of statistics, ratios and comparative information requested was more focused than than a click of a key availability of today – a practical limitation of time and cost.

We can be overrun by statistics and the analytics to interpret them. The time investment now is in the use of the output. And we can be mislead by results from indirect and relative measurements if the comparator group is not appropriate to the target.

For example, traffic on a website can be mistakenly shown as aggressively above the norm or horribly behind it, if a static information site and a promoted sales-based site are compared. Apples and oranges.

Keep metrics and analytics simple to get meaningful results which can translate into changes that affect revenue.

I have run an organization using about eight key indicators available on a real-time basis. The system had capabilities of generating over 200 elements of real data and ratios – the other 192 were of no value to me – so I did not request them.

Best story about meaningful analytics was a comment from Dick Davies after we had attended a meet & greet event – he said he had spoken with 35 individuals. I asked how he knew – he said 'I counted' (resource sheets at the beginning of the event minus sheets at the end). Simple. Effective. Practical.

What are the best (and most effective) metrics and analytics you have seen?