Precision v. Accuracy: How about using a range?

Precision v. Accuracy: How about using a range?

The precision versus accuracy concept was first brought home to me back in the depths of time while I was doing Physics “A” Level in high school and calculating measurement errors in experiments. From this, I learned that no matter how precise one’s measurements were, there is an inherent error in the tool used to measure the results. Taking into account that lack of precision provided more accurate results, which is what we sought.

When I got involved in finance during my time in business school, the measurement tool was the currency, and so precision was deemed to be the smallest currency unit, i.e., a cent. This precision was encouraged by the beautiful computing power of Lotus 1-2-3 and then Excel, which allowed you to do forecasts that were precise to the cent going out years based on a few assumptions. While the precision was there, accuracy was foregone as we built huge models on a few simplistic assumptions.

However, upon leaving business school and entering the real world, my illusions were quickly dashed. After my first week at work, I presented my boss with a ten-year forecasting model that showed profit and loss statements, balance sheets, cash flow statements, and of course, a discounted cash flow valuation. He looked at it and asked how confident I was in my forecasting. As I defended it, he looked at me and asked in a sort of Bayesian way, “Would you bet your bonus on the company making the revenue numbers you have for this year?” (we were a quarter of the way into the year).

“No!” was my quick reply.

“In that case, how can you defend ten years of numbers which all build off that initial number?” he asked. This has lived with me ever since that we quickly get sucked into the precision of our models, but the numbers are so inaccurate.

During my career, I have to see precise projections for sales, projects, costs being bandied around in companies by everyone, including the CFO. Yet few, if any, would bet a modest amount, let alone their bonuses, on those numbers being the final results. Thus we end up with the corporate situation where everyone knows the numbers are wrong but cannot admit it.

However, when working with these same companies and trying to get them to accept the concept of ranges in forecasts and probability distributions, I am regarded as though I had just stated that the earth was flat and supported by elephants. One CFO of a public company looked at me with total distance and asked: “Why would anyone ever need something like that?”.

When I responded that I was seeking more accuracy, albeit with less precision, in financial projections, it was apparent that had I reverted to speaking Fanagalo. Another CFO used precise numbers (down to the dollar when their revenue was over $20 million). None of their forecasts were ever correct, but he could not accept that forecasting to the million was acceptable. I heard that their last results were a huge surprise given the forecasts; however, I was not surprised at all given the forecasting process.

This trade-off of precision in return for greater accuracy continually is rejected by many of the financial professionals that I meet. I have wondered if the cause of this focus on precision encouraged by the accounting profession makes it hard for these professionals to let it go.

Going back to my boss’ logic – if you would not bet on a single number being accurate, would you be prepared to bet on a range? For example, the forecast may say that next years’ revenue will be $10 million, but no one will bet their bonus on it when pushed. So would you be willing to be that it will be between $9 and $11 million or $8 and $12 million? When you reach a range that you would be willing to bet on, it is surely the range to use in the forecasts.

Using ranges like this and applying techniques like Monte Carlo simulations results in far higher accuracy in forecasts and an understanding of the risk profile of the results, i.e., there is a 50% probability that revenue will be between $9 million and $10 million or that profits will range between $0 and $1 million. Furthermore, one can see what items are critical to the final results, what is not. The company can focus on those essential items rather than getting distracted by the noise.

It is best to remember Nils Bohr’s quote, “Prediction is very difficult, especially if it’s about the future.” Therefore, to make the predictions more useful, it is best to forego precision in return for greater accuracy.

 

© 2013 Marc Borrelli All Rights Reserved

Recent Posts

Do You Truly Know Your Core Customer?

Do You Truly Know Your Core Customer?

Knowing the profit of your core customers is key to building a growth model. Many companies have identified core customers that are generating a sub-optimal profit and so they cannot realize the profits they seek. Identifying the correct core customer allows you to generate profits and often operate in “Blue Ocean.”

The Greatest Own Goal or the Greatest Collapse

The Greatest Own Goal or the Greatest Collapse

The European Super League collapsed within days of launch due to hubris and the founder forgetting the key parts of their business model, value creation, sales, and value delivery. The collapse might bring a high price.

Does Your Financial Model Drive Growth?

Does Your Financial Model Drive Growth?

Working with many companies looking to grow, I am always surprised how many have not built a financial model that drives growth. I have mentioned before a financial model that drives growth? Here I am basing on Jim Collin's Profit/X, which he laid out in Good to...

COVID = Caught Inside

COVID = Caught Inside

As we emerge from COVID, the current employment environment makes me think of a surfing concept: “Being Caught Inside When a Big Set Comes Through.” Basically, the phrase refers to when you paddle like crazy to escape the crash of one wave, only to find that the next wave in the set is even bigger—and you’re exhausted. 2020 was the first wave, leaving us tired and low. But looking forward, there are major challenges looming on the horizon as business picks up in 2021. You are already asking a lot of your employees, who are working flat out and dealing with stress until you are able to hire more. But everyone is looking for employees right now, and hiring and retention for your organization is growing more difficult.

Why is there not MORE common sense

Why is there not MORE common sense

“Why don’t they use common sense?!” You may have said this phrase yourself, or heard it with your managers, when discussing an employee’s actions. However, the frustrated appeal to “common sense” doesn’t actually make any meaningful change in your organization. We all make decisions based on the information we have and the guides we have to use. So if the wrong decisions are being made in your organization, it’s time to examine the tools you give decision-makers.

Do You Understand Your Costs to Ensure Profitability?

Do You Understand Your Costs to Ensure Profitability?

You can only determine profitability when you know your costs. I’ve discussed before that you should price according to value, not hours. However, you still need to know your costs to understand the minimum pricing and how it is performing. Do you consider each jobs’ profitability when you price new jobs? Do you know what you should be charging to ensure you hit your profit targets? These discussions about a company’s profitability, and what measure drives profit, are critical for your organization.

Sunk Costs Are Just That, Sunk!

Sunk Costs Are Just That, Sunk!

If you were starting your business today, what would you do differently? This thought-provoking question is a valuable exercise, especially when it brings up the idea of “sunk costs” and how they limit us. A sunk cost is a payment or investment that has already been made. Since it is unrecoverable no matter what, a sunk cost shouldn’t be factored into any future decisions. However, we’re all familiar with the sunk cost fallacy: behavior driven by a past expenditure that isn’t recoupable, regardless of future actions.

Do You REALLY Know Your Business Model?

Do You REALLY Know Your Business Model?

Bringing clarity to your organization is a common theme on The Disruption! blog. Defining your business model is a worthwhile exercise for any leadership team. But how do you even begin to bring clarity into your operations? If you’re looking for a place to start, Josh Kaufman’s “Five Parts of Every Business” offers an excellent framework. Kaufman defines five parts of every business model that all flow into the next, breaking it down into Value Creation, Marketing, Sales, Value Delivery, and Finance.