Precision v. Accuracy: How about using a range?

Precision v. Accuracy: How about using a range?

The precision versus accuracy concept was first brought home to me back in the depths of time while I was doing Physics “A” Level in high school and calculating measurement errors in experiments. From this, I learned that no matter how precise one’s measurements were, there is an inherent error in the tool used to measure the results. Taking into account that lack of precision provided more accurate results, which is what we sought.

When I got involved in finance during my time in business school, the measurement tool was the currency, and so precision was deemed to be the smallest currency unit, i.e., a cent. This precision was encouraged by the beautiful computing power of Lotus 1-2-3 and then Excel, which allowed you to do forecasts that were precise to the cent going out years based on a few assumptions. While the precision was there, accuracy was foregone as we built huge models on a few simplistic assumptions.

However, upon leaving business school and entering the real world, my illusions were quickly dashed. After my first week at work, I presented my boss with a ten-year forecasting model that showed profit and loss statements, balance sheets, cash flow statements, and of course, a discounted cash flow valuation. He looked at it and asked how confident I was in my forecasting. As I defended it, he looked at me and asked in a sort of Bayesian way, “Would you bet your bonus on the company making the revenue numbers you have for this year?” (we were a quarter of the way into the year).

“No!” was my quick reply.

“In that case, how can you defend ten years of numbers which all build off that initial number?” he asked. This has lived with me ever since that we quickly get sucked into the precision of our models, but the numbers are so inaccurate.

During my career, I have to see precise projections for sales, projects, costs being bandied around in companies by everyone, including the CFO. Yet few, if any, would bet a modest amount, let alone their bonuses, on those numbers being the final results. Thus we end up with the corporate situation where everyone knows the numbers are wrong but cannot admit it.

However, when working with these same companies and trying to get them to accept the concept of ranges in forecasts and probability distributions, I am regarded as though I had just stated that the earth was flat and supported by elephants. One CFO of a public company looked at me with total distance and asked: “Why would anyone ever need something like that?”.

When I responded that I was seeking more accuracy, albeit with less precision, in financial projections, it was apparent that had I reverted to speaking Fanagalo. Another CFO used precise numbers (down to the dollar when their revenue was over $20 million). None of their forecasts were ever correct, but he could not accept that forecasting to the million was acceptable. I heard that their last results were a huge surprise given the forecasts; however, I was not surprised at all given the forecasting process.

This trade-off of precision in return for greater accuracy continually is rejected by many of the financial professionals that I meet. I have wondered if the cause of this focus on precision encouraged by the accounting profession makes it hard for these professionals to let it go.

Going back to my boss’ logic – if you would not bet on a single number being accurate, would you be prepared to bet on a range? For example, the forecast may say that next years’ revenue will be $10 million, but no one will bet their bonus on it when pushed. So would you be willing to be that it will be between $9 and $11 million or $8 and $12 million? When you reach a range that you would be willing to bet on, it is surely the range to use in the forecasts.

Using ranges like this and applying techniques like Monte Carlo simulations results in far higher accuracy in forecasts and an understanding of the risk profile of the results, i.e., there is a 50% probability that revenue will be between $9 million and $10 million or that profits will range between $0 and $1 million. Furthermore, one can see what items are critical to the final results, what is not. The company can focus on those essential items rather than getting distracted by the noise.

It is best to remember Nils Bohr’s quote, “Prediction is very difficult, especially if it’s about the future.” Therefore, to make the predictions more useful, it is best to forego precision in return for greater accuracy.

 

© 2013 Marc Borrelli All Rights Reserved

Recent Posts

Boosting Common Sense Decision-Making in Your Organization

Boosting Common Sense Decision-Making in Your Organization

Discover how to enhance decision-making in your organization by focusing on three crucial areas: solving the right problem, gathering all the available information, and understanding the intent. Learn to empower your team, foster a purpose-driven culture, and improve organizational clarity for better decision-making.

Do You Understand Your Costs to Ensure Profitability?

Do You Understand Your Costs to Ensure Profitability?

You can only determine profitability when you know your costs. I’ve discussed before that you should price according to value, not hours. However, you still need to know your costs to understand the minimum pricing and how it is performing. Do you consider each jobs’ profitability when you price new jobs? Do you know what you should be charging to ensure you hit your profit targets? These discussions about a company’s profitability, and what measure drives profit, are critical for your organization.

Sunk Costs Are Just That, Sunk!

Sunk Costs Are Just That, Sunk!

If you were starting your business today, what would you do differently? This thought-provoking question is a valuable exercise, especially when it brings up the idea of “sunk costs” and how they limit us. A sunk cost is a payment or investment that has already been made. Since it is unrecoverable no matter what, a sunk cost shouldn’t be factored into any future decisions. However, we’re all familiar with the sunk cost fallacy: behavior driven by a past expenditure that isn’t recoupable, regardless of future actions.

Do You REALLY Know Your Business Model?

Do You REALLY Know Your Business Model?

Bringing clarity to your organization is a common theme on The Disruption! blog. Defining your business model is a worthwhile exercise for any leadership team. But how do you even begin to bring clarity into your operations? If you’re looking for a place to start, Josh Kaufman’s “Five Parts of Every Business” offers an excellent framework. Kaufman defines five parts of every business model that all flow into the next, breaking it down into Value Creation, Marketing, Sales, Value Delivery, and Finance.

Ideation! Harder Than It Sounds

Ideation! Harder Than It Sounds

Bringing in new ideas, thoughts, understanding, and logic is key as your organization faces the challenges of a changing environment. But when you do an ideation session in your organization… how does it go? For so many organizations, many times, after a few ideas have been thrown out and rejected, the thought process slows down very quickly, and a form of hopelessness takes over. How does your organization have better ideation? I’ve come across a new approach with a few teams lately.

Recruit, Recruit, Recruit!

Recruit, Recruit, Recruit!

An uptick in business has begun this quarter, and companies are rushing to hire to meet this surge in demand. What amazes me is how many are so unprepared to hire. Continual recruiting is key to the survival of a company. It isn’t the same thing as hiring—continuous recruiting is building a pipeline of people that you would hire if you needed to fill a position, or “A players” you would hire if they were available.

We All Need Clarity

We All Need Clarity

If your organization is focused on obscurity over clarity, whether intentionally or not, your “A” player employees are vulnerable. There is a looming talent crunch. As we start to emerge from COVID, demand is increasing, and many are scrambling to fill positions to meet that demand. Headhunters and recruiters are soon going to be calling your key “A” employees. Have you been giving them a reason to stay?

Not Another **** Meeting

Not Another **** Meeting

As Leonard Bernstein put it so well, “To achieve great things, two things are needed: a plan and not quite enough time.” Your meetings can be shorter, more fruitful, and engaging, with better outcomes for the organization, employees, and managers. It’s time to examine your meeting rhythms and how you set meeting agendas. This week, I break down daily, weekly, monthly, quarterly, annual, and individual meeting rhythms, with sample agendas for each.

Is Your Company Scalable?

Is Your Company Scalable?

Let’s start here: Why should your company be scalable at all? If your business is scalable, you have business freedom–freedom with time, money, and options. Many business leaders get stuck in the “owner’s trap”, where you need to do everything yourself. Sound familiar? If you want a scalable business that gives you freedom, you need to be intentional about what you sell, and how.

Are you ready for the Talent Crunch?

Are you ready for the Talent Crunch?

Companies are gearing up to hire. Unfortunately, many are competing within the same talent pool. Some experts are currently predicting a strong economic recovery starting in May or June. But as the economy booms, there is going to be fierce competition for talent. How will you fare in the looming talent crisis? Your organization should be creating a plan, now, so you can attract the talent you need in the year ahead.