Testing Assumptions Can Result in Better Decisions

Testing Assumptions Can Result in Better Decisions

There is an excellent Jewish expression called “bubbie-meise”, which refers to old wives’ tales. Some examples are: It’s bad luck to open an umbrella in the house! You can’t go swimming for one hour after you’ve eaten or you’ll drown! Eat all your food, there are starving children in Europe!  And my favorite, Chicken soup can cure anything!

One does not have to belong to any religion to believe in such things.  We generally tend to accept assumptions, beliefs, or superstitions as valid. Such anecdotes have been passed down for generations. But in the world of business, clinging to faulty data and being too stubborn to accept change cannot be cured buy a bowl of chicken soup, however tasty it may be.  We need to test assumptions to ensure better decisions.

Perceptions and inherent patterns cause us to rely on invalid assumptions.  People tend to be risk adverse, avoid change, and accept the most comfortable alternatives. However, just as we can develop routines to help us through our day, we can also develop routines to reduce the chance our assumptions are wrong.  Risk can never be fully eliminated, but understanding how it can be reduced can help us immensely.  It’s why we check the weather forecast before going outside or use the crosswalk to cross the street.

Analytics alone cannot resolve a conflict; it needs to be supplemented with passion, effort, commitment, and focus. Analytics can be less reliable when the data is wrong, when relationships are invalid, when sampling is inappropriate, and when risk is not considered. For example, the more creativity and uncertainty involved in any given situation, the more intuition and a little luck will be required.

Many economic proposals ignore that the economy is getting even more diverse. In 2023 nearly all the stock market gains are in seven stocks. The comparable returns of stocks and bonds seem to gyrate every day. Inflation, bank results, foreign activities and other factors seem to affect the economy every day. 

"When I let go of what I am, I become what I might be."  - Lao Tzu

Some suggestions to better test assumptions are as follows:

Review and evaluate processes and decisions. For example, it is unreal to me that objective testing regularly outperforms personal evaluations in employees’ personnel decisions. The reason is mostly poor training and bias.

Data needs to constantly updated. The latest census shows some dramatic changes in the makeup of our country, and that diversity needs to be considered when we gather and analyze data. Different regions have significantly varied ethnic as well as economic characteristics. A great amount of data also needs to be adjusted for the impact of the pandemic. For example, comparisons to last year or 2019 can show quite different results because of social changes brought on by the pandemic; there are more stay-at-home workers than ever before.

Facts are frequently more independent that we think. If you flip a coin a certain number of times, the odds will always work their way back to 50-50 regardless of any streak of heads or tails.   Cause and effect are frequently assumed rather than analyzed. Differing and multiple goals (such as short-term and long-term goals) can impact the understanding of cause and effect. Medical symptoms are frequently attributed to certain issues, while other factors may be the real cause.  That’s why it’s important to get a second opinion if something does not sound right to us.

Bias is one of the greatest complications when it comes to accuracy in the analysis of decisions. This includes statistical problems like sampling, measurement, and development of information. I also believe that social bias can be more impactful than statistical bias. This includes our preconceived perceptions and assumptions about factors affecting decisions. Cultural and environmental factors also affect bias. Dress, demographics, weather, location, and culture all affect perceptions in the decision-making process.  It is important to never assume anything based on the past.  I would refer to the Odd Couple episode “My Strife in Court” to illustrate what the word “assume” is made of.

"You know what happens when you assume..."

Risk assumptions and tolerance are critical to effective actions. Predicting results where there are significant and consistent historical data can be fairly simple; however, predicting results for new programs or with little or inconsistent data requires developing educated estimates. Assumptions regarding risk tolerance also need to be considered. For example, you generally need to be more cautious with regards to safety than low investment high reward opportunities like the lottery.  It’s crucial to know where every dollar is going, and where it can reap the greatest benefits.

Have you considered unconscious bias training?

Organizations need to be open to measurement and feedback and understand cultural parameters. Observing, understanding, and sharing financials, operations reports, and sales reports are the first step. A management style such as “walking around” and checking in with employees can be priceless. Balancing short-term and long-term goals, understanding challenges, and tolerance for failure are examples of understanding the cultural environment.

Analytics, tradition and experience are all valuable tools to improve decision making. However, you need to ensure that the assumptions behind those tools are accurate and reliable. In particular, our rapidly changing environment involving issues like Covid requires regular testing and validation. Similarly, creativity and intuition that defy some analyses and are becoming increasingly required. We can help you objectively search alternative causes and solutions. Understanding that there are various solutions to the problems we face out there only helps us improve our business practices.  It does not mean that chicken soup still does not hit the spot.

Dr. Bert Shlensky, President of www.startupconnection.net, offers experience, skills, and a team devoted to developing and executing winning strategies.  Our strategy includes clear steps, and over 150 free articles and templates to facilitate your efforts and guide your process. We’re here to help you get on track and stay there as you move forward. You might start with our quick video: https://www.youtube.com/watch?v=dhZ3LvSmZfw

We welcome comments, suggestions, and questions. You can write us at: bshlensky@startupconnection.net or call at 914-632-6977

Testing Assumptions Can Result in Better Decisions

Testing Assumptions Can Result in Better Decisions

We all know what happens when we assume… And yet, how many of our decisions are based on untested information and assumptions? Have you ever been told to wait an hour after eating before swimming or you’ll drown? Where did this information come from and why do we accept it to be true?

Comic about what happens when you make assumptions.

Bubbe-meise is a Yiddish term used to describe old wives’ tales. Some examples include: It’s bad luck to open an umbrella in the house. Eat all your food—there are starving children in Europe! Chicken soup will cure anything!

In general, we tend to accept beliefs, data, news, teachers etc. as valid. Even putting aside lies, probabilities, bias, incompetence, etc., we accept a lot of bad information, assumptions, and suggestions. Why is this?

We need to question more, check resources, and test assumptions in order to make better decisions.

Cartoon with child telling storyteller:  "This fact-checking site says no cow has ever jumped over the moon."
Frank and Ernest Comic

Perceptions and inherent patterns can also cause inadvertent actions. Recently, social scientists have focused on how we make seemingly obvious decisions. The results show most people tend to be risk adverse, avoid change, and accept the most comfortable alternatives. So, while we can work to change a bad decision at any time, we frequently avoid, delay, or defer change and, thus, draw out a negative situation. For example:

  • Denying the effectiveness of COVID vaccines is just unexplainable. For years, we have accepted seat belts, polio and various other vaccines, not driving while drunk, and many other safety measures. The vaccines are just a similar precaution to save lives.
  • Many economic proposals ignore that the k economy is getting even more evident. The k economy argues that economic recovery is experiencing different rates among the poor and the affluent. Specifically, the poor are experiencing even more problems while working class and the rich especially are experiencing exponential gains. Excluding this information is irresponsible and will only produce inaccurate conclusions.  
  • Discussions about returning to work and school are frequently based on personal opinions and biases. Why can’t we recognize we lack perfect information and rely on and test the knowledge we have?  

The solutions to these issues are not simple or obvious. However, we can pay more attention to alternatives, successful examples, and valid data while focusing less on personal opinions and bias. In particular, we need to include the parameters and process in our deliberations. Other helpful strategies include:

  • Get the politics of the issues out of the discussions. How many poor decisions are made because we think that’s what the boss wants? Or because “that’s the way it’s always done?” Or because we’re afraid to speak up? Or because we refuse to acknowledge that the situation has changed? Drop the ego and make fact-based decisions.
  • Utilize analytics. This is an incredible tool for improving success, developing alternatives, and measuring outcomes. However, analytics can be less reliable when the data is wrong, we assume invalid relationships, sampling is inappropriate, and risk is not considered.
  • Review and evaluate processes and decisions. It is unreal to me that objective testing mostly outperforms personal interviews in staffing decisions. But, the reason is mostly because of poor training and bias.
"Did you fact check this before reposting it?"
(response) "I don't need to.  It agrees with my preconceived view and biases, so it must be true!"
  • Stop using old or incorrect data. We need to check that our sources are correct and up-to-date. The pandemic has significantly affected data and trends using 2020 information. The census shows some dramatic changes in the population—in particular, we need to consider diversity. For example, different regions have significantly different ethnic characteristics.
  • Don’t ignore facts and tradeoffs. Going back to the office has many tradeoffs such as commuting time and communication among employees. We need to understand the issues, develop flexible solutions, and test various alternatives rather than relying on personal preferences of people.
  •  Consider the conditions of a situation. Facts are frequently more independent than we think. If you flip a fair coin, the odds are still 50-50 (regardless of the last few flips because the flips are independent). However, sports analysts have proven that certain conditions, like left-handed batters hitting to right field, are more probable.
"The most misleading assumptions are the ones you don't even know you're making."  - Douglas Adams
  • Don’t assume cause and effect. We frequently jump to conclusions before doing a proper analysis. Differing and multiple goals (such as short-term and long-term) can impact the understanding of cause and effect. Medical symptoms are often incorrectly diagnosed because a correlation was detected, which could be mere coincidence. Too often, an assumption is made and a diagnosis is given before things like environment, heredity, or psychological factors are even taken into consideration.
  • Check your biases. The biggest issue is probably bias, which is most evident in political and economic arguments. Questions like: Why are the poor are poor? What is the impact of IQ? How will the stock market perform? What are the causes of crime? These types of questions all involve a complex analysis of a variety of factors. And yet, everyone seems to chime in with an unchecked, biased opinion.

Bias is one of the greatest complications when it comes to accuracy in the scientific analysis of decisions. This includes statistical problems like sampling, measurement, and development of information. I also believe that social bias can be more impactful than statistical bias—this includes our preconceived perceptions and assumptions about factors affecting decisions. Cultural and environmental factors also affect bias.

Cartoon with Cat telling growling dog:  "Have you considered unconscious bias training?"

Analytics, tradition, and experience are all valuable tools that help improve decision-making. However, we need to ensure that the assumptions behind those tools are accurate and reliable. In particular, our rapidly changing environment (especially in regard to issues like COVID) requires regular testing and validation. Similarly, creativity and intuition that defy some analyses are becoming increasingly necessary. Search alternative causes and solutions, test your assumptions, and always ask yourself: Why do I believe what I believe? How do I know my information is correct?

Dr. Bert Shlensky, President of www.startupconnection.net, offers experience, skills, and a team devoted to developing and executing winning strategies. This combination has been the key to client success. We welcome comments, suggestions, and questions. You can write him at: bshlensky@startupconnection.net  or call at 914-632-6977