Intuition and Data Analysis

The analysis of data is now, and always has been, problematic. We are not machines. Our thinking is affected by intuition and experience, which are not empirical in nature. In business, Six Sigma or not, the ability to see information from both an empirical perspective and from the perspective of human stake holders (not empirical), is critical to quality decision making.

Let me give you an example of a non-empirical, intuitive/experiential perspective. If you have ever returned to a playground that you knew when you were young, you may have remembered the sliding board being really high, but now it seems small.  It did not shrink. Your perspective changed.  This is a fundamental rule of human thought. We learn through experiment (experience). These learnings change the way we view the world. In other words, the context of our information changes.

This is both good and bad.  We learn not to put our hand on a hot stove, to look both ways before crossing the street and to not insert keys into electrical wall sockets, because of severe negative consequences. This is the result of the power of observation.

This works well on simple systems where results are not ambiguous, and are easy to understand and predict. On systems where there is complexity and results are not easy to predict, you must “peel the onion” with your observations. When evaluating a complex system, intuition must be used very carefully.

Dr. Daryl Bren does a magic trick with his students on their last day of class with him.  The magic trick is really a lesson. He attempts to demonstrate his ability to read a student’s mind by way of giving information about their personal history that he could not otherwise know. He is always successful and his students grapple with what to think about this intriguing skill. Their intuition, based on trust in their professor, compels them to want to believe. Once he has given them enough time, he tells them how he accomplished the feat. Basically he knew who he was going to” read” and collaborated with their family ahead of time, without the student knowing. It is a trick, not magic. He then delivers the punch line, never substitute your intuition for real data.

Another story.  Several years ago I had an employee that told me that he had started a rumor about the possibility of a major management shakeup. Two weeks later he came to my office, excited, saying that he had it on good source that there was going to be a major management shakeup. He even had details (facts?), which his intuition bought into.. I had to remind him that he, in fact, started that rumor two weeks earlier and fell victim to it. Intuition, in the absence of fact, will nearly always lead to incorrect conclusions.

This is not to say that intuition is not important. Intuition is a critical evaluation tool, and just like any other tool, must be used properly. Intuition can indicate that either your perspective or the data is skewed in some way.  Maybe both are skewed.  Intuition will point to what needs a reality check or more information.

This is just another case where balance and perspective play important roles in our lives. In reality, what I am talking about is finding the “why” behind a set of data or “facts”. Successful Six Sigma Projects and quality business decisions depend on it.

Two Dimensional Thinking

 

A two-dimensional thinker sees the world as a polarized place. Who you are and what you believe becomes categorical. It is either one way or the other. These individuals can see facts, but truth eludes them because the facts are generally considered without context.
The problem with two dimensional thinkers is that they skew, or misinterpret, facts in order force them into a two dimensional framework. As a result, they frequently have “the facts”, but do not know, or are misrepresenting, the truth. This is how marketers sell their ideas, products or services. They build context around a set of facts so that the listener’s interpretation is guided to the desired conclusion. As you watch and listen to the world around you, see if you can see this take place.  How much of what you hear is fact and how much is context? Does the context pass the reality test?
Context defines truth by giving facts relevance. Conflict between people is generally the result of two dimensional thinking. This is demonstrated by the win/lose attitude of the conflicting parties. Both sides bend contextual information to fit their argument. Resolution can usually be gained by getting to a win/win attitude, which is based upon the understanding that there is an alternate solution to the conflict that the win/lose mentality cannot see. The alternate solution is typically based upon a more honest contextual framework.
All of this makes two dimensional thinkers less effective in problem resolution, listening and leadership. These areas of human thought require the ability to see things from differing perspectives. The “why” of a situation is just as important as the “What”, and the “why” is generally contextual in nature, not categorical.
Moving beyond two dimensional thinking involves accepting that most words and events in our lives have meanings that are subject to interpretation. We call this perspective.  You have heard the saying, “One man’s trash is another man’s treasure.” The world looks different from different perspectives.
Seeing the world from different perspectives involves tying facts to context that may be separate from your own reality.  One of the best ways to accomplish this is by listening. Stephen Covey stated it nicely by saying we must “seek first to understand, then to be understood.” Understanding is a continuous process, not a categorical one. Try, sometime, to truly listen to someone. Your ears, eyes and mind are open, but your mouth is shut. Allow yourself to evaluate alternate perspectives for the purpose of understanding. This is not about losing your own perspective or replacing it, although that may happen.  It is simply a matter of seeking to see a situation through someone else’s eyes.
Six Sigma, based solely upon statistics, is two dimensional in nature. It tells us the “what” but not the “why”. When contextual information is paired with statistical results, the “why” becomes a part of the dialog. By understanding contextual information, we are able tie causality to defects and improve processes. This way the human element is part of the picture.