1.26.2010

New! Decision Lens 2 Minute Video Overview

Hi All,

Check out our new Decision Lens YouTube channel with a new video briefing on how Decision Lens helps you make better decisions by setting priorities and allocating resources to the highest value projects.

http://www.youtube.com/decisionlens

1.21.2010

eBook: An Introduction to Better Decision Making

Decision making is one of the most important yet least understood activities that any organization has to accomplish. This introduction to decision making shows how the Analytic Hierarchy Process and Decision Lens can guide you so that the decisions you make are based on your objectives and priorities.

2 Minute Overview of Decision Lens -- YouTube Channel

Hi Everybody,

Better decision making is not an easy concept to capture. Take a look at this video on YouTube's newest channel by Decision Lens

http://www.youtube.com/decisionlens

1.07.2010

Decision Lens - Better Decision Making in Clinical Trials

Good coverage of decision making today by Kerri Nelen who writes a blog for Applied Clinical Trials Online (pharma industry):

http://blog.appliedclinicaltrialsonline.com/2010/01/06/the-ipod-of-decision-makers

10.01.2009

A Common Sense Approach to Strategic Planning

by: Kip Knight, President, Knight Vision Marketing

Note: Kip is formerly the VP of Marketing at eBay. Additionally, he spent 10 years in Brand Management at Procter & Gamble, and 12 years with PepsiCo, including serving as CMO at Taco Bell. Currently, Kip is affiliated with Decision Lens, helping companies make better decisions and optimize resource allocations. In this article he shares thoughts developed from his experiences at these great marketing companies.

It's fair to assume strategic planning for most business leaders is similar to planning to go to the dentist (i.e. they know it's important to do it but they are worried how much it's going to hurt). The term "strategic" is a power word often used to intimidate others - that's a real shame. Making sound strategic plans and executing them is something we're all capable of doing if we put the appropriate amount of time and focus towards doing it right.

To begin with, strategy is fundamentally about what you're going to do (and more importantly, what you're not going to do) to build your business. It's all about the choices you and your team are willing to make (and stick with) over time.
A strategic planning process often starts with a Mission Statement. Despite being the recurring topic of Dilbert cartoons, a great Mission Statement can actually help focus your team by answering a fundamental question too many businesses lose sight of: What business are we in and why?

Once you're agreed on your Mission Statement, your strategy work should focus on your business's overall Objective (i.e. how are you going to define success over the next 3 years).

Goals are the means to translate your overall business objective into accountability for everyone on your team. These are the key metrics used to measure success in achieving your overall business objective.

Strategies are the collection of choices your team makes to create a sustainable advantage versus your competition. There are an infinite number of choices you can make...the key to success is that there are very few choices you and your team should be committed to making for the long term. Those choices will determine the success or failure of your business.

Plans are directly linked to your strategies. They spell out what you're going to do over the next 12 months to make your strategies come to life. Too many executives spend a disproportionate amount of time developing strategies and not nearly enough on how they're going to be executed. Give me a brilliant execution of an average strategy any day versus a lousy execution of a brilliant strategy! The rewards of a well crafted strategy brilliantly executed are reflected in outstanding financial results.

A great strategy should be well known by everyone on your team (without having to refer to a thick PowerPoint) as well as your customers (who will see the execution of your strategy on a daily basis).

Another issue you don't need to worry about is changing your strategy very often. I've often compared changing a business strategy with amending the Constitution of the United States - it should only be done after careful thought and deliberation.
The Tide brand at P&G has been using the same advertising strategy for the past 50 years and has maintained category leadership the entire time. Brands that change their strategies frequently aren't going to last very long or be very effective since they end up confusing everyone associated with the business.

When I think of some of the brands I admire, such as Apple, Nike, Prius, Southwest and Whole Foods, a common theme that's apparent is they've made and stuck with key strategic choices over time that's given them a distinct advantage over their competition.

Consider businesses and brands that have failed (such as Pontiac and Buick). How much of their failure was due to the inability to answer such fundamental questions such as:

• How did they define success over a 3-year time frame?
• What were the key metrics used to measure success?
• What strategic choices did they make to create a sustainable advantage over their competition?
• What did they do over a 12-month period to make their plans a reality?

If you and your team can answer these questions clearly and confidently, congratulations: your odds of success for your brand just went way up. If not, I hope these questions will spur you and your team to develop your own answers with your team to build your business.

6.16.2009

Decision Making and Organizational Transformation

True transformation is rarely accomplished through incrementalism alone. It requires specific resources to be allocated to transformative initiatives and the real trade-off is often between how to balance between supporting the base business and investing in change.

Transformation requires more than expending 5% of current employees time on thinking about projects and initiatives to transform an organization. It requires specific people who can fully focus on understanding the benefits, costs, risks and opportunities that transformation can bring, then developing and proposing initiatives into the capital planning process or other budget processes. Then the real tradeoff that executives need to make regards determining which activities are not high priority in the base business so that the resources can be re-allocated to truly game changing initiatives.

What I have personally witnessed in many commercial organizations is that the two most difficult things they deal with in the evolution of their businesses is first to have people coming up with good ideas regarding new products and initiatives then making judicious investment decisions to ensure that they continue to innovate. The most destructive thing to many companies is overinvesting in their cash cow and not sufficiently investing in innovation causing them to grow in spurts, fall off cliffs, change personnel and start the process over again. Capital planning in infrastructure, IT, or other key parts of the business is key to maintaining this balance.

10.08.2008

Nutrisystem and Business Planning (What?) - Good Decisions Can Be Loaded with Bad Decision Potential

So I went onto Nutrisystem 2 weeks ago.  That's the diet plan that you set up where you get your food shipped to you -- breakfast, lunch, dinner.  Dan Marino says it works, so I thought I'd give it a try.


Now I'm not one of those typical 1-800 try me types.  I don't have "thighmaster" or a bowflex.  But this thing grabbed me for a few reasons.  First of all, celebrity sponsorship (yup, I went for it).  I grew up in Pittsburgh when Dan Marino was quarterbacking the Pitt Panthers and have followed his career.  The picture of Dan after he had completed the Nutrisystem plan was pretty convincing as he had always been a beefy kind of guy.

So how do I feel about my decision to go onto Nutrisystem -- good one or bad one?  Well, both. 

The good decision was to go for a healthier lifestyle.  But what this type of planned system also exposes is not only how many bad decisions I had been making, and believe me there were a lot, but it actually put me in a minefield of potential bad decisions.  Hot dog at daughter's friend's birthday party at the bowling alley?  Bad Decision.  Pizza last Sunday night during the Steelers game? Another Bad Decision.  And there are so many available, take your pick.

On this type of system I've moved from a world where on a normal day I was generally happy that I had made a good decisions on a given meal ("I had salad!"), to one where the expected norm has to be the Good Decision and so anything that strays from that is now a Bad Decision.  Nutrisystem is pretty well designed to help you avoid Bad Decisions, and they counsel you that if you do fall into a Bad Decision, get up and keep moving.

And so I've realized that it all comes down to ones priorities.  I have an over-arching long term priority on becoming healthy and losing weight, and if I can keep my eye on that then I'll be good.  Remember the forest rather than the trees.  But we are chemical beings, and over time there will be moments when that high-minded priority set gets supplanted through temptation or perhaps a desire for immediate gratification (heh heh heh).  I know the outcome of this flipping of priorities in the moment, and it results in a Bad Decision.

So now let me extrapolate this a bit to business planning and decision making.  It is important, similar to the diet here, to first focus on a higher set of objectives that you are trying to achieve.  i.e. better health, loss of weight.  revenue growth, less risk.  You then have to prioritize them to develop an understanding of which ones will contribute the most to your desired outcome, and those priorities serve as your guidepost for business planning.  We have entered the fall, and in the air is not only football season but for many of us it is planning season.  An overall "vision" or "mission" may help to guide planning season, but how does that translate into a quality plan that is aligned to the organization's overall priorities?  Have the organization's overall priorities been explicitly defined and put into priority so as you develop your plan you understand what the organization is trying to achieve?  Most often we don't see this.  So each group is left with the temptation of simply securing your resources in the moment through a well placed argument or back-room politicking (grab the hotdog at the birthday party, health aside).

And after a while "planning" doesn't feel so much like planning as it does a beauty contest.   Temptation has won.  Some folks slipped on the high heels coming down the stairs and they are OUT -- didn't get what they wanted.  Others miraculously wound up with more than they should have received.  And there is little logic to back up the plan and the many decisions made.  The organization has fallen to a base level of confrontation and gut-driven selection rather than an alignment to your overall strategy.  Is it any wonder that people hate planning season?

Define the objectives of your organization.  Do it collaboratively to ensure that everyone is on board.  Prioritize them.  Use them as your measuring stick to guide alternative courses of action, or investments in programs or products.  This produces results that work for the organization, keeping it healthy.

By the way, I've lost 8 pounds.  But I feel the claws of the Bad Decisions nipping at my heels daily.   

9.30.2008

What exactly is a "bad decision"?

A decision that doesn't provide the desired outcome. What can lead to this?

  • You didn't consider what the key factors to pay attention to are.
  • You didn't get advice (or you did, but it came from someone with your exact outlook).
  • You had no way to test out it to see how changing things would affect the outcome.
  • You had poor logic.
What are examples of bad decisions? There are all kinds of bad decisions made in different arenas such as politics, business, media, etc. We're going to focus on one topic at a time over the next few months and would appreciate any inputs you might have.

A bad political decision:
Try to foist a bailout on the US taxpayer without explaining to them what they were paying for. That's a bad decision. Clearly, somebody failed on one of the key points above.

A bad business decision:
JP Morgan purchases Washington Mutual (after being forced to purchase Bear Stearns just a few weeks ago). More of a bad thing doesn't all of the sudden make a good thing.

A bad investment decision:
Run out of the stock market and buy Gold. If you've ever read anything about Gold its a terrible long-term investment, and the best time to buy stocks is when they've been hammered.

A good career decision that turned into a bad career decision:
Anybody working in mortgages.

A bad autocratic decision:
Putin invades Georgia. That one's gonna set Russia back 20 years.

A bad blog decision:
Launching a blog on Good Decisions and Bad Decisions? You'll let us know. More to come.


9.05.2008

Decision Making, Feedback, and a Network View

[By Thomas Saaty]

In sports team A beats team B, team B beats team C but team C beats team A. Does team A beat team C or C beat A? An individual prefers apples to oranges and oranges to bananas, but at the store he buys more bananas than apples, does he really prefer apples absolutely to bananas or with some hesitation, and why does he buy so many bananas then? Our logic requires categorical answers of yes or no to these questions.

These examples show that things happen or are preferred with variable intensity and do not have categorical yes or no answers. What must we do to allow for such apparent contradictions to our logical cannons that would allow for circulatory reasoning as in the sports example rather than ban it from our logic? Because such events and preferences occur with varied intensities, we must use numbers to indicate how strong they are and those numbers must provide a faithful representation of what happens in the real world and not simply be examples of garbage in garbage out processing of information.

With numbers we can accumulate intensities and then it would make sense to determine how strongly one thing dominates another with respect to a certain occurrence or property. If it turns out that we can understand the world better with such a representation because it allows for circularity then we need to explore how it can be done and how much of an improvement we get from its outcome in the form of numbers as priorities than we currently get by using our linear yes-no logic to trace the outcome of influences. Meaning implies significance and significance implies priority and our outcomes would be on target to give us meaning for outcomes which may be circular. How can we do it and does it work?

To deal with the complexity of the real world and of the thinking mind, we must know the structure(s) of that complexity. We also need to know how to use judgments that express our understanding and even more, use them to measure the many intangibles side by side with the measurements of tangibles, to determine the importance of the influences that play a significant role in shaping complexity. Many people need to be involved in providing the judgments because often one person does not have the experience and adequate understanding to provide the judgments about all the factors that go into the process.

To develop a structure of the influences that shape complexity we identify the important sources and sinks of influences, whether they are from nature or from people with all the criteria that affect their intensity of occurrence. These structures take the form of a hierarchy with a goal at the top and alternative outcomes at the bottom, or a network with dependence and feedback. The object is to use experienced judgments to determine the priorities of the importance of the influences from which a best outcome or mix of outcomes is derived. It is done by synthesizing the priorities of the influences into a best final outcome, a process that would be extremely difficult to do by using words, language and deductive logic which is linear as relates one idea to one other idea sequentially and has no way to create priorities without operating on numerical judgments.

We have shown through many examples that for a complex problem, like the war in Iraq, logic does not lead to a single unique plausible outcome, nor do measurements of the number of months or years, people, soldiers, dollars, deaths and all other numbers that can be assembled, and finally nor do the opinions of a myriad people working individually or as a group tell us what the best way to solve this difficult problem is. But there is a tried and proven practical way to do it even if we have to involve the opinions of all the 6.8 billion inhabitants of this world and they may or may not use logic or all the known measurements. How?

The Analytic Hierarchy Process (AHP) and its generalization to dependence and feedback, the Analytic Network Process (ANP) provide comprehensive methods and structures for systematically improving our understanding of the gradual and finely organized influences that drive how we evaluate alternatives and make decisions. It overcomes the so called bounded rationality based on the assumption of transitivity by including in its structures and calculations, the sensitivity and depth of feelings associated with understanding and the imagination and awareness needed to address all the concerns. These processes acknowledge the inherent subjectivity in all decision making and make it explicit to the stakeholders through relative quantitative priorities.

The AHP/ANP requires that one not only follow an algorithm to put things together correctly, but even more importantly, a way to creatively construct a structure to base the algorithm on. In addition, unlike any other model in applied mathematics today, the AHP/ANP deals with intangible factors and derives measurements for them by using judgments with the participation of many people who provide the judgments individually. The AHP/ANP can combine these judgments into a single representative judgment for the group and also including the importance of the individuals themselves.

8.30.2008

Decision Making Involves these Concerns

Decision making involves the following concerns:

1. Creating a structure to represent all the factors in a decision and their influences and interactions
2. Generating a set of alternatives and choosing the best one which involves:

  • Measuring intangibles
  • Setting priorities
  • Combining priorities across both tangible and intangible factors
  • Performing sensitivity analysis

3. Allocating resources to projects and alternatives. To do this we need to:

  • Measure performance
  • Optimize the allocation

4. Planning. In planning we

  • Determine the most likely outcome
  • Find policies to attain a desired outcome
  • Incorporate these policies in the structure and again determine the most likely outcome
  • Repeat until the likely outcome converges to the desired outcome

5. Designing systems and ensuring their stability
6. Resolving conflict
7. Performing Benefits, Opportunities, Costs and Risks (BOCR) analysis

Where Judgment is used in Science and in Decision Making

In science, measurements of factors with different ratio scales are combined by means of formulas. The formulas apply within structures and involve variables and their relations. Each scale has a zero as an origin and an arbitrary unit applied uniformly in all measurements on that scale but the meaning of the unit remains elusive and only becomes well understood through much practice. The meaning and use of the outcome of any measurement on a ratio scale must in the end be interpreted according to the judgment of an expert as to how well it meets understanding and experience for the situation in which it is being applied or how well it satisfies laws of nature that are always there. Science derives results using numbers objectively, that is, everyone gets the same numbers, but interprets their significance subjectively, that is, how well they serve individual or group goals and understanding.

In decision making, however, because of the diversity of influences with which it is concerned, and the many decisions that may arise, there are no set laws that characterize in fine detail commonly encountered structures as there are in science. Understanding and familiarity with the situation is needed to structure a problem and judgments are needed to capture importance, preference or likelihood. With the Analytic Hierarchy Process (AHP) these judgments are expressed quantitatively on an absolute scale that denotes dominance of one element over another so that a best outcome can be derived by combining and trading off different factors or attributes. In the end after applying the AHP rules of composition a multidimensional scaling problem is reduced to a one-dimensional scale of priorities that are relative sets of numbers which belong to an absolute scale. So in the AHP significance is interpreted subjectively at the beginning of the process through judgments and priority numbers are derived from them objectively, that is, everyone would derive the same results from those judgments.


Priority scales are similar to probabilities; they are not the same as the ratio scales used in science. Ratio scales are like yardsticks. They have a starting point (a zero) and a unit. Priority scales do not. By the term “relative” we mean a priority scale is specially derived for a situation with its factors and alternatives and it is applicable only to that situation. It is not good for all situations and all time; when the situation changes the priorities may change. The ratios of AHP priorities are meaningful: for example, a priority of .50 is twice a priority of .25. In decision making the priority scales are derived objectively after subjective judgments are made, and they reflect the importance of the influences we considered. The process is the opposite of what we do in science when the subjectivity of interpreting what the final number means comes at the end. Of course there has to be validation of the decision process through many examples that show it works to make it a science based on reason, quantity and mathematics.

Finally, in science measurement is applied uniformly using the arbitrary unit from the very small to the very large. This cannot be done for all elements using judgment in decision making. Judgment can only be applied meaningfully to homogeneous groups of elements and when they are not they must be put into different clusters with a common pivot element from one cluster to the next to make it possible to compare them in each cluster and then combine their measurement according to increasing order of magnitude. In science there is no way to compare the significance of very small numbers with very large numbers in a systematic and meaningful way except by speaking of orders of magnitude. The meaning of the unit does not change from one order of magnitude to another, thus leaving interpretation in science subjective and loose.


In another blog we look forward to bringing the two together: science and mathematics with their Cartesian axes and decision making with its priorities that occur in relative form.

1.28.2008

Surprising Insight? The Nature of Decision Making

[by Dr. Thomas Saaty]

The AHP (Analytic Hierarchy Process) and ANP (Analytic Network Process) methodologies take into consideration all of the factors that are difficult for other methodologies to take into consideration in a sufficiently refined way based on an accurate and valid representation of the intensities of judgments.

How can we learn to consciously deal with influence? We need to accept the following observations:

1) A person is a nervous system equipped with senses, muscle and bone to control the environment; the nervous system develops judgments;

2) The influences as described by judgments and synthesized in the mind are describable by a “hypermatrix” the interactions of whose submatrices are derivable from raising it to powers;

3) Theoretically, people interact by combining certain priorities in their hypermatrices raising the result to powers and then comparing to determine agreement and differences;

4) All things in nature are order seeking in some internally determined sense.

The most pervasive idea that all living things share is that of making choices for action in the face of different kinds of influence. This action is our way of controlling and responding to influences with the kind of influence that we prefer according to our purpose. Sometimes biology and chemistry have a unique choice built-in which may be unfavorable to the circumstances. At other times there is an opportunity to try different choices.

The most important case is when the choices are several and we have to choose one from them that is best according to some criteria. This freedom of choice shows that a human being is an advanced form of existence with an ability to consciously control its survival and destiny. But still we are limited in what we can sense and perceive and thus our choices are conditional by our body form and by our senses and environment in which we live. Next to chemistry, physics and electricity that create form and function, decision-making is the most important function that arises from them to further the future of life. The essence of our survival depends on the quality and kind of decisions we make and how much we factor into them influences that may not be here today, but could occur tomorrow to change their significance.

8.14.2007

Analytic Hierarchy Process Overview

The Analytic Hierarchy Process (AHP) is a problem solving framework. It is a systematic procedure for representing the elements of any problem. It organizes the basic rationality by breaking down a problem into its smaller constituent parts and then calls for only simple pairwise comparison judgments, to develop priorities in each hierarchy.

The AHP provides a comprehensive framework to cope with the intuitive, the rational, and the irrational in us at the same time It is a method we can use to integrate our perceptions and purposes into an overall synthesis. The AHP does not require that judgments be consistent or transitive. The degree of consistency (or inconsistency) of the judgment is revealed at the end of the AHP process.

When dealing with scientists, corporate managers, the academic community, lay people and others in solving problems or planning we have observed repeatedly that people provide subjective judgments based on feelings and intuition rather than on well worked out logical reasoning. Also when they reason together people tend to influence each other s thinking. Individual judgments are altered slightly to accommodate the group's logic and the group's interests. However, people have very short memories and if asked afterwards to support the group judgments, they instinctively go back to their individual judgments.

One also observes that people find it difficult to justify their judgments logically and to explain how strong these judgments are. As a result people make great compromise in their thinking to accommodate ideas and judgments.

Designing an analytic hierarchy - like the structuring of a problem by any other method necessitates substantial knowledge of the system in question. A very strong aspect of the AHP is that the knowledgeable individuals who supply judgments for the pairwise comparisons usually also play a prominent role in specifying the hierarchy.

The Analytic Hierarchy Process: A Brief Description
When people make a decision, probably they would not list all the factors that are essential to this decision and explicitly compare the significance of each. Nevertheless people constantly make comparisons and implicitly indicate preferences among different choices. In making decisions, we have observed repeatedly that people provide subjective judgments based on feelings and intuition, as well as their "logical" understanding.

The Analytic Hierarchy Process (AHP) is a multiobjective, multicriterion decision-making approach which employs a pairwise comparison procedure to arrive at a scale of preferences among sets of alternatives. To apply this technique, it is necessary to break down a complex unstructured problem into its component parts; arraying these parts, or variables, into a hierarchic order; assigning numerical values to subjective judgments on the relative importance of each variable and synthesizing the judgments to determine which variables have the highest priority and should be acted upon to influence the outcome of the situation.

Detailed Explanation and Simple Example

We are all fundamentally decision makers. Everything we do consciously or unconsciously is the result of some decision. The information we gather is to help us understand occurrences in order to develop good judgments to make decisions about these occurrences. Not all information is useful for improving our understanding and judgments. If we only make decisions intuitively, we are inclined to believe that all kinds of information are useful and the larger the quantity the better. But that is not true. There are numerous examples which show that too much information is as bad as little information. Knowing more does not guarantee that we understand better as illustrated by some author’s writing “Expert after expert missed the revolutionary significance of what Darwin had collected. Darwin, who knew less, somehow understood more.” To make a decision we need to know the problem, the need and purpose of the decision, the criteria of the decision, their sub-criteria, stakeholders and groups affected and the alternative actions to take. We then try to determine the best alternative, or in the case of resource allocation we need priorities for the alternatives to allocate their appropriate share of the resources.

Decision making, for which we gather most of our information, has become a mathematical science today (Figuera et al.2005). It formalizes the thinking we use so that what we have to do to make better decisions is transparent in all its aspects. We need to have some fundamental understanding of this most valuable process that nature endowed us with to make it possible for us to make choices that help us survive. Decision making involves many criteria and sub-criteria used to rank the alternatives of a decision. Not only does one need to create priorities for the alternatives with respect to the criteria or sub-criteria in terms of which they need to be evaluated, but also for the criteria in terms of a higher goal, or if they depend on the alternatives, then in terms of the alternatives themselves. The criteria may be intangible and have no measurements to serve as a guide to rank the alternatives and creating priorities for the criteria themselves in order to weight the priorities of the alternatives and add over all the criteria to obtain the desired overall ranks of the alternatives is a challenging task. How? We will cover some of the essentials of multi-criteria decision making here.

The measurement of intangible factors in decisions has for a long time defied human understanding. Number and measurement are the core of mathematics and mathematics is essential to science. So far mathematics has assumed that all things can be assigned numbers from minus infinity to plus infinity in some way and all mathematical modeling of reality has been described in this way by using axes and geometry. Naturally all this is predicated on the assumption that one has the essential factors and all these factors are measurable. But there are many more important factors that we do not know how to measure than there are ones that we have measurements for. Knowing how to measure such factors could conceivably lead to new and important theories that rely on many more factors for their explanations. After all, in an interdependent universe everything depends on everything else. Is this just a platitude or is there some truth behind it? If we knew how to measure intangibles, much wider room would be open to interpret everything in terms of many more factors than we have been able to do so far scientifically. One thing is clear, numerical measurement must be interpreted for meaning and usefulness according to its priority to serve our values in a particular decision. It does not have the same priority for all problems. Its importance is relative. Therefore, we need to learn about how to derive relative priorities in decision making.


Background

There are two possible ways to learn about anything - an object, a feeling or an idea. The first is to examine and study it in itself to the extent that it has various properties, synthesize the findings and draw conclusions from such observations about it. The second is to study that entity relative to other similar entities and relate it to them by making comparisons.
The cognitive psychologist Blumenthal (1977) wrote that "Absolute judgment is the identification of the magnitude of some simple stimulus...whereas comparative judgment is the identification of some relation between two stimuli both present to the observer. Absolute judgment involves the relation between a single stimulus and some information held in short-term memory, information about some former comparison stimuli or about some previously experienced measurement scale... To make the judgment, a person must compare an immediate impression with impression in memory of similar stimuli".

Using judgments has been considered to be a questionable practice when objectivity is the norm. But a little reflection shows that even when numbers are obtained from a standard scale and they are considered objective, their interpretation is always, I repeat, always, subjective. We need to validate the idea that we can use judgments to derive tangible values to provide greater credence for using judgments when intangibles are involved.


The Analytic Hierarchy Process

To make a decision in an organized way to generate priorities we need decompose the decision into the following steps.

1. Define the problem and determine the kind of knowledge sought.

2. Structure the decision hierarchy from the top with the goal of the decision, then the objectives from a broad perspective, through the intermediate levels (criteria on which subsequent elements depend) to the lowest level (which usually is a set of the alternatives).

3. Construct a set of pairwise comparison matrices. Each element in an upper level is used to compare the elements in the level immediately below with respect to it.

4. Use the priorities obtained from the comparisons to weight the priorities in the level immediately below. Do this for every element. Then for each element in the level below add its weighted values and obtain its overall or global priority. Continue this process of weighting and adding until the final priorities of the alternatives in the bottom most level are obtained.

To make comparisons, we need a scale of numbers that indicates how many times more important or dominant one element is over another element with respect to the criterion or property with respect to which they are compared. Table 1 exhibits the scale. Table 2 exhibits an example in which the scale is used to compare the relative consumption of drinks in the United States. One compares a drink indicated on the left with another indicated at the top and answers the question: How many times more, or how strongly more is that drink consumed in the US than the one at the top? One then enters the number from the scale that is appropriate for the judgment: for example enter 9 in the (coffee, wine) position meaning that coffee consumption is 9 times wine consumption. It is automatic that 1/9 is what one needs to use in the (wine, coffee) position. Note that water is consumed more than coffee, so one enters 2 in the (water, coffee) position, and ½ in the (coffee, water) position. One always enters the whole number in its appropriate position and automatically enters its reciprocal in the transpose position.

The priorities, (obtained in exact form by raising the matrix to large powers and summing each row and dividing each by the total sum of all the rows, or approximately by adding each row of the matrix and dividing by their total) are shown at the bottom of the table along with the true values expressed in relative form by dividing the consumption of each drink (volume) by the sum of the consumption of all drinks. The information about actual consumption was obtained from the US Statistical Abstracts. We see the answers are very close and pair-wise comparison judgments of someone who knows can lead to very accurate results of drink consumption.





An Example of a Simple Decision

The following is a simple decision examined by someone to determine what kind of job would be best for her after getting her PhD: either to work at two kinds of companies or to teach at two kinds of schools. The Goal is to determine the kind of job for which she is best suited as spelled out by the criteria. Because of space limitations we will not define them in detail here. For more detail see Saaty, (1994 and 2000).




There are 12 pairwise comparison matrices in all: One for the criteria with respect to the goal, which we show here in Table 3, two for the sub-criteria the first of which for the sub-criteria under flexibility: location, time, and work, that we show in Table 4 and one for the sub-criteria under opportunity that we do not show here. Then there are nine comparison matrices for the four alternatives with respect to all the “covering criteria”, the lowest level criteria or sub-criteria connected to the alternatives. The 9 covering criteria are: flexibility of location, time and work, entrepreneurial company, possibility for salary increases and a top-level position, job security, reputation and salary. The first six are sub-criteria in the second level and the last three are criteria from the first level. We only show one of these 9 matrices comparing the alternatives with respect to potential increase in salary in Table 5.

The criteria listed on the left are one by one compared with each criterion listed on top as to which one is more important with respect to the goal of selecting a best job. The sub-criteria on the left are then compared with the sub-criteria on top as to their importance with respect to flexibility. The alternatives on the left are then compared with those on top with respect to relative preference for potential increase in salary. The sub-criteria priorities are weighted by the priority of their parent criterion flexibility (.036) to obtain their global priority.


The priorities for each matrix are obtained as they were from the matrix of comparisons for the drinks in the US. In Table 6 the rankings of the alternatives are shown against the nine covering criteria (only one of the matrices leading to the rankings was shown, in Table 5). We need to multiply each ranking by the priority of its criterion or sub-criterion and add the resulting weights for each alternative to get its final priority. We call this part of the process, synthesis. It is shown in Table 6. Because Table 6 is horizontally long, it is divided into two pieces where the lower piece follows to the right of the upper piece.



The overall priorities for the alternative jobs, shown on the far right of the lower piece of Table 6, are the sums across each row for the alternatives. Note that they sum to 1. These priorities may also be expressed in the ideal form by dividing each priority by the largest one, .333 for International Company, as shown in Table 7. The effect is to make this alternative the ideal one with the others getting their proportionate value. One may then interpret the results to mean that a State University job is about 78% as good as one with an International Company and so on.



The Ratings Mode

There is another method to obtain priorities for the alternatives. Here we establish rating categories for each covering criterion and prioritize the categories by pair-wise comparing them for preference. Alternatives are evaluated by selecting the appropriate rating category on each criterion.

The rating categories for the Job Security criterion are Hi, Medium and Low. We compare them for preference using a pair-wise comparison matrix in the usual way as shown in Table 8 below. To obtain the idealized priorities normalize by dividing by the largest of the priorities. The idealized priorities are always used for ratings.



The rating categories for all the covering criteria and their priorities are established in a similar way and are shown in Table 9.




Table 10 shows the verbal ratings of the four alternatives on each covering criterion and Table 11 shows their corresponding numerical ratings from Table 9 with their totals shown in the first column on the left. The totals are converted to priorities by dividing by their sum in the second column on the left.




Comparing the results from the pair-wise comparison method called a relative model to these results from the ratings model as shown in Table 12 we note that the first two alternatives’ priorities are very close. The last two are a little different. This is to be expected. The two methods do not deliver the same priorities exactly. The relative model method where alternatives are compared with each other under the various criteria is more accurate. The ratings method has the advantage that one can rate large numbers of alternatives rather quickly, and the results are adequately close.


The process of paired comparisons has far broader uses for making decisions. We can deal with a decision from four different standpoints: The benefits (B), that the decision brings, the opportunities (O) it creates, the costs (C) that it incurs and the risks (R) that it might have to face. We refer to these merits together as BOCR. Some people in the field of strategic planning use similar factors known as SWOT (strengths, weaknesses, opportunities and threats) having switched the order of weaknesses and opportunities in making the correspondence with BOCR. The alternatives must be ranked for each of the four merits. The four ranking are then combined into a single overall ranking by rating the best alternative in each of the BOCR on strategic criteria that an individual or a government uses to decide whether or not to implement one or the other of the numerous decisions that they face. The results of the four ratings determine the priorities each of which is used to weight all the priorities of all the alternatives with respect to that merit.

There is in addition the possibility of the dependence of the criteria on the alternatives in addition to the mandatory dependence of the alternatives on the criteria or among themselves. In that case we have a decision with dependence and feedback. To determine the best course of action in such decisions needs a few days to do thoroughly. For more information on this, see the Analytic Network Process.

Group Decision Making

Two important issues in group decision making are: how to aggregate individual judgments in a group into a single representative judgment for the entire group and how to construct a group choice from individual choices. The reciprocal property plays an important role in combining the judgments of several individuals to obtain a single judgment for the group. Judgments must be combined so that the reciprocal of the synthesized judgments is equal to the syntheses of the reciprocals of these judgments. It has been proved that the geometric mean, not the frequently used arithmetic mean, is the only way to do that. If the individuals are experts, they may not wish to combine their judgments but only their final outcomes obtained by each from their own hierarchy. In that case one takes the geometric mean of the final outcomes. If the individuals have different priorities of importance, their judgments (final outcomes) are raised to the power of their priorities and then the geometric mean is formed.

Future Trends

There are two areas that need greater attention in decision making. One is the integration and cataloguing of the structure of a variety of carefully studied decisions to create a dictionary to serve as a source of reference for others to consult so they can benefit from the knowledge that went into making these decisions. Two successful attempts have already been made in this direction resulting in two books: The Hierarchon (Saaty and Forman,1993) a dictionary of hierarchically structured decisions and the Encyclicon (Saaty and Ozdemir 2005), a dictionary of more general network structured decisions.

Another important area of investigation is how to factor psychological time into a decision in order to anticipate and deal with the future more successfully through prediction and planning. Many efforts are under way in this direction. Books and articles have been published that deal with the future and with planning using the prioritization process described in this chapter.

Conclusion

It appears inescapable that we need an organized way to make decisions and collect information relevant to them when a group must decide by laying out all the important factors and negotiating their understanding, beliefs and values. Here are a few examples where the process has been used in practice.

The Analytic Hierarchy Process has been used in various settings to make decisions (samples).

• In (2001) it was used to determine the best relocation site for the earthquake devastated Turkish city Adapazari.
• British Airways used it in 1998 to choose the entertainment system vendor for its entire fleet of airplanes
• A company used it in 1987 to choose the best type of platform to build to drill for oil in the North Atlantic. A platform costs around 3 billion dollars to build, but the demolition cost was an even more significant factor in the decision.
• The process was applied to the U.S. versus China conflict in the intellectual property rights battle of 1995 over Chinese individuals copying music, video, and software tapes and CD’s. An AHP analysis involving three hierarchies for benefits, costs, and risks showed that it was much better for the U.S. not to sanction China. Shortly after the study was complete, the U.S. awarded China most-favored nation trading status and did not sanction it.
• Xerox Corporation has used the AHP to allocate close to a billion dollars to its research projects.
• In 1999, the Ford Motor Company used the AHP to establish priorities for criteria that improve customer satisfaction. Ford gave Expert Choice Inc, an Award for Excellence for helping them achieve greater success with its clients.
• In 1986 the Institute of Strategic Studies in Pretoria, a government-backed organization, used the AHP to analyze the conflict in South Africa and recommended actions ranging from the release of Nelson Mandela to the removal of apartheid and the granting of full citizenship and equal rights to the black majority. All of these recommended actions were quickly implemented.
• The AHP has been used in student admissions, military personnel promotions, and hiring decisions.
• In sports it was used in 1995 to predict which football team would go to the Superbowl and win (correct outcome, Dallas won over my hometown, Pittsburgh). The AHP was applied in baseball to analyze which Padres players should be retained.
• IBM used the process in 1991 in designing its successful mid-range AS 400 computer. IBM won the prestigious Malcolm Baldrige award for Excellence for that effort. Bauer et al. (1992) devoted a chapter on how AHP was used in benchmarking.
• Several military and political applications have been made. Of general interest was the analysis of the decision as to whether to build or not build the national missile defense (NMD) made two years prior to the time that decision was made in December 2002. The decision was the same as the study recommended: build it.

Key Terms and Their Definitions

'''Alternative''': The possible outcome of a decision. It can be a physical object, a strategy or an action.

'''Benefits''': The advantages, gains or positive values obtained in making a decision.

'''Comparison''': Examination for dominance with respect to a common property.

'''Costs''': The disadvantages or negative values incurred in making a decision.

'''Criterion''': An attribute or condition that an alternative must satisfy.

'''Element''': A single source of influence in a decision.

'''Goal''': The object of a decision.

'''Hierarchy''': A multi-level structure used to represent a decision in which the goal of the decision is at the top, followed by a level of criteria and then another level of sub-criteria and finally the alternatives of the decision always at the bottom. Influences in a hierarchy are linear and run from the top down or from the bottom up.

'''Ideal''': The best of a group of elements being compared.

'''Network''': A structure for representing decisions that unlike a hierarchy does not have an ordering of levels. Influences are non-linear and run from a group of elements to another and back directly or through a cycle that passes through other groups of elements. The group of alternatives must always receive priorities from other groups of elements, but can also be a source of influence in some decision networks.

'''Opportunities''': The potential (future) advantages, gains or positive values that might result from making a decision.

'''Pair-wise Comparison''': A judgment from the fundamental scale that uses the smaller element as the unit and estimates the larger element to have the attribute a multiple of that unit.

'''Priority''': Relative value of importance.

'''Rank''': Position or order in a group

'''Rate''': To rank by estimating the merit or intensity with which a given alternative in a decision possesses a certain property.

'''Risks''': The potential (future) disadvantages, losses or negative values that might result from making a decision.

'''Strategic Criteria''': Criteria used to evaluate the BOCR merits of a decision to derive priorities for the BOCR by rating their top alternatives. These priorities are used to combine the four different rankings one with respect to each of the merits. The costs and risk are subtracted from the benefits and opportunities.

'''Sub-criterion''': A smaller partition of a criterion.

7.05.2007

AHP and Conjoint Analysis

In marketing decisions, people sometimes ask what the differences are between the Analytic Hierarchy Process and Conjoint Analysis. Most of the confusion seems to come from the fact that in each process there are pairwise comparisons. But that's really where the similarity ends. (this content courtesy of Dr. Jerry Wind at Wharton).

Conjoint is the best approach (short of real market experiments) to get consumers to make tradeoffs among the features or benefits of a set of alternative choices, i.e. products. Its major advantages are that it allows in a relatively short interview (typically about 20 -30 minutes) to get enough information on consumers trade offs and, using hybrid conjoint analysis, one can analyze the data and develop three outputs:

a. the relative importance of each feature/benefit
b. the optimal offering
c. through simulators, an answer to what will happen if we change any of the features

Conjoint is especially valuable when presenting the consumer with real products (developed based on a master experimental design). Conjoint is often used to establish price elasticity., segment markets, decide on positioning and design optimal product and service offerings. It has also been used to evaluate different advertising and promotion offerings and distribution channels.

In short it is one of the best consumer research techniques with thousands of application and articles.

The results of conjoint analysis can be very helpful INPUT to managers who use the AHP taking the consumer input and other considerations in determining their optimal strategy.
For example even if I have info on price elasticity from a conjoint analysis study I can use this as a guide to a pricing decision and will be better off including the consumer input as one of the inputs to management deliberations.

Another major difference is that the strength of the AHP is in group decision making (conjoint can not do it)

The major benefits for AHP is the process that allows management to articulate assumptions, structure their decision process, focus on both the short and long term via key scenarios, bring all relevant information (including results of conjoint studies) into the discussion, conduct sensitivity analysis, and get a buy in by all the managers involved.

Conjoint can not do any of these nor is it designed to do it (this is where Jerry's portion of this blog ends).

For example, if you are trying to decide on the best marketing program mix to achieve a specific marketing strategy, you might be considering programs in video, events, Internet, and print. Conjoint has no criteria – just alternatives that you are comparing. You could use it to ask consumers which among a specific set of print campaigns they might prefer (although you won’t have the degree of preference and you won’t have any measure of consistency about that preference), but it doesn’t allow you to compare those alternatives to a set of strategic objectives or tell you how well would very different types of alternatives in different areas would compare, i.e. how a video campaign would deliver to the strategy vs how an event delivers to that strategy vs an Internet program vs. a print campaign, because the features of each of these alternatives are so dramatically different. Aligning the marketing or product mix with the strategy, developing the relative priorities, and allocating resources are not possible in conjoint.

The AHP is a prioritization and resource allocation approach much more fitting to marketing executives who need to align a host of often very different marketing program alternatives to a business strategy. It enables you to generate innovative marketing mix strategies, evaluate the various strategies, and reach consensus among conflicting interests (group enabled). Specific uses include:

- determining the desired target product portfolio and allocation of resources among the components of the portfolio
- determining the desired directions for new product development or introductions (McNeil case)
- generating and evaluating marketing mix strategies

Because AHP uses “ratio scales”, comparing the importance of one criterion against each other criterion, it enables executives to compare and assess the relative importance of very tangible objectives such as “sales growth” with more intangible objectives such as “building brand loyalty”. This is literally a comparison of apples and oranges that everyone thinks cannot be done. AHP is the only approach that can do this because of the ratio-scale pairwise comparison process.

Finally, when you get to the evaluation of the marketing alternatives against those strategic objectives, AHP enables the marketing execs to then compare very different types of alternatives and assess how much each alternative will deliver towards the strategic objectives. Specifically, you can evaluate how a given “Internet marketing” program delivers to a strategic objective vs a print campaign or an event. The Internet marketing program might contribute to the “sales growth” objective very well, but not do much at all towards “building brand loyalty”, whereas an event might deliver much more effectively to “building brand loyalty” but fall short on measureable “sales growth”. The outcome of the AHP process is the prioritized list of all of the alternatives and how much they contribute to the strategy in an exact, structured and quantified way. i.e. the best marketing program has a priority of .96 while the worst is a .07. This tells you that you should be willing to invest 14X as much in the top program compared to the bottom, and enables you to focus on a very innovative marketing mix. The priority of the alternatives then provides a platform to allocate $$ for budgeting to the campaigns that will deliver the most value for the business. You are maximizing the investment towards your strategy, and thus the value delivered from that investment. Very different than conjoint, you know with AHP and Decision Lens exactly how much bang for the buck each marketing program is delivering for you against the strategy.