Back Analysis of a Decision Tree Q: What question are we trying to answer? A: Whether or not we should buy some market research data that has been offered to us for $5,000. D: We have actually answered this question three times, with EVPI, EVSI, and by looking at the expected values of each major portion of the tree. Q: Why did we answer it three times? A: A question of speed. D: EVPI is a quick, but rough estimate, while EVSI takes longer to set up. Having set up the EVSI tree, we used the expected values for the third answer. Q: What did EVPI recommend? A: To buy the information. D: We would pay $90K for perfect information, they were asking for only $5K, and our boss said the research company was pretty good, though certainly not perfect. Q: What did EVSI recommend? A: To buy the information. D: We would pay $8,240 for information of this accuracy, and they are asking only $5,000. Q: What did we decide when looking at the expected values of each major portion of the tree? A: To not buy the information. D: Whether we looked at the decision alternative to “Not Buy” or either of the “Buy – Favorable” or “Buy – Unfavorable” branches, the decision with the highest expected value was to build. This meant that if we were going to rely on expected values (EVPI and EVSI), then there was no point in buying the information because it did not matter what the information said. Whatever it said, we would make the same decision – to build. Q: So, since we can’t trust the expected values to make our decision for us, how do we analyze the tree? A: Figure 1 is an outline of the steps we will follow to analyze Figure 2, shown on the next page: Step 1 2 3 4 5 6 7 8 Instructions Start on the right-hand side of the tree Analyze the squares, not the circles For each decision alternative, compare the probabilities and payoffs for one state-of-nature Identify risks and rewards, tradeoff, and decide Repeat for each remaining state-of-nature Reconcile any conflicts to make an overall decision Move down to the next square on this level. When done with a level, use the decisions you have made to analyze the next set of squares to the left Page 1 of 12 684085936, Page 2 of 12 Figure 1: Steps to Analyze a Decision Tree High (.4) 1200 Expand Mod (.4) 660 500 Low (.2) -100 High (.4) 2500 Not Buy 1380 Build Mod (.4) 1380 1200 Low (.2) -500 High (.4) 1500 Second Mod (.4) 910 800 Low (.2) -50 High (.50) 1195 Expand Mod (.43) 803 495 Low (.07) -105 High (.50) 2495 Favorable 1383 1726 Build Mod (.43) 1726 1195 Low (.07) .56 -505 High (.50) 1495 Mod (.43) Subcont 1086 Buy 795 Low (.07) -55 1383 High (.28) 1195 Expand Mod (.36) 475 495 Low (.36) -105 High (.28) 2495 .44 Unfavorable 947 Build Mod (.36) 947 1195 Low (.36) -505 High (.28) 1495 Mod (.36) Subcont 685 795 Low (.36) -55 684085936, Page 3 of 12 Figure 2: Decision Tree Q: Why do we start on the right-hand side? A: To make our job easier. D: You may think the tree in Figure 2 is too complex to easily analyze, but it is rather simple if we take it small pieces. By starting on the right, we don’t have to look at the whole tree, just one small piece at a time. Q: Why do we analyze the squares, but not the circles? A: The squares represent decision alternatives, which we control, while the circles show states-of-nature, which we don’t control. D: Since the purpose of analysis is to lead to a decision, you wouldn’t want to waste time analyzing something where you can’t make a decision (that is, circles). So, we concentrate on the squares. Q: Why do we look at the states-of-nature one at a time? A: They are mutually exclusive and, again, it makes our job easier. D: As only one state-of-nature will eventually turn out to be the true one, it doesn’t make any sense to look at all of them together. Besides, there is too much data to do that. Comparing all of the alternatives for one state-ofnature is similar to the EVPI approach: if we knew the future were going to be that state-of-nature, which alternative would we pick? Q: What happens when we repeat the analysis for the other states-of-nature? A: We get an answer for each of the other states-of-nature. Q: Why do we have to reconcile anything? A: You may (most likely, will have) choose different alternatives for different states-of-nature. D: As you must make a single, overall decision, you must look at the various alternatives you have preferred under different conditions and, in effect, ask yourself where you are most willing to be wrong. Before beginning the analysis, I want to point out this is a very simple tree, mostly because the probabilities are not affected by the decision alternatives. Q: How can the decision alternatives affect the probabilities? A: Quite easily. D: Suppose you are making plans for Spring Break. Your alternatives are that you could go out west to the Rockies to go skiing, or you could go to the Caribbean on a cruise. You might use weather conditions as your states-of-nature, something like “hot” and “cold.” In this setting, the probability of hot weather is rather more likely in the Caribbean than it is in the Rockies, and the reverse is true for cold weather. It is much more typical to have the probabilities changing within a tree than it is to have them stay the same. I chose this example because it is easy, and because it allows me to illustrate domination in a decision tree. Q: How do you look for domination in a decision tree? A: By comparing the payoffs and the probabilities for each alternative 684085936, Page 4 of 12 D: In a payoff table, you did not need to worry about the probabilities changing, but that is a concern for decision trees. Q: Should we check the probabilities or the payoffs first? A: The probabilities. D: If the probabilities of the states-of-nature change from one alternative to another, then you cannot have domination, no matter what the payoffs show Q: If the probabilities do not change, then should we check for domination? A: Yes. D: For our convenience, I have copied one square (and the subsequent states-of-nature) into Figure 3, below. Look at that figure and compare the decision alternatives “Expand” and “Subcontract.” First make sure the probabilities are the same on the states-of-nature (they are, 0.40, 0.40, and 0.20), and then compare the payoffs for each state-of-nature. Under “High,” subcontracting wins (1500 to 1200), under “Moderate,” subcontracting wins (800 to 500) and under “Low,” subcontracting wins (-50 to -100). This means that subcontracting dominates expansion, and “Expand” can be ignored while analyzing the tree (which makes the tree even easier to analyze). One more caveat: this analysis is based on my preferences. You may not agree with all of my choices, because you may be more or less risk-prone than I am. I will try, though, to explain why I am making those choices as I go, so you can see the types of explanations you should be providing. Q: How do we get started? A: Concentrate on the first square on the right-hand side of the tree. D: Being an excessively orderly person, I chose to start at the top-right, so the decision node (square) that I am analyzing is the one for the initial decision to “Not Buy.” Q: Should we always start at the top-right? A: That’s up to you. High (.4) 1200 Expand Mod (.4) 660 500 Low (.2) -100 High (.4) 2500 Not Buy 1380 Build Mod (.4) 1380 1200 Low (.2) -500 High (.4) 1500 Mod (.4) Subcont 910 800 Low (.2) -50 684085936, Page 5 of 12 Figure 3: First Analysis Block D: A good reason for starting at the top right is that if you approach the tree in an organized way, you are less likely to make a mistake, such as forgetting to analyze one part of the tree. There is no rule, though, that says you have to do it that way. Q: Is there anything that can help us sort through all the data that is still there? A: Yes, something you have already used: the payoff table D: You may recall that we drew this portion of the tree by starting with a payoff table. At that time, I mentioned that any table could be drawn as a tree, and that tables were better for focusing on a single decision. We are not going to do a full-blown payoff table analysis. Most people, however, see data in a table better than they do in a tree, so we will present it that way for our own benefit. Q: How do we use a payoff table to analyze a decision tree? A: Begin by drawing the table. D: Just as you did when setting a payoff table, begin by listing the decision alternatives (remember that “Expand” is dominated, so it is not shown) down the left-hand side of the table, as shown in Table 1: Alternatives Build Subcontract Table 1: Decision Alternatives in Table Form Now, follow your instructions and compare the alternatives for the first state-of-nature, high growth. Q: What do we do with the payoff table when comparing the alternatives for the first state-of-nature? A: Copy in whatever data you need. D: Table 2 shows the payoffs for the “High” state-of-nature. (0.40) High Build 2500 Subcontract 1500 Table 2: Payoff Table with First State-of-Nature Alternatives Q: Why didn’t you show the probabilities? A: I did, above the word “High.” D: I don’t need to show the probabilities for the decision alternatives, because the probabilities are the same. Since the probabilities are the same for the two alternatives, they do not affect our decision. That is what makes analyzing this tree so easy. All we have to do is see that “Build” has a higher payoff that “Subcontract” and we know that “Build” is the better alternative for the “High” state-of-nature. Q: As we are finished with the first state-of-nature, what comes next? A: Move on to the second state-of-nature. 684085936, Page 6 of 12 D: Table 3 (next page) adds the second state-of-nature, “Moderate,” to the table. Again the probability of moderate growth is the same (40%) for each alternative. Comparing the two on payoffs, “Build” wins (1200 versus 800). (0.40) (0.40) High Moderate Build 2500 1200 Subcontract 1500 800 Table 3: Payoff Table with Two States-of-Nature Alternatives Q: Can we say that “Build” is dominating “Subcontract” so far? A: Yes, but I wouldn’t. D: It is a rather pointless statement, because we are about to compare the two alternatives for the final state-ofnature, and then we will know whether or not domination is present. So why raise an issue that may not exist? Q: Do we get the same result for the third state-of-nature? A: We use the same process, but get a different conclusion. D: Table 4 shows all three states-of-nature. Looking at the payoffs for “Low” growth, this time “Subcontract” wins over “Build,” -50 to -500. (0.40) (0.40) (0.20) High Moderate Low Build -500 2500 1200 Subcontract 1500 800 -50 Table 4: Payoff Table for the Decision to “Not Buy” Alternatives Q: Do we have our decision yet? A: No, because we made different choices for different states-of-nature. D: Now we have to perform Step 6, reconcile the differences. To do this, summarize the risks and rewards for the two alternatives. One of the nice things about trees is that the risks of one alternative tend to be the rewards of the other. Q: What are the rewards of the “Build” alternative? A: There is an 80% chance of a payoff that is at least $400K better. Q: Where did that come from? A: Combining the “High” and “Moderate” states-of-nature where “Build” won and looking at the difference in the payoffs. D: “High” and “Moderate” both had 40% probabilities, so that makes an overall 80% chance that “Build” is the right choice. Under “High” that payoff for “Build” is $1,000K better than “Subcontract” (2500 – 1500) and under “Moderate” the payoff for “Build” is $400K better (1200 – 800). Q: What are the risks of the “Build” alternative? A: There is a 20% chance of losing an extra $450K. D: That comes from the “Low” state-of-nature. 684085936, Page 7 of 12 Q: Are the rewards and risks for “Subcontract” just the reverse of “Build?” A: Yes. D: The reward for “Subcontract” is that there is 20% chance you will have avoided losing an extra $450K, but the risk is that there is an 80% chance of giving up the opportunity to make at least an extra $400K, possibly an extra $1,000K. Q: So how do you decide? A: Trade-off the risks and rewards. D: There are three issues here: the additional profit (made or given up), the additional loss (incurred or avoided) and the probability of each. Q: Does the amount of the avoidable loss ($450K) make you think twice about the additional profits ($400K and $1,000K)? A: Almost certainly. Q: Does the chance of losing the money affect your decision? A: It should. Q: Are you willing to accept a 20% chance of losing an extra $450K (that you could have avoided) to get an 80% chance of gaining an extra $400K to $1,000K? A: If you say, “Yes,” then you choose “Build.” If you say, “No,” then you choose “Subcontract.” D: That’s really all there is to it. Which reward is more attractive to you: avoiding the loss or making the extra money? Which risk do you want to avoid: losing the extra money, or giving up the chance to make more money? I choose “Subcontract” because, to me, the 20% probability of losing almost half a million dollars that I didn’t have to lose is just too much. I think payoffs of $1,500K or $800K are good enough, so I am not all that attracted by the extra payoffs. Remember: you don’t have to agree with me. Q: Are we finished with the analysis of the first part of the tree? A: Yes. Q: What next? A: Step 7 says to move on to the next square on the same level. D: Looking at Figure 2, above, and staying to the right, the next square follows the decision to “Buy” the information and have it turn out to be “Favorable.” Figure 4 (top of the next page) shows that portion of the tree. Q: Do we go through the same process? A: Yes, but this time we look for changes from the numbers of the first analysis. Q: Are the payoffs the same? A: No, they have decreased by $5K, to pay for the survey data. 684085936, Page 8 of 12 Q: Are the probabilities the same? A: No, they have changed based on the accuracy of the survey data, as calculated via Bayes’ Rule. High (.50) 1195 Expand Mod (.43) 803 495 Low (.07) -105 High (.50) 2495 Favorable 1726 Mod (.43) Build 1726 1195 Low (.07) .56 -505 High (.50) 1495 Subcont Mod (.43) 1086 795 Low (.07) -55 Figure 4: Decision Tree Following a Favorable Survey Result Q: Is “Expand” still dominated? A: Yes. Q: Do we setup another payoff table? A: Yes. D: Table 5 shows the same decision alternatives, but the new probability and payoffs for the “High” state-ofnature. “Build” still wins, and by the same margin, $1,000K. (0.50) High Build 2495 Subcontract 1495 Table 5: Payoff Table with One States-of-Nature Alternatives Q: How can the margin be the same? A: The same amount, $5K, was subtracted from each payoff. D: All that happened was each number went down by the same amount, so the difference is unchanged, and so is our preference. Q: What about the other two states-of-nature? A: The preferences are the same there as well, as shown in Table 6: Alternatives Build Subcontract (0.50) High 2495 1495 (0.43) Moderate 1195 795 (0.07) Low -505 -55 684085936, Page 9 of 12 Table 6: Payoff Table Following a Favorable Survey Result Q: Does that mean our overall decision is the same? A: That depends on what decision you made the first time and how you feel about the new probabilities. Q: How is the analysis the same? A: The payoffs are effectively unchanged. D: While every payoff has gone down slightly ($5K), that is at worst 10% of the payoff amount, and usually less than 1%. The differences between the payoffs are the same, so that part of the analysis is unchanged. Q: How has the analysis changed? A: The probabilities have changed dramatically. D: Previously, we had an 80/20 preference for “Build.” Now, with a favorable survey result, we have 93/7 preference for “Build.” Q: What are the risk/reward tradeoffs? A: Are you willing to accept a 7% chance of losing an extra $450K (that you could have avoided) to get a 93% chance of gaining an extra $400K to $1,000K? Conversely, are you willing to accept a 93% chance of giving up the chance to make an extra $400K or $1,000K, to avoid a 7% chance of losing an extra $450K? Q: Isn’t that a little obvious? A: Maybe not. D: I’ll admit I am willing to accept that 7% chance of an extra loss, but quite often I will have students that still see the amount of the loss as too high, and still prefer to subcontract. If you chose to build in the first analysis, then you would have to choose to build here (otherwise your decision making would be hopelessly inconsistent). If you chose to subcontract initially, then you may of may not choose to build here. In any case, make your choice and move on. Do you notice that the second analysis went a lot faster than the first one? That is because we learned what to look for in the first analysis and applied that to the second. Also, we could refer back to the reasoning of the first analysis, which made the explanations a lot shorter. That progression will usually be true for analysis of decision trees. Q: What do we analyze next? A: We stay to the right, move down the tree, and analyze the alternative to “Buy” the information when the results turn out to be “Unfavorable.” This portion of the tree is shown as Figure 5 at the top of the next page. Q: How have the payoffs changed? A: They haven’t, as compared to the second (most recent) analysis. Q: Have the probabilities changed? A: Yes, significantly. Q: Do we need to set up a payoff table for this analysis? 684085936, Page 10 of 12 A: Maybe not, but we will. D: We have learned a lot about the risks and rewards for these alternatives, so it is tempting to simply make the decision, but it is better to go slowly. Table 7 follows the tree in Figure 5, on the next page. High (.28) 1195 Expand Mod (.36) 475 495 Low (.36) -105 High (.28) 2495 .44 Unfavorable 947 Build Mod (.36) 947 1195 Low (.36) -505 High (.28) 1495 Mod (.36) Subcont 685 795 Low (.36) -55 Figure 5: Decision Tree Following an Unfavorable Survey Result (0.28) (0.36) (0.36) High Moderate Low Build -505 2495 1195 Subcontract 1495 795 -55 Table 6: Payoff Table Following an Unfavorable Survey Result Alternatives Q: What are the risk/reward tradeoffs now? A: Are you willing to accept a 36% chance of losing an extra $450K (that you could have avoided) to get a 64% chance of gaining an extra $400K to $1,000K? Conversely, are you willing to accept a 64% chance of giving up the chance to make an extra $400K or $1,000K, to avoid a 36% chance of losing an extra $450K? D: Now the chance of losing the extra money is little higher than 1-in-3. This increases the risk significantly. If you chose to subcontract on the first analysis, with only a 20% chance, then you would certainly choose to subcontract here, regardless of what you chose in the second analysis. If you chose to build in the first two analyses, then you have a decision to make. If you think the probability of the loss has gotten too high, then you would choose to subcontract here. If you are still more attracted by the extra gains (after all, there is still almost a 2/3’s chance of getting the extra money), then you accept the risk and choose to build. You have to decide. As implied above, here I would choose to subcontract, because that was my initial choice. Q: Ok, we’ve finished all the squares to the right-hand side of the tree. What comes next? A: Back up to the square on the left-hand side of the tree. D: We are back at the start of the tree, but look at what we have accomplished. By making the decisions on the right-hand side first, we have eliminated 2/3’s of the branches that need to be considered now. Q: Do we repeat the process of comparing the decision alternatives for each state-of-nature? A: Yes. 684085936, Page 11 of 12 D: More precisely, we try to, but quickly realize that the tree is not perfectly symmetric. The “Not Buy” branch doesn’t have any states-of-nature. All we can do here is set up the payoff table by treating the two “Buy” outcomes as separate alternatives, as shown in Table 7, on the next page: Alternative Not Buy Favorable Buy Unfavorable Table 7: Payoff Table for Buy/Not Buy Decision Please note that “Buy – Favorable” and “Buy – Unfavorable” refer to how the survey turns out. They do not imply you can select what kind of survey information you see. Q: What data do we put into this table? A: Whatever you chose during the earlier analyses. D: This time, the probabilities are changing, so we have to show a little more. Even though we have already made our decisions for what follows each alternative shown in Table 7, we still have to consider the High/Moderate/Low growth states-of-nature, so we copy in all of the data, as shown in Table 8: Alternatives Decision Outcomes High: 40% Not Buy Subcontract Moderate: 40% Low: 20% High: 50% Favorable Build Moderate: 43% Low: 7% Buy High: 28% Unfavorable Subcontract Moderate: 36% Low: 36% Table 7: Payoff Table for Buy/Not Buy Decision 1500 800 -50 2495 1195 -505 1495 795 -55 These are my decisions. I’ll show the other possibilities later on, but I want to make a point first. Q: What is the question we are trying to answer? A: Whether or not to buy the survey information. D: At the end of the EVSI lecture, I used the expected values of the major branches to show that we did not need to buy the information. The logic was that since we were going to chose “Build” no matter what the information told us, there was no benefit to buying it. We can turn that logic around and ask a different question: Q: Does the result of the survey information change the decision I make? A: Yes. D: If the survey says “Favorable,” then I choose “Build.” If the survey says “Unfavorable,” then I choose “Subcontract.” Clearly, the survey results matter to me. Q: What is the change in payoff, moving from a decision to “Build” to a decision to “Subcontract?” 684085936, Page 12 of 12 A: It varies based on the state-of-nature, but either $1,000K, $400K, or $450K. Q: Would you pay $5K to gain information that could make at least a $400K change in your decision? A: I would. D: For me, for the set of decisions I made, the information is worth $5K and a whole lot more. I would be willing to pay up to $400K for really good survey data. Given that, I might want to tell my boss to commission a survey, one that will give us more precise information. That may or may not happen (there may not be time, or your boss might be satisfied with the available information), but it is something to think about. Notice that in this case, I did not have to really look at the payoffs or probabilities. It was enough to know that the information would make me change my mind. Q: What if the information didn’t make you change your mind? A: Then you wouldn’t buy it. D: Table 8 shows all of the reasonable decision patterns for this analysis. Decision Sets Alternatives 1 2 3 Not Buy Build Build Subcontract Favorable Build Build Build Buy Unfavorable Build Subcontract Subcontract Table 7: Payoff Table for Buy/Not Buy Decision 4 Subcontract Subcontract Subcontract Find the one that matches your decisions from the analysis. If you are in Set 1 or Set 4, then you wouldn’t buy the information, it doesn’t affect your decision making. If you are in Set 2 or Set 3, then you just got a bargain, because that information is worth a lot more than just $5K. As I said, this was an easy to tree to analyze, because it is a very simple tree. The percentages stayed the same within a decision node (square), one alternative was dominated, and the final decision did not rest on the payoffs or probabilities. To show you how we analyze a more complex tree, a have taken an old mid-term problem and written out an analysis of it. That is the next lecture. Back
© Copyright 2026 Paperzz