You are on page 1of 11

n the processed meat industry, food safety and microbiological shelf life issues lend themselves to the use

of probability modeling. Our research concentrated on predicting the effectiveness of sodium lactate as an antibotulinal agent in vacuum packaged, uncured and cured turkey breast model systems. In uncured turkey breast containing 1.4% NaCl, 0.3% Na phosphate, and 03% Na lactate, the antibotulinal effect of sodium lactate can be predicted using the following model: Days to toxicity = 3.13+0.39(Na lactate) . Using cured turkey breast with 0.3% Na phosphate, 0.2% sucrose, 0 3% Na lactate, the time to toxicity can be predicted from the following model: Days to toxicity = 1.69+4.88(NaCl)11.16(Na lactate)+7.23(Na lactate) . Probability models have also been developed to predict the refrigerated shelf life of specific processed meat products. The usefulness of the predictive modeling for food safety and quality in the food industry
2 2

The Probability of Penalizing the Innocent Due to Bad Test Results


In modern society two-outcome tests are everywhere. They include drug tests, sobriety tests, disease tests, genetic tests, etc.. The outcome of these tests are either positive or negative, yes or no. We like to think these tests are at least 99% accurate, and yet, horror stories of spurious results seem to abound. Take company-wide drug testing, opponents may claim that at least a third of those identified as drug users will actually be innocent. If we assume the test is 99% accurate, this claim sounds ridiculous. But is it? To analyze the claim we will "grow" a decision tree. Decision trees are a wonderful little device for analyzing anything with two possible outcomes. Every time we reach the end of a branch and have two possibilities we simply create a set of two new branches. For our analysis, we will assume that 2% of all employees actually use drugs. This is lower than the general population but keep in mind that a lot of drug users are unemployed. Also, a company with a clearly stated anti-drug policy will probably have a low proportion of users. The tree's trunk represents the population of all employees. The first set of branches (see figure 1) represent the two possible conditions: drug user, not drug user. The expression Pd = .02 indicates that there is a 2% probability of a person being a drug user. Pc = .98 indicates a 98% probability that a person is clean or drug free. Next, we add two sets of branches representing the drug test* as shown in figure 2 . One set of branches is attached to each of the original two branches. P w = .01 indicates that there is a 1% chance of getting a wrong or incorrect result from the test. Pr = .99 indicates that there is a 99% chance of getting a right or correct result from the test. Note that the probabilities associated with each set of branches must add up to 100%. Finally we add the tree's leaves (see figure 3). Each leaf represents a possible final outcome of the entire process. Note that there are four possibilities. Two of the four possibilities are correct: drug users and drug free individuals are both correctly identified. However, two of the four possibilities are spurious: drug users and drug free individuals are not correctly identified. figure 1. First set of Branches

figure 2. Second set of Branches

We are unlikely to hear complaints from a drug user who is incorrectly identified as being drug free. The drug free person identified as a user is another matter. This would be a very upsetting situation. To find the probability of each final outcome as represented by the four leaves simply multiply the probabilities of each branch one must "climb" on the way to reaching the leaf. For example, the probability of a drug user being rightly identified is represented as Pdr and is calculated as follows: Pdr = Pd * Pr = 0.02 * 0.99 = 0.0198 or 1.98% Note that all the leaf probabilities have to add up to 100%. The population of people identified as drug users consists of individuals who actually are drug users (1.98% of the employees tested) and incorrectly identified individuals who actually are not drug users (0.98% of the employees tested). The percentage of people identified as drug users who are actually innocent can be calculated as follows: Pinnocent = Pcw /( Pcw +Pdr ) = (0.98%) /(0.98% + 1.98%) = .331 or 33.1% The wild eyed claim that a third of all people accused of drug use will be innocent is not so ridiculous after all. Figure 4 shows that the proportion of spurious results among people identified as drug users is surprisingly sensitive to test accuracy. An accuracy of 99% is marginal at best. However the biggest surprise is the fact that the proportion of spurious results among people failing drug tests approaches 100% as the proportion of drug users in the general population approaches zero. Drug testing in a drug free population amounts to a witch hunt.

figure 3. Complete Decision Tree

Drug testing can be administered in a manner which minimizes the proportion of innocent people among those dismissed for failing drug tests. First, test only when evidence for drug use exists, such as erratic behavior. A much higher percent of people showing drug abuse symptoms will actually be drug users and this reduces the the percentage of innocent people who are falsely accused (see figure 4). Second dismiss an employee only after failing more than one test. Using multiple types of evidence including accurate drug testing is the key to preventing the firing of an innocent employee for drug abuse. Police generally follow a similar procedure of using multiple types of evidence when making drunk driving arrests. First, before making an investigation they must establish a reasonable suspicion, such as the odor of alcohol on the breath or the sight of alcoholic beverage containers in the car. Second, they make a standardized field sobriety test. Third, they test the breath, blood, or urine for alcohol. Forth, they are required to inform suspects of their chemical test rights. These include the right to obtain a blood or urine sample for retesting (see Blood Alcohol Testing in Drunk Driving Cases). No one should accept a conclusion based on only a single test result if acceptance carries severe or far reaching consequences. In the case of diagnostic tests for medical conditions it can lead to dangerous or unnecessary procedures. In the case of a drunk driving arrest it can lead to unjustified imprisonment. A low SAT score can lead to denial of admission to a well qualified candidate. Corroborating observations or data and multiple independent tests are the best defenses against spurious test results.

* Note: The analysis assumes that the probability of a false positive result is identical to the probability of a false negative test. In reality this is usually not the case. One will be at least slightly higher than the other. However, the decision tree analysis still works and still gives similar results. Testing in a compliant group without cause is still likely to be a witch hunt. < Return to Contents

How to Design Small Decision Making Groups

Introduction
Teamwork and group decision making are hot buzz words. Giant corporations spend millions annually teaching employees how to work in groups and hold effective meetings. Yet, anyone who has attended a decision making meeting probably feels that a camel is indeed a horse designed by a committee. When decision making teams work, they work very well and when they don't they consume inordinate amounts of time only to yield weak results. Simple applications of probability and statistics can shed light on how to stack the odds in favor of success. This discussion will focus on decision making groups working with partial information where there is a definite difference between selecting a good and bad alternative. For example, this could be a decision about how many toys to produce for the Christmas market. There is only partial information since actual customer behavior cannot be known until well after the decision is implemented. Making the wrong number of toys can result in a substantial loss of profit. Such groups have two key problems. The first is management of communication. The second is decision making accuracy. Generally having more people in a group increases the likelihood that someone will propose the correct decision. However, more people means more opinions and ideas that have to be communicated and discussed. This makes management of the communication process more difficult and can end up reducing group effectiveness. The best ideas may never even be heard.

Rules for Optimizing Small Groups 1. Group members must have the basic
knowledge and ability to identify and evaluate alternatives. Not everyone needs to be an expert but everyone must be able to ask intelligent questions. Each member must be granted equal status or standing within the group. A single member may be the only one to have the correct solution. Equal status improves the chances that this solution will be expressed. Each member must be allowed to fully explain and argue for his or her proposed solutions.This is the only way a single individual with the correct solution can convince the group. Criticisms of options should be made only after all options have been listed. This helps insure that all options are identified. For major decisions, discussion should proceed until there is unanimous agreement that a workable solution has been reached.Requiring a unanimous agreement forces a greater amount of discussion and gives a single individual with the correct solution the opportunity to convince others. Unanimous agreement can involve compromise. It means that all the members have agreed to a workable solution although it may not be their personal favorite. For minor decisions, the majority rules. This speeds up group activities without a major loss of effectiveness. Groups should have an odd number of members. This prevents ties and improves the odds of making a correct decision when using majority rules. The optimum group size is about 5 members.Groups should be expanded beyond this size only when there is good reason. For instance, effective implementation may require buy-in by more than 5 major stakeholders.

2.

3.

4. 5.

6. 7.

Management of Communication
The difficulty of managing communication is roughly proportional to the number of possible social interactions. With two people there is nothing to manage since there is only one possible social interaction. With three people there are three possible two-person interactions and one three way interaction for a total of four. With a four person group there are six possible two way, four possible threeway, and one possible four way interactions for a total of eleven.

8.

The total number of possible social interactions for any sized group is simply the sum of all possible combinations taken two at a time or higher. These are calculated for 2-person interactions using the following Formula:

x=2

n! x!(n - x)!

As can be seen by figure 1, the number of possible social interactions begins to explode in groups with more than 5 people. Large groups require skillful leaders and formal structure in order to function effectively. Formal structure, such as parliamentary procedure, works by deliberately stifling many of the possible social interactions. Unfortunately, this can also stifle creativity and insures that decisions will be dominated by the most politically skillful individuals even when they don't have the best ideas.

Best Possible Decision Making Accuracy


Probability can also be used to evaluate decision making accuracy. This can get complicated so we'll make some simplifying assumptions as follows:

1. There is partial information available on all possible alternatives. Obviously, if there's no information available 2. 3. 4.
then decision accuracy is random. If complete information is available then the decision accuracy should depend only on having enough time and expertise to evaluate the information. All alternatives can be clearly categorized as good or bad. Those categorized as good are clearly superior to those categorized as bad. Selecting a good alternative is a good decision by definition. There can be no ties. A decision is either good or bad. The probability of successfully identifying a superior alternative is not influenced by the number of alternatives. If bad alternatives greatly outnumber good ones then it does not make the good ones harder to identify. In real life many bad alternatives can be quickly eliminated. Each group member has the same probability of successfully identifying a good alternative. A decision making group should contain qualified people who have the ability to discuss and analyze the alternatives. When only partial information is available there typically are no experts with the special ability to consistently guess the right answer. If such an expert existed then there would be no accuracy advantage in using a group.

Divorce statistics for first marriages provide information on the average probability of picking a good alternative in an important decision using partial information. Failure to pick a good alternative can be defined as divorce. Overall, after 20 years 50% of all first marriages have ended in divorce. Based on the divorce statistic, it looks like 50% would be a good number for the average decision making accuracy of typical individuals. However, closer examination indicates that 50% is a low estimate. Women who marry when they are less than 18 years old have a 67% chance of ending their first marriage within 20 years. On average, members of this group have not fully developed their ability to identify and evaluate alternatives. Their higher divorce rate skews the average results for all marriages to the low side. Women between 20 to 24 years of age, on the other hand have a 41% chance of divorce within 20 years. This rate appears to remain approximately stable for women who marry at 25 years of age or older (see Figure 1A). Based on this information 60% accuracy looks like a better rule of thumb for adult decision makers who are using partial information. Adoption of the 60% average accuracy rule of thumb is not based on a mathematical proof but is reasonable. In many cases a 50% average accuracy could be achieved by coin tossing. It's unlikely for human decision making to be worse on average than 50% accuracy unless fraud or deception is involved. 60% accuracy seems more reasonable without being overly optimistic about humankind's abilities. Assuming an average decision making accuracy of 60% allows us to calculate the probability that no one in a group will identify a good alternative. Obviously if this were true then the group could not possibly make a good decision. The probability of no one in the group identifying a good alternative is found as follows: P0 = (0.4)n Where n = the number of people in the group. The best possible decision making accuracy of the group would be Pg = 1 - P0 .

Figure 2 shows a graph of the best possible decision making accuracy vs group size. To achieve this level requires that the decision be made unanimously following an extended discussion. The Rules for Optimizing Small Groups shown at the top of the page must be followed to achieve this performance. These rules are designed to insure that all options are identified and that they are fully discussed. If the group is composed of qualified individuals with the basic knowledge to make the decision and they behave in a rational manner, a single enlightened group member should be able to persuade the group to select the right alternative. On this basis the only way the group would fail is if no one in the group selects a good alternative.

Majority Rules Decision Accuracy There is a tendency in groups to make decisions by voting, in which the majority rules. While this speeds the decision making process it reduces the accuracy and should be used only for minor decisions. To study this situation we resort to finding areas under the binomial distribution using the following relationship:
n

(x!(n - x)!)(q
n!
x=m

n-x

)px

where: n = number of group members m = the minimum size for a majority p = the probability of being right or .6 q = the probability of being wrong or .4 note: q = (1-p ) Figure 3 displays the results of majority rules decision making for various sized groups. Note the odd looking saw tooth appearance which gives even numbered groups a lower probability of making the correct decision. The explanation is that these groups can have a tie. For example, a group of four will only have a majority 75% of the time. The other 25% of the time will be a tie vote which obviously does not result in a correct decision. Odd numbered groups will have a majority on every vote. Yes, even number groups can often resolve tie votes but it costs more

time and effort to do it.

Conclusions:
Figure 4. shows that a group size of five is optimum. Five takes advantage of the desirability of odd numbers for majority rules decisions. For the unanimous decision making style a group of five will have a 99% accuracy assuming 60% individual accuracies and that a single person with the right answer can convince the others. Even with only 50% individual accuracies the group accuracy will average 96.9%. Adding additional members will not greatly improve accuracy. However, additional members will significantly increase group management problems since the number of possible social interactions increases rapidly. The data presented does not mean that every group has to contain exactly five members. There are other factors to consider such as the implementation of decisions. This often requires buy-in by the stakeholders. Placing stakeholders in the group can speed implementation. However, important decision making groups should not be expanded unless there is an overriding reason to do so.

You might also like