Professional Documents
Culture Documents
Schlumberger Private
Outline
Introduction
Basic tornado Concepts
Schlumberger Private
Basic decision tree concepts
Basic Monte Carlo concepts
Monte Carlo vs. decision trees
Independence, dependence, correlation
More Monte Carlo topics
Portfolio theory
Introduction
Three loose categories of analysis:
Sensitivity Analysis
Decision Analysis
Risk Analysis
Schlumberger Private
The underlying theme is uncertainty:
How important is it?
How can it affect decisions?
What is the impact of it?
Each of these categories can make use of different
tools.
The questions asked in each stage of analysis tend to
be different.
Sensitivity Analysis
How much is the
value of a project
affected by
uncertainties?
Schlumberger Private
Is the range of
possible outcomes
acceptable?
Which uncertainties
are the most
significant?
Is it worth trying to
refine the estimates of
the most significant
variables?
Decision Analysis
Should we drill, sell, or run seismic?
Is the cost of adding a compressor likely to be
recouped?
Which development strategy will pay out most quickly?
Schlumberger Private
Should any decisions change if we change our
measure of value?
How much is seismic information worth, if anything?
Risk Analysis
What does the risk
profile for the project
look like?
What is the
Schlumberger Private
likelihood of losing
money?
Should we be
surprised by the
outcome of this
project?
What is the most
meaningful measure
of risk for us?
Basic Tornado Concepts
Uncertainty
Everything has uncertainty at some level
Schlumberger Private
Understanding it has two components:
How uncertain is it?
How much does it matter?
Basic Tornado Concepts
High, Base, Low
When specifying how uncertain something is,
we often give high, base, and low estimates.
Schlumberger Private
What does this mean?
The base estimate is generally the estimate for the
most likely value.
High and low are more tricky: the range should be
wide enough to capture most possibilities, but it
should not be so wide that the estimate has no
meaning.
Basic Tornado Concepts
Some terminology:
Variable: an uncertain parameter affecting the result of a
calculation. E.g., oil price, operating costs, net pay, etc.
Schlumberger Private
Value Measure: a measure of value; the result of a
calculation. E.g., NPV, ROR, recoverable reserves, etc.
Schlumberger Private
To create a tornado diagram...
calculate the VM using the base estimate of all the variables
calculate the VM using the low and high estimate of each variable
calculate the change in VM between low and high for each
variable
plot each change as a horizontal bar with the largest at the top
Spider Diagrams
A spider diagram is another sensitivity analysis tool:
calculate the VM using a range of values for each
uncertain variable
Schlumberger Private
plot the VM vs. the percent change in the base
estimate for each variable
steeper slopes indicate the VM is more sensitive to
changes in that variable
negative slopes indicate an inverse relationship
Basic Decision Tree Concepts
Probability
Everyone is familiar with the concept of
Schlumberger Private
probability:
When you flip a coin, there is a 50% chance of
getting heads.
When you roll a die, there is a 1 in 6 chance
(16.6667%) of rolling a 4.
All of decision analysis relies heavily this concept.
Basic Decision Tree Concepts
Decision Tree Nodes
There are three types of nodes in a standard decision tree.
Schlumberger Private
Decision nodes represent decisions that need
to be made.
Schlumberger Private
It is generally not possible to achieve the EV in a
single trial.
If the identical project could be done many many
times, the average outcome should be close to the
expected value.
Basic Decision Tree Concepts
High, Base, and Low Revisited
A common element of a decision tree is the three-
branch uncertainty node.
Schlumberger Private
Recall that EV is the probability-weighted
average of all the outcomes.
For the calculated EV to be meaningful, care
must be taken in the selection of the
probabilities.
A continuous variable needs both its average value and its range
of possible values to be roughly captured by the three-branch
Schlumberger Private
representation.
Probability-value pairs need to be carefully selected.
Schlumberger Private
To create a CP graph:
Sort all possible outcomes from
lowest to highest.
Plot the probability of the lowest
outcome against its value.
For the next outcome, plot its prob. plus the previous prob.
against the its value.
Repeat for all points.
Basic Decision Tree Concepts
CP Graphs and Risk Tolerance
Two decision trees can have the same expected value but
different cumulative probability graphs.
Schlumberger Private
Two coin flip games:
Heads: win $10, Tails: win $0
Heads: win $1, Tails: win $0, play ten times
If it cost $4 to play these games,
would you?
What if the stakes were measured
in thousands of dollars?
In Class Example
Using the ProCalc5 Spreadsheet:
Plot a tornado diagram
Create a decision tree with top three variables
Schlumberger Private
Calculate expected value
Plot a cumulative probability plot
Basic Monte Carlo Concepts
The Calculation Engine
Recall the discussion of variables and value measures.
They are the inputs and outputs of a calculation engine.
Schlumberger Private
A calculation engine could be Merak Peep, MS Excel, or
any other application that has inputs and outputs.
Basic Monte Carlo Concepts
The Calculation Engine
For a Monte Carlo simulation, inputs are described as PDFs
Random values are drawn for each input and outputs are
Schlumberger Private
calculated.
Repeating this builds up a histogram of possible output
values.
Basic Monte Carlo Concepts
Probability Distributions
A probability distribution is a means of expressing the
range of possible values for an uncertain variable, and the
Schlumberger Private
likelihood of those values.
Schlumberger Private
The sampling is done such that areas of high probability
density are chosen more frequently than areas of low
probability density.
If region A has twice the probability density of region B,
there should be twice as many sample values drawn from A
as from B.
Basic Monte Carlo Concepts
Measures of Central Tendency
There are many kinds of averages.
Schlumberger Private
are mean, median
and mode.
For an asymmetric
PDF, these three
measures will not be
the same.
Basic Monte Carlo Concepts
Continuous vs. Discrete Distributions
One important property to note about a probability
distributions is whether it is continuous or discrete.
Schlumberger Private
Continuous distributions apply to
variables such as porosity or price.
Schlumberger Private
This is an alternate view of the same information, but it can
be easier to interpret, depending on the insight sought.
Basic Monte Carlo Concepts
Percentiles
It is easy to illustrate percentiles using the cumulative probability
graph.
There is a 10% chance of the true value being less than the P10
Schlumberger Private
estimate of that value.
It is also possible to easily determine the likelihood of the variable
falling within any given range of values.
Basic Monte Carlo Concepts
Correlation
It is possible for variables to be random but not
independent of each other.
Schlumberger Private
If, when the values of one variable are high, the values of
the other variable also tend to be high, then they are
positively correlated.
When the opposite is true, they are negatively correlated.
Correlation does not necessarily imply a causal
relationship between two variables.
Basic Monte Carlo Concepts
Correlation continued
The degree of correlation is measured by the correlation
coefficient, which runs from -1 to +1.
Schlumberger Private
Plotting the values
of one variable vs.
the corresponding
values of the other
variable is a good
way to visually
inspect correlation.
Decision Trees vs. Monte Carlo
Schlumberger Private
both calculate expected value
both consider ranges of outcomes
What are the differences?
Decision Trees vs. Monte Carlo
As we have discussed,
uncertainty nodes commonly
have three branches to represent
Schlumberger Private
an uncertain variable.
An alternative
representation of the same
information in the form of a
discrete probability
distribution:
Decision Tree vs. Monte Carlo
Schlumberger Private
Are there really only three
possible prices?
Should all prices around
the base price be equally
likely?
Instead of a few discrete values, Monte Carlo can
use a continuous distributions to represent
uncertain variables
Decision Trees vs. Monte Carlo
Both decision trees and Monte Carlo use a
calculation engine to provide data.
Schlumberger Private
The key difference is how this output data is
used.
Decision Trees vs. Monte Carlo
Decision trees use the values of the outcomes
and their associated probabilities to
determine a weighted average. This is the
expected value of the tree.
Schlumberger Private
EV = (P(1) V(1)) + (P(2) V(2)) + (P(3) V(3))
Decision Trees vs. Monte Carlo
In Monte Carlo analysis, expected value is
calculated by taking the mean of all the
outcomes.
There is no weighting by probability because
Schlumberger Private
the sampling from the input distributions
accomplishes this.
Sampling is more
frequent in regions of
high probability density.
EV = (V1 + V2 + V3 +)/N
Sample size important.
Pros and Cons of Monte Carlo
Pro: For situations where precision is important,
MC modeling is more sophisticated than decision
trees.
Schlumberger Private
Con: More sophistication requires more data and
effort. A three-branch uncertainty node may be
just as good for rough calculations.
Pros and Cons of Monte Carlo
Pro: For large numbers of uncertain input
variables, the number of calculations required
for MC analysis can be smaller.
Schlumberger Private
Con: Decision trees are faster to calculate
when relatively few uncertainties are involved.
Pros and Cons of Monte Carlo
Pro: Monte Carlo is a good risk profiling tool.
What are the P10 and P90 values?
What is the chance of losing money?
How does this project fit into the
Schlumberger Private
portfolio?
Schlumberger Private
Dependence implies a relationship between
events (if this, then that).
Correlation implies a relationship between
variables (if A is high, then B is low).
Both can manifest themselves similarly,
depending on the application.
Tornado Dependence
Recall the previous discussion of tornado diagrams
Each variable is adjusted one at a time to observe the
effect on the value measure.
Schlumberger Private
This implicitly assumes that the variables are
independent of one another.
Correlation and dependence can be expressed to a
limited degree by associating more than one variable
with a sensitivity bar.
Use the high estimate for A with the high estimate for B
to represent a positive relationship
Use a low estimate in conjunction with a high estimate to
represent a negative relationship.
Decision Tree Independence
By default, variables in decision trees are independent
Schlumberger Private
mentioned earlier shows
the same uncertainty node
following each branch of
the previous node.
This implies that the value
of the second variable is
independent of the first
variable.
Decision Tree Dependence
Both correlation and dependence can be defined in a
decision tree.
Schlumberger Private
same way.
Here, the values used in
each uncertainty node in
the second level are
different.
Could also have different
probabilities.
Bayesian Revision
An unintuitive aspect of probability theory.
Schlumberger Private
moderate, or poor well.
Also, from past
performance you
know the likelihood of
good or poor seismic
results given different
qualities of wells in
the region.
Bayesian Revision
Schlumberger Private
But you need them in this
format.
Bayesian revision is the
technique of converting
the probabilities from one
representation to the
other.
Bayesian Revision
The results of the Bayesian revision in this example
are shown in the tree below.
Schlumberger Private
resulting probabilities
are not obvious.
Bayesian revision is
very closely tied to
the concept of Value
of Information
Value of Information
The question that might occur to you after looking at
the previous example is whether the seismic
information was worth obtaining what is the value
of that information?
Schlumberger Private
Because of the unintuitive nature of Bayesian
revision, value of information calculations are often
surprising.
Sometime information turns out to be extremely
valuable at other times it has no value at all.
In order for information to have any value, it must in
some way affect the decision you make.
A Simple Card Game
Youre walking through a dirty, run-down casino on the
edge of town. A surly looking man stands at a table with a
deck of freshly shuffled cards. You ask him what game he
is dealing and he explains:
Schlumberger Private
The rules are very simple my friend. It costs $100 to play
this game. After you hand over the money, he will turn
over the top card of the deck. If the card is a face card,
you win. If not, you will lose. How much do you win? If the
card is a Jack, you win $150. If the card is a Queen, you
win $250. If the card is a King, you win $350. So you see,
its really a very easy game. Let us play.
Schlumberger Private
I see you are an intelligent person. Perhaps I can suggest
a way we both can profit. If you tip me $50, I will signal
you with a tap of my foot whether the next card is a face
card. You can then decide if you want to play.
Schlumberger Private
I know the offer this man has given you. I will make you a
better offer. For only $25 dollars, I will consult my poor
dead mother and tell you whether the card will be a face
card. She is hardly ever wrong no more often than two
heads in two coin tosses.
Schlumberger Private
random numbers.
The algorithm requires a seed number that is used
as the starting point for the string of numbers.
If the same seed is used, the same string of
numbers will be generated.
This feature of random number generators can be
exploited in some applications.
Random Walks
One method of modeling price is with a random walk.
A distribution is used to model the month-to-month
changes in price.
Schlumberger Private
For each iteration of the MC simulation, one sample
value is drawn for each time period of the economic
evaluation.
The goal is to reproduce the
statistical properties of real price
charts by carefully selecting the
parameters describing the random
walk.
Convergence
How many iterations are required for a MC simulation?
Tracking the changes in statistical measures as the
simulation proceeds is a method of addressing this
Schlumberger Private
question.
The speed of convergence depends on the setup of the
MC model and the desired level of accuracy.
The more iterations, the more accurate the results.
Combining Distributions
Care must be taken when combining the results of
separate MC simulations.
Adding the P10 results of two projects does not give
Schlumberger Private
the P10 result for the combination of those projects.
The results must be added iteration by iteration.
If the results of the projects are correlated (because
of a common price forecast for example), the order
of the iterations is crucial.
Portfolio Theory
The Problem in a nutshell:
You have N projects that you could pursue
You have enough money to do n projects
Schlumberger Private
n<N
Schlumberger Private
risk is bad
Project value dependent on portfolio:
value is portfolio-contribution dependent
portfolio is more (or less) than the sum of its parts
More than one optimal portfolio:
more value gained by accepting more risk
less risk achieved by accepting less value
Portfolio Space
Imagine that you plotted every feasible portfolio
on a graph of value vs. risk
An upper boundary
Schlumberger Private
would be apparent
Only the points represent
valid portfolios - the
space is typically not
continuous
Schlumberger Private
by portfolios in quadrant II
Schlumberger Private
Collection of points, not a
continuous line
Have not yet defined value
and risk
Schlumberger Private
measures can be derived:
expected value = mean
uncertainty = standard deviation
(Traditional Markowitz definitions)
downside uncertainty = semi-
standard deviation
equals standard deviation for
symmetrical risk profiles
Low, high, and median estimates
Probability of losing money or
missing quota
The Definition of Risk
Throughout all of this discussion the definition of risk
(and value) has not been discussed.
There is no correct definition of risk.
Schlumberger Private
Exploring different definitions can lead to
valuable insights.
This is most easily illustrated through an
example.
The following slides show efficient frontier graphs
for a selection of portfolios produced from
fictional projects.
Risk Definition
Most common EF
graph: mean vs.
semi-std. dev.
56 most efficient
portfolios marked
Schlumberger Private
Must trade off value
and risk to select
No obvious choice
Interpretation of
risk not intuitive
Risk Definition
Risk = P10 AT Cash
(low estimate)
Now 8 efficient
portfolios
Schlumberger Private
Some points stand
out with new view
Data mining gives
new insight
Risk Definition
Risk = prob. of not
being $200 million
company
Now 3 efficient
portfolios
Schlumberger Private
Look for portfolios
with less risk than
neighbors
Lowest chance of
missing target with
highest value
portfolios
Risk Definition
Risk = variability
(normalized risk)
Now 9 efficient
portfolios
Schlumberger Private
Note low-risk
portfolios
Note poor portfolios
for further insight
Projects can be
liabilities
Risk Definition
Risk = standard
deviation of ATCash
(Markowitz)
Similar set of
efficient portfolios
Schlumberger Private
Diversification leads
to lognormal risk
profiles
Risk Definition
Risk = prob. of
exceeding first-year
spending limit
Risk no longer
based on same
Schlumberger Private
indicator as value
Note elbow in curve
Tradeoff more
obviously beneficial
with this view
Risk Definition
Risk = prob. of
missing first-year
BOE target
Risk again related to
portfolio constraints
Schlumberger Private
Dramatic change in
picture again
Risk Definition
Value & risk based
on discounted
ATCash (NPV)
Shift in relative
positions highlights
Schlumberger Private
time value of money
Process can be
repeated with each
new indicator
The End!!!
Schlumberger Private
Thats all folks!