Professional Documents
Culture Documents
Version 2
April 2002
Produced under the auspices of the Norfolk Public Health Nurses Forum
Dr Peter Brambleby
Director of Public Health
Norwich Primary Care Trust
St Andrew’s House
Thorpe St Andrew
Norwich NR7 0HT
1
The Norfolk Needs Assessment Tool Box
Version 2
Contents
1. Introduction
2. Practical techniques
3. Epidemiological considerations
3.1 Denominators 15
3.2 Rates 16
3.3 Standardisation 17
2
1. Introduction.
1.1 About this Tool Box
This tool box has been produced in response to requests for help from a
variety of sources from within the NHS and outside.
Some people want to do their own needs assessments but don’t know where
to start. Others have been asked to give a perspective on some-one else’s
assessment but don’t know what it’s all about.
It began its development under the auspices of the Norfolk Public Health
Nurses Forum, and had a predominantly “health needs” focus, but has since
been discussed with Social Services and various other statutory and voluntary
organisations and is intended to be a resource for any caring agency. The
approach and techniques should apply in most situations where the needs of
groups of people are being reviewed.
Help implement the national agenda for developing the public health role
of nurses
Raise the confidence and competence of nurse members on boards of
Primary Care Trusts
Provide a focus for sharing experience, learning and peer support.
Provide a link with the Public Health specialists.
3
Nurses Forum’s initial views on the advantages of needs assessment:-
4
1.3 Definitions
5
1.4 Lessons from elephants
There is a story from the Far East of three blind men in the forest who
encounter an elephant. The first has put his arms round a leg and calls out
“Careful – I’ve just walked into a tree!” The second has hold of the tail and
says to his friends “Yes, and someone’s left a rope hanging down!”. But the
third feels the trunk and shouts out “No! It’s a snake! Run for it!”. The point of
this story is that “need” is a multi-faceted thing, and is viewed differently by
different people at different times. In general it is better to explore it in several
ways in order to build up a more complete picture than to rely on a single
technique or just one perspective.
In another story, a sculptor, famous for his detailed carvings of elephants, was
asked how he went about it. “Easy”, he said, “I just take a block of stone and
chip off anything that doesn’t look like an elephant!”. But that’s the skill. In
the case of needs assessment, it’s the ability to approach a wealth of data and
see the “elephant” hidden within the stone.
Don’t let your needs assessment exercise become like an elephant with
constipation – ie, three months of intense straining, followed by a loud report,
after which the whole lot is dropped!
6
1.5 When is Needs Assessment useful?
1.5.1 Taking the initiative, scanning the whole population, setting the agenda:
as in these questions:
“ What are the top five health care needs of our practice population, or
of our Primary Care Trust?”
“What factors do our population believe affect their health or well-being
adversely?”
“What are the major inequalities in health or well-being across our
county?”
“What are the top three social care priorities for our senior citizens?”
“What are the health and educational needs of children in care?”
“Given our current budget for coronary heart disease, could we deploy
it to better effect?”.
7
1.5.3 Needs “Addressment”.
This is a new term, coined by the Nurses Forum. Just as in clinical practice
one tries never to request a test on a patient unless the result will affect the
clinical management, so in needs assessment one would not embark on a
project unless there is some prior commitment to act on the findings.
- epidemiology (to identify the nature and scale of the problems) and
- economic appraisal (to identify cost and savings, benefits and
disbenefits of doing different things and doing things differently).
There must be some clear end in mind, and action must follow, otherwise the
needs assessment will be futile and the engagement of others will be harder
to secure next time around.
8
2. Practical techniques
2.1 What techniques are available to assess needs?
Broadly, there are three techniques:
1. Analysis of routinely held data
2. Acquisition of information from local informed sources
3. Surveys of those who live in the area or use the services
These have the advantage of being fairly readily available and “pre-digested”
(e.g. rates and comparative information calculated as in the national public
health common data set, Health Authority annual report of the Director of
Public Health, reports from Housing, Voluntary Agencies, Education, Police
and Social Services, and PCG profiles). They allow comparisons between the
locality of interest and similar localities elsewhere.
9
2.1.2 “Rapid participatory appraisal”
(“focus groups”, “key informants” or “health forums”).
In choosing a sample of the population for a survey, care must be taken that
they are a representative cross-section so as not to introduce bias. It helps if
the sample is truly random, and it also useful to know the characteristics of
any non-responders just in case the views of an important sub-group have
been omitted.
10
2.2 How to do a population needs assessment
(“What are the needs of…?”
1 Formulate a clear question, or questions, that your needs assessment
will address. Rather than just asking open questions about what might
be done in an imaginary ideal world, it is often better to phrase a
question along these lines: “Given our present level of resources (money,
people, facilities, partners), and what we can reasonably expect in the
next few years, are there better ways of aligning them with what our
population needs?”
2 Check the question, or questions, with the people who commissioned
the assessment and who will act on the findings
3 If it’s a big project, convene a project group; agree the tasks, timetable
and administrative support.
4 Check to see if anyone has done something similar, from which you
could learn, either locally or from a literature review
5 Discuss the project with the Public Health Department at the Health
Authority – they will be able to help you design your needs assessment
and may be able to provide the comparative data from routine sources
that are part of the assessment or put you in touch with others who can.
6 Identify routine data sources that might help (taking advice from Public
Health Department, University, information department of local trust,
local authority, police, etc). This might shed light on the questions being
addressed and provide comparative information about other localities to
put the findings into context.
7 Think of informed local sources for “participatory appraisal”, either
something like a health forum that already exists, or a new focus group
convened specifically to address the question.
8 Think of a representative sample of the local population who could be
approached for a population survey.
9 Consider testing your methodology with a pilot, especially if you are
treading new ground.
10 Go for it! Local flavour and local participation are the greatest strengths!
11 Validate your assessment and draft recommendations by feeding back
to the people who contributed and the people who are affected by
change.
12 Agree the priorities and gaps you have identified, at Board level in the
participating organisations, and start addressing them!
13 Register your project with the HImP partnership so that others can tap
into your experience. This is also an important record to ensure
standards, openness and corporate governance.
14 Conduct a “de-brief” or “washing-up” session with your group to see if,
with hindsight, it could be handled even better in future.
15 Depending on the importance and generalisability of your assessment,
consider publishing your findings in a peer-reviewed journal.
11
2.3 How to address a problem-solving needs assessment
(“Do we need a ….”)
(Note: this section was drafted from a health care perspective, but is probably
applicable in other types of need, such as social care and education.)
The following list (all beginning with “E” for convenience) may be helpful.
Epidemiology What is the nature and scale of the problem in our area, for
which this innovation offers a solution?
Can we estimate the prevalence (existing cases) and
incidence (new cases)? Note: with a new service there may
be a temporary prevalence “pool” to mop up, followed by a
different steady state when new cases balance those being
cured or dying.
What are the likely demographic trends over time?
Economics What are the added costs of the new intervention in our area,
if any, over what we do at present?
Are there savings - do they release money, staff, facilities?
Where and when do costs and savings fall?
Do we judge that the overall added benefit is in proportion to
the overall added cost?
How do the benefits of using resources in this way compare
with other ways of using the same amount of resource?
Is there some other, perhaps unrelated, area of activity in
which we should now disengage?
12
Expectations What, if anything, do we know about what local patients and
professionals want? Note: if there is little outside pressure,
especially from the public, there is less chance of the issue
getting priority. This is not a defence of “prioritising by
decibels” but a reminder that commissioners need to show
that they are responsive to local needs and wishes.
Equity How well does this proposal fit with the current Health
Improvement Programme or Service and Financial
Framework, and do they need to be re-negotiated?
Are we satisfied that we are maintaining a fair distribution of
resources between care groups and providers?
Will the new initiative increase or reduce inequalities?
Best L, Stevens A, Colin-Jones D: Rapid and responsive health technology assessment: the
development and evaluation process in the South and West region of England. J Clin. Effect., Vol 2, No
2, 1997, 51-6
13
2.4 How to prioritise a list of needs
This is the domain of Economics – the discipline that deals with scarcity and
choice. In some specific clinical areas, such as cancer or stroke, there are
validated “instruments” (sets of questions) for assessing the outcomes of
treatment, but comparing between different types of need is always difficult.
There has been expansion in the department of health economics at UEA -
(try Ric Fordham at UEA – 01603 593543). Meanwhile, even though we often
fall back on qualitative judgements, we should still be systematic and open
about the reasons for our decisions.
• Look at the numbers of people who will receive the new service or
treatment
• Estimate the numbers who are likely to benefit (may be all those receiving
the new service, but depends on the evidence about the particular
intervention)
• If it is an intervention with possible adverse effects (eg false positives in a
screening test or dangerous side effects from a new medicine), estimate
the possible scale of harm
• Look at the kinds of effects being generated, for example:
♦ length of life
♦ quality of life
♦ relief of pressure on carers
♦ improved efficiency of service
♦ improved conditions for staff
♦ benefits for other caring agencies (eg invest in health care to reduce
pressure on social care)
• Look at the magnitude of that effect (By how long is life extended? By how
much is quality of life enhanced?)
• Look at the duration of that effect: …a few months? … a few years?
• Look at all the costs (not just cash, but travel time, time off work, etc) and
the savings too. Don’t just focus on the caring agencies, think of the
patients and families too. Ask for the help of a health economist if the
scale of the changes warrant this
• Having looked at all these factors, try to prioritise those which give the
greatest health gain – ie, combination of length and quality of life – and
then look at relative costs and affordability. Do this in a qualitative way,
when quantitative ways are impractical. Try to make it clear what the
reasoning is.
• Remember: data on costs and outcomes can only ever be estimates;
certain vulnerable groups may need a protected (or “weighted”) share of
resources; national priorities and imperatives have to be accommodated; it
is justifiable to adjust the priority list so long as the reasons are clearly
stated and the final decision taken in open forum.
14
3. Epidemiological considerations
3.1 Denominators
Its population could be taken as the people registered with the practices that
make up the PCT, wherever they live, or those who are resident within the
PCT boundary drawn on a map, whether they are registered with practices in
that area or not.
We know about practice populations broken down into age and sex groups, so
we can calculate rates (another term for fractions) for the needs and NHS
activity that goes on in those practices. For example, we could look at
numbers of health visitors attached to each practice per 100 children aged
under 5 years in the practice, or per 100 low birth weight babies born in the
previous year. In this example we are relating provision of a service (health
visiting) to indicators of need (pre-school children and vulnerable new-borns).
The practical relevance of this for needs assessments at the level of primary
care or community services is the selection of a population that suits the data
available and suits the purposes of the study being conducted.
15
3.2 Rates
16
3.2 Standardisation
The ESP is widely used to compute directly age-standardised rates. The same
population is used for males, females or all persons.
17
Indirect standardisation. This is useful in making comparisons in rates
between one population (such as Norfolk) and a real “standard” population
(such as the UK). Its most familiar use is in the “standardised mortality ratio”
(SMR), but it applies equally to standardised illness ratios, standardised
hospital admission ratios, or other such events.
18
4. The difference between “need”, “demand” and
“supply”
Need (the ability to benefit in some measurable way) is not the same as
demand (what patients ask for) and different again from supply (what is on
offer for them). To illustrate the differences the following schematic
presentation relating to secondary care (hospital) services may be helpful.
Diagram 1
Need, Demand and Supply for secondary health care – the present.
Diagram 2
Need, demand and supply for secondary health care – the objective
19
In these diagrams:
“Need” is the ability to achieve a measurable change in health status as a
result of a secondary health care intervention. Technological advances
push back the boundaries of need – for example, before there were
effective coronary artery re-vascularisation procedures the NHS did not
have to assess the need, but now it does. “Need” can also be defined
arbitrarily for local circumstances – for example most health authorities
have decreed that tattoo removal is not a legitimate NHS need.
“Demand” is seen here from the hospital perspective, ie what the GP is
referring the patient to hospital for (for those who have been through the
sieve of General Practice) or the patients who self-refer (eg via casualty).
“Supply” represents what is provided by way of hospital services (ie
capacity).
20
Zone 3: Demand that is met even though it is not strictly needed.
This is a waste of scarce resources. Think of the milder cases of glue ear that
proceed to surgery where “watchful waiting” would be more appropriate.
Tightening up the local criteria for referral and thresholds for intervention, or
rewarding appropriate clinical management rather than activity per se, are
ways to free up resources here. Taking Zones 1 and 3 together gives the total
area of current provision that is not addressing true need. It represents the
principal hunting ground for disinvestment and re-deployment of resources
(such as staff, theatre sessions or finance). It requires considerable effort in
public information and education.
Zone 4: Demand that fulfils criteria of need but is not yet met.
This zone equates with the waiting list for admissions after the patients have
been assessed in the outpatient clinic. There is such intense managerial and
political pressure to address this group that it is easy to concentrate on
nothing else – to lose sight of the bigger picture and miss the whole-system
approach. Note that a hospital’s outpatient waiting list contains a mixture of
Zone 2 and 3 patients – all of whom have expressed a demand but are not
necessarily in need.
Zone 6: Services that are supplied to meet need without prior demand
by the patient.
Do we ever meet needs without them being demanded? An unusual concept
at first glance, but think of cancer screening, childhood immunisation, health
promotion and well-person clinics. This is where the Health Service goes into
proactive mode. It is a major plank in the strategy to get need and supply to
overlap better. Go get them!
21
Summary
This simplistic model has limitations, but reminds us that in needs assessment
we cannot take what we know about either demand or supply as substitutes
for need, tempting though this may be since the data are often readily
available. (How many health authorities or PCTs simply roll over the previous
year’s contracts with local hospitals as a proxy for need?) The model also
directs attention to practical steps to address the mismatches, which is often
the rationale for embarking on needs assessment in the first place. Here are
some of the groups who could get involved and activities that they could
engage in.
Reference:
1. NHSME, DoH, 1991. Assessing health needs: a DHA Project Discussion Paper
22
5. References and further reading
1 Hooper J and Longworth P. Health Needs Assessment in Primary
Health Care – A workbook for primary health care teams. DoH
Resource Pack, ring-binder format. Sept 1997
Highly recommended. Sets out the methods which are used in this
Norfolk resource pack.
First in a series of 6 weekly articles (two more follow below) in the BMJ
which covered the topic.
23
8 Stevens A, Gillam S. Needs assessment: from theory to practice.
Br Med J 1998; 316: 1488-52
24