1C evaluation and assessment of healthcare Flashcards
name the Bradshaws types of needs
F- Felt need
E- Expressed need
N- Normative need
C- comparative need
(E)
Define felt need
Need as perceived by an individual, what a patient feels they require to feel better
Define Expressed need
Either what is demanded (ie attending for services) or need which is vocalised
Define Normative need
Need as deemed by a physician. Ie need based on professional judgement
Define comparative need
Relative need of different groups. ie the needs of one area compared to another
Definition of a HNA
A systematic method of identifying the unmet health and healthcare needs of a population and making changes to meet the unmet need
What may HNA focus on
HNA may focus on different:
-population groups
-illnesses
- procedures or interventions
Wagstaff and Culyer’s definition of need
Equate the need for interventions with the potential to benefit from them. Ie even if a person is unwell, if they cannot benefit from intervention, they have no need for that intervention
HNA: definition of need for HNA
Need is said to exist when there is an effective, acceptable intervention and the potential for health gain.
HNA: factors impacting demand
Demand is a poor proxy measure for need.
Demand is influenced by:
- illness behaviour
- knowledge of services
- accessibility of services
-media
HNA: what are JSNAs
-joint statutory health needs assessment
- statutory requirement for local authorities with CCGs/ICSs through the health and well being board
- explicitly consider the social needs of the population
- involve non health agencies in the assessment
- opportunity to consider wider determinants of health
Stevens and Raftery’s 3 approaches to an HNA
- Corporate
- Epidemiological
- Comparative
HNA: Corporate approach (4 advantages and 2 disadvantages)
- Approach based on eliciting the views of stake holders (ie patients, service users, charities, public, politician, professionals)
- can be conducted relatively quickly
- No need to collect large amounts of data
- responsive to interested parties
-incremental process so small changes can be made, a little at a time, based on stake holder feedback - small changes may not be appropriate when large change needed
- Change can be drive by power rather than need
HNA: Epidemiological approach
- this approach considers the epidemiology of the condition, current service provision, the effectiveness and cost effectiveness of interventions and services
HNA: comparative approach
- compares service provision between different populations
- may use data from surveys of hospital activity data
- compares observed findings with those that would be expected bsed on a reference population. Population needs to be standardised to allow comparison (ie for age, comorbidity etc)
- local service provision may be effected by a number of factors not just different need
5 stages to conducting a health needs assessment according to health development agency (now part of nice)
- Scope
- Identify potential priorities
- Selection of priorities for change
- change
- review
HNA stage 1: scope
Identify:
P-population of interest
A- aim of HNA
R- resources required for HNA
R- risks invovled
S-stakeholders
HNA stage 2- identify potential priorites
- gather various data to describe the population
- may involve collecting quantitative and qualitative data
- data is analysed to give information on health need, this includes discussion with stakeholders
- current level of service provision is reviewed as well as evidence of effectiveness
HNA Stage 3: Selection of priorities for change
- identify which issues are most important, leading to priorities for action
-priorities may be based on:
1. size and severity of impact- availability of effective intervention
- local commissioning priorities
HNA stage 4: change
-implement changes using change management techniques (ie action planning, monitoring, risk management)
HNA: stage 5: review
- learn from the project, disseminate fundings and identify the next priority
HNA sources of data: routinely collected data (does it over/under estimate and why?)
tends to underestimate burden of need as it does not include:
-unmet need (ie cannot access services)
- self care
- people paying for treatment privately
HNA sources of data: epidemiological data (does it over/under estimate and why?)
- tends to overestimate need as it includes:
1 people who cannot benefit from treatment (ie too sick for operation)
2. people who do not want treatment
3. people who have already been treated.
what is participatory needs assessment and why is it useful
- involvement of the local community in the needs assessment
- ofent produces qualitative rather than quantitative data
- involving the local community in all stages of the needs assessment can improve accuracy of results and increase acceptance of findings
List 5 things required for successful participatory needs assessments
- clear objectives (so the public know exactly what is up for consultation/discussion)
- recognised methods of data collection/ data sources
- clear communication
- hearing voices, which are important, but often not heard ( ie ethnic minorities, elderly)
- involvement of community in all steps of the process
what is the main type of data collected in participatory needs assessment and what methods can be used to collect data (4 methods)
- tend to collect qualitative data
-can use:
1. interviews with key informants
2. Focus groups
3. group work shops
4. visual methods (ie mapping or transect walks)
what is a transect walk
where participants are given low cost cameras or encouraged to use mobile phones to take photos in order to illustrate their needs
what is health utilisation data used for (3 things)
- in many developed countries health utilisation data is routinely collected and can be used for:
- commissioning
- research
- paying service providers
What is a health utilisation minimum data set and what is likely to be included? (5 areas)
- a minimum data set is often outlined to ensure that the needed data is gathered for each care episode.
Minimum data sets often include:
1. Demographics (DOB, address, name, sex)
2. Clinical information (diagnosis, procedures, prescriptions)
3. Pathway/ service use (referred to where and when, Duration of stay, referral appointment date)
4. Provider details (clinical team/ consultant)
5. bespoke/ specific data (PROMS, satisfaction data ie friends and family test, research data)
- health utilisation data can be looked at across multiple care episodes for one patient to gather information on clinical performance across a clinical pathway
what are 2 key contextual factors which must be considered when interpreting healthcare utilisation data in order to ensure it is interpreted appropriately?
- Patient mix (sicker patients/ more co-morbidities get ill more often, take longer to recover and tend t have worse outcomes)
- System factors (service utilisation will be affected by other service availability ie alcoholic admission on friday night will be admitted for longer if there are not weekend community detox services.)
service utilisation data:
measure and interpretation of referral and appointment date data
MEASURE: waiting times
INTERPTATION: indicators of barriers to access due to:
- insufficient resources
- suboptimal care pathway
- lack of effective preventative measures
service utilisation data:
measure and interpretation of duration of stay
MEASURE: number of bed days
INTERPRETATION: can give indication of:
- morbidity (ie fewer bed days may suggest people arrived less sick)
- efficiency ( fewer bed days for same procedure may indicate more efficient service)
- effectiveness (feweer bed days for same procedure may indicate better perioperative care)
service utilisation data:
measure and interpretation of episodes of care and patient/clinical data
MEASURE: number of admissions/admissions for diagnosis
INTERPRETATION: indicator of: volumes of care provided, Appropriateness of care (ie is there a high number of admissions for diagnosis appropriate for community management)
service utilisation data:
measure and interpretation of date of this admission and date of previous admission
MEASURE: Readmission rate
INTERPRETATION: indicator of morbidity (sicker patients –> higher readmission), effectiveness (ineffective care –> readmission)
service utilisation data:
measure and interpretation of A+E attendance/emergency care attendance
MEASURE: Unplanned care rates
INTERPETATION: indicator of barriers to access due to inadequate care pathway, lack of preventative measures
health service research/ evaluation: limitations of using RCTs (5)
When conducting studies of health services, the gold standard RCT might not be the most appropriate use of study design
- resources (not enough money or time)
- Timeliness (may take years to see health benefits of an intervention)
- Policy changes (national policy changes can require rapid changes to local health services which RCTs do not allow for)
- multi site study challenges (different organization of health services can mean that it is hard to conduct studies across multiple sites)
- Organisational challenges (studies are often concerned with health service organization, it is impractical to reorganise half a health service in order to study impact)
health service research/ evaluation: study design for assessing acceptability
Epidemiological study design (ie cross sectional study)
health service research/ evaluation: study design for effectiveness (when experimental design not possible)
Epidemiological study design (cross sectional, cohort, case-control)
health service research/ evaluation: study design for effectiveness (when evidence base does not exist)
Experimental/ quasi-experimental ie rct
health service research/ evaluation: study design for effectiveness (when evidence base does exist)
Systematic review
health service research/ evaluation: study design for efficiency
economic evaluations (cost benefit, cost utility, cost effectiveness analysis)
health service research/ evaluation: study design for implementation/quality
quality improvement tools (ie PDSA)
factors influencing choice of study design in health service research/evaluation (5)
- aim of study (ie if want to know about acceptability use cross sectional survey, if want to know effectiveness of new intervention use a trial)
- whether the study is for summative or formative purposes (in may health services it is better to refine and tweak interventions as implemented (PDSA cycles allow for this), however this cannot be done in RCTs
- resources available
- whether the service is existing, new or proposed (if existing it is unlikely there is a suitable comparison group so cross sectional survey might be most appropriate. IF a new service you could implement in some areas only and compare with areas without it)
- what is the exisiitng evidence base (if there a re lots of studies you may just need a lit review)
Maxwells 6 dimensions of quality
EEEAAR (remember EAR 3,2 1)
Effectiveness (at an individual level)
Efficiency and economy (is the service providing the best value for money)
Equity (could the service be more fair)
Access (can one subgroup use the service more easily that other subgroups)
Acceptability
Relevance (is the service relevant to the needs of the whole community(
components of donabedians framework for assessing quality of health care (4)
Donabedian described 3 elements to assessing quality of health care
Structure–> process –> outcome
However output is often also included
health service quality assessment: what is included in structure and give examples
The THINGS you need for healthcare
ie buildings, staff, beds, drugs
health service quality assessment: what is included in process and give examples
This is the activity that is undertaken
ie staff training, prescriptions, operations, referrals, hand washing
health service quality assessment: what is included in output and give examples
This is the result of the activities undertaken in process
eg. waiting times, number of operations, length of stay
health service quality assessment: what is included in outcomes and give examples
The end result/the change in health status
ie mortality, morbidity, discharge, patient satisfaction
health service quality assessment: advantages (1) / disadvantages (1) of using structure measures to assess healthcare quality
Advantage: easy to collect
Disadvantage: may not be comparable between systems, ie one country may have more nurses but they may not be so highly trained.
health service quality assessment: advantages (2)/ disadvantages (1)of using process measures to assess healthcare quality
Advantages:
1 relatively easy to collect in centralised healthcare services such as the NHS.
2. Some process measures directly link to outcome ie vaccine delivery
Disadvantages:
1. Many process measures may not link to outcomes ie if lots of prescriptions given for treatment of a condition but these patients would be better treated with a different intervention
health service quality assessment: advantages/ disadvantages of using outcome measures to assess healthcare quality
Advantages: the ultimate aim of health care is to improve health outcomes
Disadvantages:
1. Not necessarily related to health service performance as will also be affected by the case mix
2. health outcomes often take a time to develop so cannot be assessed in a short term study
3. Difficult to link intervention/ service to health outcome rather than other factors.