Responding to the coronavirus pandemic: Conducting a needs assessment in a time of rapid change
This short article provides guidance to services on conducting a needs assessment during the coronavirus pandemic.
12 June 2020
This short article discusses how you can assess the changes you have made to programs and services in response to the coronavirus pandemic.
This article is part of a series on responding to the coronavirus pandemic. See the other articles on Conducting a needs assessment in a time of rapid change and Documentation tips for monitoring and evaluation.
This short article discusses how you can assess the changes you have made to programs and services in response to the coronavirus pandemic. This article is for staff in community service organisations. It will help you to plan, collect and assess data to understand how clients and staff are responding to any changes in service delivery.
Periods of rapid transformation can result in changed client needs or changed conditions of service delivery. This can create both opportunities and challenges for services. Collecting data to assess how clients and staff are responding to changes in your service will give you information that you can use to make adjustments to service delivery.
For example, you might learn through assessment that a particular group are no longer accessing your service, so you might want to do some outreach to this group. You might use data you collect to identify areas for staff training. Or you might be assessing the changes you have made to see if some phone or video service delivery could become permanent.
Consider what you want to find out through assessment.
For example, you might want to know:
If this is a temporary change and you intend to return to your regular program or service as soon as possible, then it is likely you would only invest limited resources in assessment. However, if you are considering making some of these changes permanent, then it would be sensible to do a more thorough assessment of the changed service.
Data collection needs to place a minimal burden on staff and clients while being as systematic and rigorous as possible. Below we list three different sources of data: administrative data, client feedback, and staff feedback. If possible, we recommend collecting data from each source. This will give you a broader range of perspectives and strengthen your findings.
Before you plan your data collection, document the changes that you have made – so you know exactly what is different about your service and what changes you want to assess. See this short article about documentation for more information.
Administrative data are data that are collected as part of your regular service provision; data that you collect for DEX1 is one example. It is easier to use existing data because there is no additional work needed to collect the data, and usually little or no additional burden on clients to answer questions. In most cases, to assess change, you will need to compare current administrative data to data you collected prior to the coronavirus pandemic. Administrative data can be used to explore who is using your service and how. You might then use this knowledge to make service improvements. For example, to increase outreach to a population group that is currently under-represented.
Some types of administrative data are discussed below.
These data will need to be compared to data collected before the changes to your service delivery. Some questions you might ask are:
Collecting data from clients can help you understand how they are experiencing changes to programs or services. If possible, it can also be valuable to make contact with clients who are not participating in your service to understand the barriers to their participation
You are probably already getting informal feedback from staff about the effects of service changes. With some planning and structure, you could more systematically collect staff feedback to see how programs and services are operating in the current environment.
Making sense of the data you collected does not need to be complicated. The type of analysis you will do will depend on the amount and type of data you have collected. For example, if you have done a focus group with staff or collected data from clients using a three question mini-interview, you could look for common themes and ideas. You could then write this into a single-page summary, including any findings from administrative data, and present this to your team and managers for discussion.
As social distancing restrictions are lifted, some services may return to face-to-face delivery. However, this might take longer for some services, particularly those that work with vulnerable clients, and some may prefer to continue using phone or video conferencing. Some services may choose to offer a range of options to clients. The data you have collected can help you make decisions about how you deliver your service now and in the future.
If you decide to make some of the changes permanent, you may need to consider how this could influence the outcomes your program or service aims to achieve. You might need to review your program logic. For example:
For more detailed resources on evaluation methods and strategies there are a range of resources in the Expert Panel Program planning and evaluation guide.
Families and Children Activity service providers can also contact the Expert Panel Project team for free advice and support.
1 The Data-Exchange (DEX) is the program performance reporting portal hosted by the Department of Social Services. Services funded under the Families and Children Activity are required to input data into the Data Exchange.
Featured image: © GettyImages/SrdjanPav
Conducting a needs assessment in a time of rapid change
This short article discusses why conducting a needs assessment during times of major change is important to ensure your service is responding effectively to community needs.
Documentation tips for monitoring and evaluation
This short article discusses how documenting decision making around program or service changes will assist you in monitoring or evaluating your service delivery during the pandemic.
Program planning and evaluation guide
Helping FaC Activity service providers to build capacity to plan and implement programs, evaluate outcomes, and share the results with others.
Sign up to the Expert Panel Project news for the latest news and updates for Families and Children Activity service providers
This short article provides guidance to services on conducting a needs assessment during the coronavirus pandemic.
This short article is for anyone who is delivering, or planning to deliver, a program or service modified in response to the coronavirus pandemic.
Helping FaC Activity service providers to build capacity to plan and implement programs, evaluate outcomes, and share the results with others.
Need help with a program plan or evaluation?
If you are funded under the Families and Children (FaC) Activity, AIFS can provide you with time-limited support for tasks such as developing a program logic or preparing for an evaluation.
Contact the Expert Panel Project team for free advice and support.
The Australian Institute of Family Studies acknowledges the traditional country throughout Australia on which we gather, live, work and stand.
We acknowledge all traditional custodians, their Elders past, present and emerging, and we pay our respects to their continuing connection to their culture, community, land, sea and rivers.