Pros/Cons of Quantitative Data Collection - Weighing In
The use of surveys and questionnaires to collect information about the diabetes education program provides the evaluator with excellent information about the clients’ attitudes, perspectives, and feelings about the education received in the program. Surveys and questionnaires are simple and inexpensive ways of acquiring information about how this diabetes program is helping to empower clients. The evaluator as facilitator can draw conclusions and or inferences from a single collection of survey/questionnaire data to extrapolate over a longer period of time on what may or may not be working with this education program.
Through an approach that is culturally sensitive, the evaluator remains aware of language and the context in which the program has been evaluated (AEA, 2011). The evaluator can understand the self reporting data that these surveys and questionnaires provide in combination with the rich data that is elucidated from the focus group discussions.
Benefits and Limitations of Focus Groups
Participation in a focus group is a benefit for both the evaluator and the stakeholders in the program. In a focus group setting the evaluator builds a strong rapport with clients and their families regarding their unique perspectives, concerns and feelings about the education they receive and how they manage their diabetes. Through skilled questions, the evaluator is able to garner answers as the clients and families freely express their unique experiences. The evaluator can collect very detailed and insightful information about the program and as a result, offer the best possible recommendations.
Focus groups provide an opportunity for the clients to share perspectives and to build camaraderie through their interactions with other clients who share similar experiences and challenges as they managing their diabetes. A large amount of information can be provided at a reasonable cost and within a reasonable time frame (The Health Communication Unit, 2002).
Focus groups provide rich, in-depth data, however this type of data is more difficult to analyze which is an obvious limitation. Focus groups may create opportunities for clients to respond to questions in an effort to please the evaluator rather than answer honestly regarding the benefits and limitations of the program. Focus groups within the context of the DEC may be difficult to conduct if any of the participants have problems with their hearing, cognitive impairment or difficulty communicating (The Health Communication Unit, 2002).
Surveys
Benefits and Limitations of Surveys/Questionnaires
There are many benefits to using surveys and questionnaires for an evaluation. Surveys involve less time to conduct as many stakeholders can be reached within a short time frame, by telephone, mail, fax or in-person (The Health Communications Unit, 1999). This is helpful in remaining within budget as well as on schedule for completion of the evaluation in order to provide practical recommendations in a timely manner. The evaluator remains culturally sensitive to language and provides clarity of instructions in order that all cultural and ethnic populations can freely answer questions and or omit any questions they may not wish to answer. The anonymity of the clients using these techniques, allows the clients to answer truthfully without fear of reprisals from program staff. The evaluator can better understand assets and limitations of the program in the compilation of recommendations. This can assist the evaluator in offering explanations regarding the strengths and limitations of this education program.
There are limitations with using surveys and questionnaires in any program evaluation. Some clients may report a fleeting momentary perspective of the education received and the program itself rather than their true in-depth perspective. Alternatively, clients may respond in a manner to please the evaluator rather than what he/she may truly feel. Some of these diabetes clients may have poor memory of their experience of the program and this may distort the evaluation results. Rapport with clients is obviously absent with surveys and questionnaires therefore it is more difficult to collect an understanding of the respondent's perspective (The Health Communication Unit, 1999).
Benefits and Limitations of Surveys/Questionnaires
There are many benefits to using surveys and questionnaires for an evaluation. Surveys involve less time to conduct as many stakeholders can be reached within a short time frame, by telephone, mail, fax or in-person (The Health Communications Unit, 1999). This is helpful in remaining within budget as well as on schedule for completion of the evaluation in order to provide practical recommendations in a timely manner. The evaluator remains culturally sensitive to language and provides clarity of instructions in order that all cultural and ethnic populations can freely answer questions and or omit any questions they may not wish to answer. The anonymity of the clients using these techniques, allows the clients to answer truthfully without fear of reprisals from program staff. The evaluator can better understand assets and limitations of the program in the compilation of recommendations. This can assist the evaluator in offering explanations regarding the strengths and limitations of this education program.
There are limitations with using surveys and questionnaires in any program evaluation. Some clients may report a fleeting momentary perspective of the education received and the program itself rather than their true in-depth perspective. Alternatively, clients may respond in a manner to please the evaluator rather than what he/she may truly feel. Some of these diabetes clients may have poor memory of their experience of the program and this may distort the evaluation results. Rapport with clients is obviously absent with surveys and questionnaires therefore it is more difficult to collect an understanding of the respondent's perspective (The Health Communication Unit, 1999).