Evaluation research is often applied to systematically and objectively assess the effectiveness, efficiency, and appropriateness of programs, interventions, randomized trials, marketing campaigns, etc. The results of a properly conducted evaluation can provide a clear understanding program performance, and often indicates how the program can be improved upon or refined. Evaluation results are also indispensable for program funders because they often yield valuable information regarding the worth of programs, thus enabling informed decisions about how to allocate valuable resources.
Third Millennium Analytics, Inc. provides evaluation services to a wide range of clients, including corporate/business clients (e.g., the evaluation of market research projects, programs designed to improve customer satisfaction, efforts to improve public relations or employee morale), public health agencies (e.g., to evaluate the efficacy of immunization programs, programs promoting health-protective attitudes or behaviors), those in education and public administration (e.g., to evaluate programs designed to achievement, evaluations “social marketing” campaigns to promote use of public transportation), as well as private nonprofit organizations (e.g., to evaluate programs designed increase membership, enrollment, donations, attendance, or participation in activities).
Our evaluation services include assessments of program needs, implementation, outcome/impact, and cost-efficiency. Through the use of randomized field experiments or quasi-experimental designs, outcome/impact assessments can help determine whether your programs or interventions (e.g., marketing campaigns, smoking cessation programs) are effectively producing intended attitudinal or behavioral changes (e.g., increased purchases of a given product or service, cessation of tobacco use).
Needs Assessments. Needs assessments are implemented to identify problems that need to be addressed, or to identify a need for a program, product, service, intervention, etc. More specifically, the extent and types of program needs are assessed, target populations are defined, and the nature of those populations’ needs for given services, interventions, or products are determined. Needs assessments are a crucial step prior to the design of a program (or campaign, project, or intervention), and are relevant for established programs because there are situations where a program may not be appropriate given current needs and changing conditions.
Implementation Assessments. It is often very useful to verify whether your program, intervention, or service has been administered to those for whom it was designed and targeted, that the program has been delivered as intended, whether the program/service is appropriate to those receiving it, and whether those to whom the program has been administered are satisfied or perceive the program as beneficial or informative. We can provide consultation for setting up program monitoring systems, which are intended to provide continual assessments of program implementation.
Outcome and Impact Assessments. Outcome assessments help to determine whether your interventions (e.g., advertising campaigns, smoking cessation programs, etc.) effectively result in intended attitudinal or behavioral changes (e.g., more consumer purchases of a given brand, adoption of health-protective behaviors, etc.). While conceptually similar, impact assessments are more costly and rigorous because they require experimental designs to detect whether the program “causes” a change in behavior, attitudes, etc. We can help select the most appropriate research design for your project (e.g., randomized field experiment, quasi-experimental, or non-experimental) and assist with determining whether your programs are producing the successful results you are seeking. Importantly, some designs allow for the comparison of the effectiveness of two or more competing programs.
Cost-Efficiency Assessments. A program that produces more desired outcomes with a limited budget is clearly preferable to one that produces fewer desired outcomes with the same budget. We can conduct cost effectiveness analyses (CEA) to address the question: at what cost does a program produce expected benefits? CEA will help you compare the costs and outcomes of different programs, and help identify the least costly alternative for achieving desired outcomes, or how to achieve the most desired outcomes within a given budget. Alternatively, cost benefit analyses (CBA) involves a comparison of costs and benefits of two or more policies that have different goals. This is accomplished by monetizing the goals (in dollar values) so that appropriate “apples to apples” comparisons can be made. A “breakeven analysis” can be conducted prior to program implementation in order to determine how much impact is required for benefits to at least equal the costs.