A full description and matching components of a program is essential to assess its implementation.
The components are:
- Strategies,
- The activities
- Conduct
- The means of communication and
- IT implementation of the program and the specification of the beneficiaries and where the implementation takes place.
Proper identification and precise elements of the program will determine which elements of the program were implemented as envisaged, and what factors influence potential differences in implementation.
To judge the correct specification of the elements, the concerns that the scope of the program (beneficiaries) was observed. In addition, speculation about possible links between the results of the implementation and results of the program itself (in the sense of inputs, results, effects, etc.) …
At the same time, the specification (Retail) from the contents of the program is a request of the evaluation process.
The initiative to plan and complete assessment process contributes to a specification most appropriate and realistic program content. This is an important prerequisite for the program is more effective (because the internal consistency of the program was a “screening”), and secondly that the evaluation of the results and impacts is efficient, because the program results with the objectives and coherent and realistic expectations will be compared.
To enable the assessment process, the design and specification to improve a public program, certain techniques are used.
1 – Formative Assessment: based on data collected from pilot projects and the recipient of the behavior of a particular intervention and provision of information on the feasibility of certain activities and instruments and to what extent they are capable of the aircraft design and the intended beneficiaries;
2 – Check the evaluability “clarify systematic set of procedures for the proper development of the theory behind a public program, information, and uses theplanned the data in the assessment before the start of an evaluation scale.
Its main activities include (Scheirer, 1994:49-50):
a) Refer to clarify decision-makers managers and staff through a series of meetings their expectations for the program and the evaluation itself;
b) Using a model called Matrix logical pattern, and it expects the causal relationships between the three aspects of the program, program resources, the implementation of specific activities and program results;
c) to improve the theory underlying the program through an interactive process, with visits to project sites and the information available to assess the reality of field operations and the extent to which the proposed theory is plausible;
received d) Identify the intended uses for the information of the evaluation through discussion with policy makers and program managers, including changes in the program;
e) The use of the theory with the program description. clarify application of theories, is the question of the substance from the program, and the use of data of the underlying processes.
This type of evaluation is important not only to specify the content of the program, but also activities related to the measures (indicators) of the income link can be used in future.
The term theory here refers to the interdependent principles and explain the behavior of a person, group or organization.
Chen (1990 different) two types of theories:
- The normative, the what must be a program and defines
- Causality, which describes empirically the causal relationship between solutions (including contextual factors) and the results.
The central question in this case is to study the effectiveness of the program and to achieve this goal, it uses the mechanisms of causal relationships between the measures of a program and the final result.
The purpose of this assessment can be defined as follows in order to identify the net effects of social intervention. Since the evaluation of the goals of this approach for the program or the same action is required.
Evaluation Process – This type of evaluation research in a systematic development of social programs to measure the coverage of social programs to determine the degree to which it is to control the target, and importantly, their internal processes. The aim is to detect defects in the development of procedures to identify obstacles to their implementation and to generate important data for your reprogramming through the consideration of events and activities.
As targeted use of information possible during the development phase of the program generated changes in their content at runtime. So, in contrast to previous approaches, this method of assessment, carried out simultaneously with the development of the program, also known as formative assessment. Its implementation requires, however, we can design flows and processes of the program.
In addition, the system assumes the existence of appropriate information management, which served as the basis for the work of managers and consultants, if at all.
An application of the methodology of the evaluation of social programs:
A comprehensive system for evaluating the methods, performance monitoring and evaluation processes. In addition, the parameters and modes of operation in the proposed model used.
Evaluation of results:
Here are the results from the immediate results as defined, the results (consequences) and the results in the medium (impact indicators) for the term.
For the analysis it is the use of impact indicators to measure long-term results, in conjunction with program objectives and performance indicators, proposed the immediate and medium term actions. The output indicators measure the impact of the program by the target group as a whole and between U
SERS program. In the first case, should be two types of performance indicators, research in the field or with databases and / or the entry into force:
- Degree of global coverage:
The measures cover the target group of the program. The deficit and the surplus of people benefiting are the causes of changes in the itinerary. The first shows the necessity of developing and secondly, that waste of resources (not eligible target group beneficiaries);
- Amount of coverage varies depending on the program:
Measures the involvement of different subsets of the proposed target audience. This sentence can not describe the discrimination (or bias) in the Customer Choice program, by region, age, sex, etc.. be the second point, namely the evaluation of the results for the users of the program uses to measure performance indicators, taking into account the specific objectives of the program or project.
Rob Vos (1993) are some examples of the indicators used most frequently for the users of the program and target groups:
1 – Food Programme – the rate of malnutrition by age, mortality and morbidity;
2 – for education – illiteracy rate, the repetition of the fraud; coefficient of school and educational attainment;
3 – to programs of health – mortality in general, infant mortality, maternal mortality and birth, fertility and life expectancy at birth;
4 – housing programs – quantitative deficit in the housing, quality of housing construction and availability of basic services. The indicators show the input means or resources available to achieve the objectives. limited and insufficient resources (financial, labor, equipment, etc..) almost always tend to undermine the expected results.
Vos (1993) lists some examples of the most common indicators of entry such as:
was) – to nutrition programs – food availability per person;
b) – Educational programs – student relationship / teacher, student or school, the number of series offered by the school and the availability of teaching materials for students;
c) – for health programs – the number of doctors per capita on health posts per capita beds per capita and per capita availability of vaccines.
But to identify indicators of access, the determinants that make efficient use of available resources in programs to achieve the objectives. The most common are:
a) – health programs – the number of physician visits per adult, distance from the nearest health service, disposable income per family (also useful in facilitating the acquisition of drugs, for example), and cultural factors;
b) – for programs in education – far from the school, the appropriateness of the curriculum and the disposable income for the family to allow (for example the purchase of school materials).
In addition to allowing the use of questionnaires on customer satisfaction a good indicator of quality, but not the only nor the most complete. In this sense, it is still possible to create composite indicators in the construction of indices, consisting of a defined set of attributes from the properties of the service.
Evaluation Process The evaluation process can be used as a means to determine the actual content of a public program, where he planned to achieve this was held to be defined for which it was intended and whether the benefits expected to be distributed intensity (Scheirer, 1994:40 ).