Ex-post Evaluation

1-1 Background of the Project:

Within the broader framework Argentina's reform of the state and with the purpose of improving management efficiency, the process of improving the National Statistics System (SEN) includes improving macroeconomic information, data on productive sectors, level of employment, evolution of poverty, economic sectors and social prices.

Consequently, the National Institute of Statistics and Census (INDEC) is currently executing a Technology Modernization Plan with the aim of incorporating into its work programs the technologies that will make it possible to obtain timely and appropriate information, as demanded by society from an organization with the characteristics of this Institute, with the objective of improving the quality and quantity of information as a public asset.

Since the Technology Modernization Program was not progressing as planned, due to a lack or deterioration of equipment and in view of the need for trained human resources to that end, the Government of Argentina requested assistance from the Government of Japan, centered on population statistical information comprising the technology for processing, supply and analysis of statistical information, donation of equipment and training of staff.

1-2 Project Overview:

The objective of the project was to establish a population statistics information system, with the aim of contributing to the rational development and implementation of social welfare policies for the population. To that end, the following activities were executed: 1. Establish of data base on population statistics and geographical information system. 2. Development of preparatory activities for the 2000 Census of Population and Housing; and 3. Development of a comprehensive program of professional training for human resources employed in statistical activities.

The Local Advisor has conducted an ex-post evaluation of the same, with the purpose of assessing the impact and maintenance of the activities and outline lessons and recommendations to further refine national programs and especially for the planning of similar projects. The evaluation was based on the administration of a questionnaire and interviews conducted with respondents responsible for the project in the model areas (provinces of Chubut, Misiones, Santa Fe, San Luis and Salta); and external users of the information. The criteria used in the evaluation were: impact (including positive and negative aspects and influencing factors) and sustainability (comprising influencing factors).

(1)Overall goal:

The project's overall goal is to establish a system of population statistical information, to contribute to the rational development and implementation of social welfare policies for the population, in particular in the area of health.

(2)Project Purpose:

Improved population statistics system.

(3) Outputs:

1. Start up a data base of population statistics and geographical information system.
2. Development of preparatory work for the 2000 Census of Population and Housing; and
3. Development of a comprehensive professional training program for the human resources involved in statistical work.

(4)Inputs

Japanese side:

Argentina side:

3-1 Summary of evaluation results

(1) Impact

The results of this evaluation show a high level of achievement. The whole (100%) of the informers (xx respondents) agree that the benefit provided by the project is undisputable. In connection with the project's positive effects, the following may be highlighted:

• Updated statistics with universal coverage derived from the last national census.
• Creation of a novel work dynamics, in line with the standards currently deemed necessary for the maintenance of a population statistics system.
• Strengthening of the human resources involved in the SEN, by providing training and experience in programming and executing tasks, and a complete training system of a technical and conceptual type.
• Guaranteed use of advanced material resources (hardware, software, virtual classroom), that made it possible to leverage past data (1991 census) and expedite the processing and dissemination of the data of the last national census.

The above aspects had unexpected positive effects, given the difficult socioeconomic environment that was experienced at the time of the last national census. In that regard, informants agree that thanks to the gains in terms of work dynamics, integration and knowledge among the various SEN technical teams (INDEC, provinces) it was possible to deal with the constant budget adjustments, institutional changes and the unexpected replacement of part of the teacher staff that was included in the census structure (who resigned their jobs a just few days before the survey date), in an appropriate manner.
A synergy effect of the strengthening of the human and material resources, thanks to the project also relates to the agility and variety of information dissemination, a task that was carried out on multiple platforms (virtual, magnetic, printed) and scenarios (education institutions, external users, government agencies).
Informers did not highlight any negative aspects related in themselves to the project execution.

(2) Sustainability

The counterpart maintained the results, activities and services under the project in the following areas:

• Efficient maintenance and orderly update of the Project's hardware and software.
• Updated data base and completion of surveys that complement the last national census.
• Continuation of the personnel training initiatives.
• Continuation of the tasks contemplated in the framework of the methodological exchange among Mercosur countries.

3-2 Factors that have promoted project.

(1) Factor linked to planning:

• The various institutions comprised in the SEN maintained a close and efficient relation at all times.
• The training beneficiaries remained in their jobs in spite of the temporary transfer of the last census of population, households and housing.

(2) Factors linked to the implementation process:

• The technologies transferred are being extended to new employees and recent interests of the counterpart.
• Technical Assistance from a country which is so different as Japan, provided sufficient support to consolidate the Project and overcome many of the obstacles confronted in the receiving country.
• The information and awareness activities done before the execution of the census resulted in a good response from the citizenship in general

3-3 Factors inhibiting sustainability and impact

(1) Factors linked to planning:

A substantial part of the project unfolded in a socioeconomic context which is unprecedented in Argentine history. This undermined local political support that resulted in delays in administrative and financial aspects. In said environment, the 2000 population census had to be postponed twice, and was carried out on November 17 & 18, 2001.

(2) Factors linked to the implementation process:

The deferment in the confirmation of the budget necessary for the census caused several problems, like the increase in personnel costs, the necessity of adjustment in census graphics, etc.

3-4 Conclusion

The Project's ex-post evaluation is highly satisfactory. A little over four years after its closing, there is a formidable volume of information available with various levels of geographic breakdown.
There is a provisional data base from the last national census, that provides both internal and external SEN users with quick access to the available information.
An unprecedented agreement was reached at the international level with the Mercosur countries, Bolivia and Chile, that will make it possible to obtain a common information data base and homogenous methodologies.
There is an efficient network communication system linking the various members of the SEN, being kept updated in spite of budgetary restraints. The IT system supplied by the Project is also being maintained thanks to the efforts of the counterpart's highly qualified technical resources. In the field of IT, the design of a more agile population data base is underway, to provide better access to private and public users.
In the field of training and enhancement of human resources, a permanent system that offers special courses and comprehensive programs has been established, with a national and international scope. One of the project's most relevant successes is having created a critical mass of skilled human resources, who remain in their jobs, and constitute a source of dissemination of knowledge to other government areas and other countries in the region.

3-5 Recommendations

• The applications developed, thanks to the project, in the fields of demography, information technology and training of human resources, constitute a successful experience that can be replicated in the future or recommended for use by other developed countries, in their assistance plans to countries with lower relative development levels.
• The lack of possibility of extending the project beyond the planned five years should be seen as a limitation, to be reviewed in future projects.
• The partnering scheme between the counterpart and the Government of Japan should be retained in future initiatives in the area of statistics, both at the national and international level.
• Finally, it would be recommendable to carry out a research on the effects of the project on the Japanese experts involved, to have a vision complementing that provided by the counterpart.

3-6 Lessons Learnt

• The exchange between both countries was very positive. The technical assistance and financial support granted by the Government of Japan has been relevant for the counterpart and, therefore, for Argentina.
• Identifying a single overarching objective and adjusting all activities to its achievement has been very useful. The activities conducted gave rise to technologies (GIS data base setting-up methods) and methodological procedures (preliminary tasks organization in order to implement the population census – for instance to perform tasks which have been planned 5 years beforehand) that are currently universal, which allows them to be applied in other statistics projects.
  The consolidation of a sound team of professionals has contributed to overcoming the obstacles represented by Argentina's institutional, political and economic crisis.

3-7 Follow-up Situation

From JFY 2003, a Regional Training Course in Population Statistics under JICA's Third Country Training Program is being implemented, with a period of 5 years.