An assessment tool to measure civil society impact and participation

• In Event: Impact and Performance Measurement

Abstract

This paper presents the Civil Society Participation Index (SCPI), a tool to measure, monitor and strengthen the quality and impact of citizen participation in public policies in Uruguay. The application of a tool of these characteristics allows not only to evaluate a participation mechanism at a given moment, but also enables comparisons to be made between different fields. Its periodic application might also make possible to assess the progress or setbacks of civil society participation in public management.

Methodological design
The aim of the SCPI is evaluate mechanisms of institutionalized participation in which organized civil society takes part. The creation and development of the SCPI has included an exhaustive review of bibliography and similar initiatives, and it is the result of a participatory research process with contributions from a broad diversity of civil society organizations. The index proposes the evaluation of participatory mechanisms based on the analysis of three phases:
-- Phase 1 Design. Aspects related to the creation and planning of the mechanism, including the evaluation of the laws and procedures that regulate the mechanism, its established format, structure and resources, and its defined objectives.
--Phase 2 Implementation. The effective implementation of the planned mechanism is analyzed, evaluating the adequacy and quality of the formal aspects of the space vis-à-vis the purposes and scopes originally defined.
-- Phase 3 Results and impacts. The fulfilment of the objectives of the mechanism and its scope are evaluated in terms of results (outputs, short-term achievements), and impacts (long-term sustained effects) in relation to the mechanism working areas, as well as and on the participating institutions.

For the evaluation of these three phases, six dimensions, 18 variables and a battery of 42 indicators are defined, as well as the possible sources of information for each one. The type of information and the forms for collecting this information vary according to the type of indicator: secondary sources and opinions through self-administered questionnaires, consultations or personal interviews are used. As a result of the application of this tool, a total score or numerical rating is obtained for each mechanism space evaluated on a scale defined by ranges: weak, emerging, advanced or enabling space. The total score of the space is an indication of a situation and is accompanied by an in-depth analysis of the measurement carried out and the data obtained, giving an account of the current situation, the strengths and weaknesses identified, which makes it possible to define areas for improvement.

This paper includes the results obtained by the implementation of a first pilot test, an instance of great value both to make adjustments to the design of the tool and to the data collection devices. It also allows to evaluate its relevance, as well as to assess the feasibility and conditions necessary to carry out a process of this type.

References

CLAD (2009). Carta Iberoamericana de Participación Ciudadana en la Gestión Pública, Lisboa, CLAD.
Cunill, N. (1991), “Los posibles fundamentos de la participación ciudadana”, en Participación Ciudadana: Dilemas y perspectivas para la democratización de los estados Latinoamericanos, Caracas: CLAD.
Universidad de Cuyo (s.f.), Instrumentos de participación ciudadana. Cuyo: UNCUYO.
Ziccardi, A. (Coord.) (2004), Participación ciudadana y políticas sociales del ámbito local. México: UNAM
Ziccardi, A. (Coord.) (2004), Participación ciudadana y políticas sociales del ámbito local. México: UNAM

Authors

• Anabel Cruz, Instituto de Comunicacion y Desarrollo (ICD)

• Analia Bettoni, Instituto de Comunicación y Desarrollo (ICD)