To measure if your ToC is working requires you to know if outcomes are being reached as originally predicted. The only way to know this is to monitor them for evidence of change, and this requires stakeholders to identify indicators/metrics which they agree demonstrate that an activity is (or is not) leading to the change sought.
These indicators may be ‘observable’ or ‘unobservable’. Observable indicators are those we can build into the ToC and control for (for example, demography, observed behaviour and measured attitudes). Unobservable indicators may influence the outcome, yet are not known about or can’t be measured (for example, unmeasured attitudes, unobserved behaviours or undisclosed attitudes).
Those facilitating discussions for the identification of ToC indicators or metrics should ask stakeholders:
- What indicators (observable or unobservable) would demonstrate that change is occurring towards (or away from) the outcomes sought?
- Can the indicators be gathered as some sort of evidence or data (qualitative or quantitative)?
- How and who will collect such evidence?
- At what point (threshold) in the evidence can it be concluded/agreed that the intended change (outcome) has been achieved?
- At what point can an activity stop or start based on indicator evidence?
- When should outcome indicator data for all outcomes be conducted, completed (short, mid and long- term) or shifted between indicators at different stages of the project/program?
- Are there agreed time estimates for how long it will take for activity/interventions to produce the desired effects/impacts and what happens if times are shorter or longer than predicted?