Skip to main content

3. Managing and evaluating the portfolio for impact

Monitoring

The ex-ante DELTA impact assessment is just the beginning. In addition to the results matrix, which includes key indicators and targets, each project has a monitoring and evaluation plan that specifies the frequency, methods, sources, and responsibilities for data collection and analysis.  As part of the annual supervision exercise that integrates both financial and impact performance, the DELTA Project Score is updated to reflect actual performance toward achieving impact targets set in the results matrix. Changes in project DELTA scores are factored into the overall tracking of portfolio-level progress toward delivering development outcomes. Similarly, the expected SDG contributions of each project in supervision are updated annually.

Impact measurement & evaluationMonitoring graphic

IDB Invest conducts a mandatory final self-evaluation for each operation in the portfolio. This evaluation compares the expected and actual impact of each project through a systematic assessment of its relevance, efficiency, effectiveness, and sustainability, as well as the main lessons learned. The final performance rating of each evaluation is validated by the IDB Group’s independent Office of Evaluation and Oversight. The lessons learned from these evaluations are classified and stored in our knowledge management system to feed into the design of new operations.

In addition, to further build the impact evidence base, we select some investments for more in-depth evaluations, including impact evaluations with proper experimental/quasi-experimental design. By generating and sharing rigorous causal evidence about what works and does not work from our investments, we can help bolster the effectiveness of our private sector clients and the broader impact investing industry as it continues to grow. Because impact evaluations are complex and costly, we focus these efforts on a strategically selected sample of our portfolio. 

We select impact evaluations based on four key criteria:

  1. Will the knowledge generated be relevant for the markets and industries we target? Impact evaluations should focus on bridging the knowledge gaps identified in particular sectors.
  2. Is the project representative of existing or potential lines of business? The more representative it is, the more widely we will be able to apply and disseminate the knowledge we accumulate and the good practices we identify.
  3. Does the project involve innovative business solutions with a development impact? By learning which solutions work—and, just as importantly, which ones do not—we can add value and help clients and impact investors implement the most effective ones.
  4. How relevant is the project? Sometimes the sheer size or prominence of an investment demands a thorough evaluation. This provides greater accountability to stakeholders and can inform public policy.

* A note on attribution of results to our own funding. Attributing results to the specific financial contribution of an individual entity participating in a project presents significant challenges. Even when we are able to determine causality in terms of a project’s results, pinpointing the portion of the effects attributable to a specific financial contribution requires several assumptions that reduce the credibility of the exercise. This is why IDB Invest does not specifically attempt to attribute any portion of the observed results to any particular source of funding.

Finally, we also work with clients in the early stages of an investment to test whether an innovative product or approach is effective before scaling it up. For example, we design structured experiments (which may include A/B testing) or support data collection and analysis (for example, surveys with potential end-beneficiaries or focus groups) to measure impacts or anticipate potential impacts quickly and inform client decision-making. In turn, these actions can help strengthen the project’s implementation and development impact. 

4 and 5. Impact Analytics, Learning and Dissemination

Impact analytics

Our Development Effectiveness Analytics (DEA) platform visualizes data collected by the DELTA to help us analyze how the portfolio is evolving. Dashboards at the approval and supervision stages provide management with real-time data to inform decision-making. Additional dashboards capture portfolio-level SDG contributions. The DEA also includes a repository of lessons learned from completed operations, showcasing which projects succeeded or failed in meeting their objectives and why. Lessons are then fed into current or new projects.

Impact dissemination

Ensuring that we share the knowledge and learning generated from our operations and evaluations with clients, investors, and within the IDB Group is a cornerstone of our Impact Management Framework. IDB Invest publishes the results of our impact evaluations, sector knowledge gap analyses, and other studies in the Development through the Private Sector peer-reviewed technical note series. We distill study results further through concise two-page summaries (DEBriefs) and blogs (Sustainable Business).  In addition, we publish the SDG-aligned results and impact of our projects annually in the IDB Group’s Development Effectiveness Overview. Knowledge sharing also involves working with clients to impart practical knowledge about how to measure and manage impact and other advisory services.

Meet Our Expert:

Alessandro Maffioli is Head of the Development Effectiveness Division of BID Invest. During his 12 years of experience in the IDB Group, Alessandro has coordinated several impact evaluation projects for agricultural development, technology and innovation, small and medium enterprises, and access to credit.

Previously, he worked for five years at the Center for Latin American Studies and Transition Economies of the University of Bocconi, where he specialized in economy of innovation and regional economy. Alessandro holds a PhD in Production and Development Economics from the University of Insubria, in Italy.

Contact: alessandrom@idbinvest.org