Constituent Voice

Constituent Voice is a performance management and measurement method designed as a continual improvement process developed by Keystone Accountability to enable organisations addressing social issues to improve their results by improving relationships with their constituents. Like customer satisfaction measurement, which it draws from, Constituent Voice treats measurement as an aspect of an intervention that not only provides metrics but contributes directly to outcomes by increasing the engagement of intended beneficiaries.

History

Based on four years of field research, from 2008 it was called Constituency Voice. The organization that led the field trials, Keystone Accountability, first published the first technical describing the method, then called Constituent Voice, in 2013. A revision of the original technical note was published in September 2014. ^[1] Keystone sought and received a trademark for Constituent Voice in the United States in 2013. Constituent Voice™ is licensed under the Creative Commons Attribution-ShareAlike 4.0 International license.

Constituent Voice blends two important lines of thought in development.

The main theoretical influence comes from Amartya Sen and Jean Drèze, who locate individual human ‘agency’ at the heart of development. Sen’s great synthesis work, Development as Freedom,^[2] concludes that development cannot be reduced to material well-being. Development is best understood as a package of overlapping political and economic mechanisms that progressively enable the exercise of freedoms that allow people to meet their basic needs and in other ways set the courses of their lives.

The other intellectual debt acknowledged by Constituent Voice literature is to the work of Albert O. Hirschman on the nature of choice under limited choice conditions.^[3] Hirschman observed that when faced with unsatisfactory performance from an organisation, people might decide not to exit but to ante up – to engage to improve the organisation. Hirschman called this Voice.

Constituent Voice metrics track Voice and Agency (among other things) and show how they can become essential assets for development service providers. A core claim of the Constituent Voice method is that its “relationship metrics” can be refined to accurately predict social outcomes, thereby providing real-time indicators that organisations can manage to in order to improve their performance and results.^[4]

A growing number of US national and international organisations are promoting Constituent Voice. The world’s largest charity rating agency, Charity Navigator, incorporated Constituent Voice into its 2013 revision of its rating system, Results Reporting. ^[5] Specifically citing Constituent Voice, the influential annual trends forecast by Lucy Bernholz, Philanthropy and Social Economy: Blueprint 2014, highlights “constituent feedback” as a key trend going forward.^[6] The global business management consulting firm, McKinsey and Company, cited Constituent Voice as number one of five “best practices” for foundations seeking to “make assessment work”. ^[7]

Overview of method

Constituent Voice is akin to other recent innovations in measurement and project evaluation systems such as Outcome mapping, Utilisation-Focused Evaluation, and Most significant change technique in that it values measurement for its usefulness. It complements these and related approaches in its focus on measuring relationship quality – especially relationships with the intended beneficiaries – and using these metrics to drive change in organisational practice.

When asked in 2011 to explain why he championed Constituent Voice, the President of Oxfam America Ray Offenheiser, said “At its heart, Constituent Voice method promises to shift the very power to define ‘success’, and to declare when it has been achieved, into the hands of those that development organisations claim to serve. This shift toward greater agency is essential if we are to make development more effective.”^[8]

Constituent Voice method has five steps, all of which must be completed.

Design

Designing feedback systems involves balancing four principles: (1) Rigour; (2) Sensitivity to Process and Culture; (3) Cost and (4) Utility. Oftentimes statistical rigour is elevated as a “gold standard” in surveys, but Constituent Voice emphasises that failing to account for sensitivity, cost, and utility are equally important ingredients in the effectiveness of a feedback system.

Collect

For Constituent Voice, administering surveys is not simply about getting answers to questions; it’s about building a relationship with constituents so that they feel respected, consulted, and engaged in the process. As such, data collection begins by explaining the survey’s intended purpose so respondents understand the intentions, goals, and implications of their participation.

Constituent Voice uses a combination of continuous micro-surveys and periodic, high-quality, in-depth research.

Analyse

Constituent Voice uses descriptive statistics to develop clear and visually powerful data reports.

Typically Constituent Voice analysis segments respondents based on individual characteristics and survey response (like Net Promoter), to make it easier to use the analysis to develop corrective actions and strategies. In particular, you can identify course corrections that fit with different segments of an organisation’s constituents, including non-respondents.

Constituent Voice also looks for the predictive quality of its metrics by triangulating answers to surveys against other data sets providing measures of outcomes. For example, education studies have found that student feedback accurately predict patterns of learning gains associated with that teacher, including in other classrooms and in subsequent years. ^[9]

Benchmarking is another important analytic tool used by Constituent Voice to better understand the results for any particular survey by comparing answers with the answers received to the same questions by another organisation.

Dialogue

Survey findings are inherently limited. Using survey findings to inform dialogues with respondents and others significantly extends their explanatory power. These dialogues allow validation of findings, deepen their interpretation, and agree possible solutions. Constituent Voice method emphasizes mutuality across constituents of a problem and the co-creation of solutions.

Course Correct

Constituent Voice advocates a short cycle iterative “trial and error” approach to introducing change in organisational practices. It is important that organisations inform constituents of any corrective actions so that respondents to future surveys can provide informed views.

Criticism of Constituent Voice

A critical literature on Constituent Voice is yet to emerge. Since it consciously emphasizes utility, it is likely to attract the criticism that it is more concerned about performance management than accurate measurement. As such, it should not replace traditional metrics but complement them. Keystone Accountability co-founder David Bonbright has often been quoted as saying that “Constituent Voice is the most neglected important piece of the measurement puzzle. Not the only important piece, but the most neglected one.” ^[10]

References

^ "Constituent Voice: Technical Note 1 (Version 1.1)". Keystone Accountability. Retrieved 2014-09-01.
^ Sen, Amartya (1999). Development as Freedom. Oxford University Press. ISBN 978-0-19-829758-1.
^ Hirschman, Albert O (1970). Exit, Voice, and Loyalty. Harvard University Press. ISBN 978-0-67-427660-4.
^ Peña, Maria. "The Search for a Predictive Indicator". LIFT. Retrieved 2014-09-01.
^ "Results Reporting Concept Note: The Third Dimension of Intelligent Giving" (PDF). Charity Navigator. Retrieved 2014-09-01.
^ Bernholz, Lucy (2013-12-04). "Philanthropy and the Social Economy: Blueprint 2014". Grantcraft. Retrieved 2014-09-01.
^ "Learning for social impact: What foundations can do" (PDF). McKinsey and Company. 2013-04-01. Retrieved 2014-09-01.
^ "Technical Note 1: Constituent Voice" (PDF). ALNAP. Retrieved 2014-09-01.^{[permanent dead link]}
^ "Learning about Teaching: Initial Findings from the Measures of Effective Teaching Project", MET Project Policy Brief, The Bill and Melinda Gates Foundation: 5, December 2010
^ "Ringing out 2013 and a modest overture for 2014". Keystone Accountability. 2013-12-20. Retrieved 2014-09-01.

External links

Keystone Accountability Official Website

[1] "Constituent Voice: Technical Note 1 (Version 1.1)". Keystone Accountability. Retrieved 2014-09-01.

[2] Sen, Amartya (1999). Development as Freedom. Oxford University Press. ISBN 978-0-19-829758-1.

[3] Hirschman, Albert O (1970). Exit, Voice, and Loyalty. Harvard University Press. ISBN 978-0-67-427660-4.

[4] Peña, Maria. "The Search for a Predictive Indicator". LIFT. Retrieved 2014-09-01.

[5] "Results Reporting Concept Note: The Third Dimension of Intelligent Giving" (PDF). Charity Navigator. Retrieved 2014-09-01.

[6] Bernholz, Lucy (2013-12-04). "Philanthropy and the Social Economy: Blueprint 2014". Grantcraft. Retrieved 2014-09-01.

[7] "Learning for social impact: What foundations can do" (PDF). McKinsey and Company. 2013-04-01. Retrieved 2014-09-01.

[8] "Technical Note 1: Constituent Voice" (PDF). ALNAP. Retrieved 2014-09-01.^{[permanent dead link]}

[9] "Learning about Teaching: Initial Findings from the Measures of Effective Teaching Project", MET Project Policy Brief, The Bill and Melinda Gates Foundation: 5, December 2010

[10] "Ringing out 2013 and a modest overture for 2014". Keystone Accountability. 2013-12-20. Retrieved 2014-09-01.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

History

Overview of method

Criticism of Constituent Voice

See also

References

External links