Wikipedia:Wikimedia Strategy 2018–20/Evaluate, Iterate, and Adapt
 | This page is currently inactive and is retained for historical reference. This page supported discussions in January and February 2020 (see summary of conversations). Please see updates at meta:Movement Strategy. |
| Evaluate, Iterate, and Adapt | ||||
| Previous | Narrative of Change | Principles | Glossary | Next |
This recommendation proposes the idea of underpinning our Movement with continuous processes to analyze our ecosystems, raise awareness on their current state, and plan for our continued growth. It is foundational to all other recommendations, as, without analysis of where we are and how we do things, we cannot adjust and make changes to guarantee our future growth and sustainability.
Intro section
[edit]These pages describe a major discussion process currently taking place at the website for Wikimedia.
If you wish to add comments to the main discussions for this process at that website, here is the link where you can do so:
- Link to main page at Wikimedia website:
What
[edit]In order to “become the essential infrastructure of the ecosystem of free knowledge,” as a Movement, we need to continually evaluate our progress toward our internal and external goals to be able to dynamically iterate, adapt, and upgrade our socio-technical processes and structures. This will allow us to remain flexible in dynamic contexts and to ensure our programs and actions are well-directed and efficient.
We must evaluate all the areas, including content coverage, community and governance diversity and inclusivity[1], skills development, partnership impact, technology efficiency, and platforms’ usability and accessibility. Results must be widely and clearly communicated across the Movement to increase self-awareness and accountability among all stakeholders, allowing us to adapt our strategies accordingly.
Why
[edit]As we are planning to create or reorientate new structures and processes to reach our 2030 goals, we must develop comprehensive methods to evaluate whether the path we are taking is leading us in the right direction. Today, the Wikimedia Movement insufficiently evaluates its contents, programs, and processes, making it difficult to identify strengths, weaknesses, opportunities, and threats, preventing stakeholders from advancing towards both efficiency and impact.
To date, efforts to map and build capacity for Movement stakeholders have been ad hoc and un-sustained. The strategic direction requires new thinking, skills, and structures to build evidence-based best practices to document, sustain, and evaluate the progress or failures of programs, including for capacity building and skill development programs, over the long term.[2]
How
[edit]To overcome the current barriers to growth, we recommend an approach based on several actions. We must develop methodologies to account for meaningful learning and sharing of experiences across our Movement. These methodologies involve planning, evaluation, dissemination of results, and iterations of processes to improve our Movement direction.
Programmatic and project planning will include systematic evaluation as an integral part of the process, as preconditions to adapting to changing environments, and to the improvement of our overall work. Evaluation needs to be incorporated into decision-making at all institutional levels. Planning for adequate resources, skills development, and capacity needs will be necessary to create meaningful evaluation processes.
The evaluation processes should occur at and across all levels, to verify whether our work is making progress toward achieving our strategic goals. Evaluation processes should also be adapted to the capabilities of the different communities (i.e. not be time-consuming, easy to put in place, supported by resources). This process ends with the dissemination of knowledge. Any evaluation, iteration, and change must be stored in the knowledge management system, accessible and communicated to the entire Movement, in order to raise awareness, amplify its effects, and help others avoid duplication of efforts.
The results from the evaluation must be disseminated and discussed with all involved stakeholders. For example, verifying that an improvement in the registering process / user page creation has increased user retention in a particular language edition must be communicated to the corresponding language community. The results from the evaluation must provide the necessary data to understand the context and elements involved in the system or part of the system examined[3]. Including the people who may benefit from the change that is evaluated, whether it is the current community, new participants, or other groups of users, allows what was learned to be better understood with potentially greater impact within other projects who can learn from and adapt the results[4]. Every evaluation must be adapted to achieve its intended goals.
Expected outcomes
[edit]Evaluation:[5]
- Establish clear criteria for evaluation based on our goals: impact, inclusive user experience, people-centeredness, and equity to facilitate planning and decision-making at all levels for our growth and sustainability.[6]
- Establish mechanisms to clarify mutual accountabilities for any stakeholders within the Wikimedia Movement.[7]
Iteration:
- Monitor progress on implementing equity in the Movement by evaluating diversity[4] and newcomer inclusion[8] as fundamentals of participation in the Movement.
- Evaluate strategic changes to make sure that both the current communities and future diversity of profiles are always taken into consideration as we implement strategic recommendations.[9]
- Provide evaluation with resources and experts on any given area.[10]
- Develop a comprehensive evaluation system for capacity building in order to allow stakeholders to understand and value their progress and feel supported in their inclusion.[10]
- Iterate processes that propose changes in technology, policies, and governance systems to promote validation through research and testing.[4]
Adaptability:
- Adopt policies and procedures based upon evaluations of the changing world and the changing Movement to meet new and altered situations and challenges.
- Increase the flexibility and adaptability of the structures and approaches we develop.[11]
- Plan, budget, and invest in research to make adjustments as required for improvements, innovations, and impact.[4]
References
[edit]- ^ Capacity Building R6: Evaluating Capacity Building
- ^ Tanzania Strategy Salon, June 2019, Resource allocation thematic area, Catalan Strategy Salon, September 2019, Product and technology thematic area
- ^ Egypt/Spain Strategy Salon community conversations, June 2019, Capacity Building thematic area
- ^ a b c d Diversity R2: Reaching a self-aware and dynamic structure
- ^ Community Survey Analysis: Resource Allocation: “numerous responses about accountability”.
- ^ Partnerships R1: Provide the knowledge needed for understanding and solving global issues, Community Survey Analysis: Product & Technology, Q2, “gentle introduction of changes”, Diversity R2: Reaching a self-aware and dynamic structure, Roles & Responsibilities R1: All of this exists to support our primary purpose
- ^ Roles & Responsibilities R6: Wikimedia Movement organisations
- ^ Community Health R6: Newcomers are a key indicator to the success of the Movement
- ^ Community Survey Analysis: Product & Technology, Q2, “gentle introduction of changes”, Diversity R2: Reaching a self-aware and dynamic structure
- ^ a b Capacity Building R6: Evaluating Capacity Building
- ^ Resource Allocation RF: Ensure flexible approach to resource allocation, Advocacy R2: Diversity