Monitoring va baholash muammolari

Ko'pgina notijorat tashkilotlar va xalqaro nohukumat tashkilotlar monitoring va o’rganib chiqish imkoniyatlariga ega dasturiga ega bo'lishi mumkin bo'lsa-da, ular ko'pincha natijalarga asoslangan tizim atrofida ishlab chiqilgan bo’ladi. Natijalarga asoslangan tizim ko'pincha turli dasturlar o'rtasida chambarchas bog'langan va loyihani boshqarishga qaratilgan bo'lib, faoliyat va chiqish natijalarini yig'ishga asoslanadi. Ushbu tizimlar monitoring va baholash muammolariga ega, chunki ular ko'pincha faoliyat va natijalarni boshqarish uchun juda sodda yoki juda murakkabdir. Ular oddiy ma'lumotlarni yig'ish, vizualizatsiya va hujjatlarga e'tibor qaratagan holatda ishlaydi. Ko'pgina monitoring va baholash tizimlari natijalarni muntazam ravishda umumlashtirish uchun kengaytiriladigan yechimlarni taqdim eta olmaydi.
Bu holatlarni inobatga olgan holda monitoring va baholash tizimlarini tanlashda yo‘l qo‘ymaslik kerak bo‘lgan sakkizta eng yomon xatolarga to‘xtalib o‘tamiz.
Ushbu maqola eng keng tarqalgan monitoring va baholash muammolarini tavsiflaydi va ularni bartaraf qilish uchun chuqur yechimlarni beradi.
Monitoring va baholash muammolari
Birinchi navbatda monitoring va baholashdagi eng qiyin to'siqlardan boshlash va ularni qanday hal qilishyo’llari qadam ba qadam ko'rsatilgan.
1. Monitoring & Baholash - bu hashamatli
Bu noto'g'ri tushuncha haqiqatdan uzoqroq bo'lishi mumkin emas! Ijtimoiy ta'sir dunyosida ta'sirni o'lchash hashamatli va moliyachini qondirish uchun zarur bo'lgan yomonlik degan noto'g'ri tushuncha mavjud . Men sizga oshxonadagi lavaboni shunday uloqtirgan juda ko'p ijtimoiy tadbirkorlarni uchratdim.

• 
  Biz allaqachon ijtimoiy manfaatlar qilayotganimizni bilamiz; nega biz o'lchashimiz kerak?
  
• 
  Biz birinchi bosqichdagi ijtimoiy korxonamiz, biznes modelini yaratishda zo'rg'a kurashamiz; o'lchov keraksiz yukdir.
  
• 
  Hech kim ta'sirni o'lchash uchun pul to'lamaydi.
  

Ushbu dalillarning aksariyati o'z-o'ziga xizmat qiladi yoki ta'sirni o'lchash orqasida fundamental tushunchaning etishmasligini ko'rsatadi.
Bizning avvalgi blogimiz, SDG 3: Mobil sog'liqni saqlashni dalillarga asoslangan ta'sirni o'lchash orqali ko'lamini kengaytirish, qancha mobil sog'liqni saqlash loyihalari pilot darajada qolayotganini tasvirlaydi. Biroq, Hindistondagi sog'liqni saqlash tashkiloti ta'sirni o'lchashni sinchkovlik bilan integratsiyalashgan holda butun shtat bo'ylab dasturni kengaytira oladi. Mana bir maslahat - tizimli ma'lumotlarni to'plash va jamoatchilikni jalb qilish bilan puxta ishlab chiqilgan, iterativ jarayon sehrli bo'lishi mumkin.
Janubiy Afrikada monitoring va baholash muammolari
2. Ma'lumotlarga ishonchning yo'qligi
Ko'pgina hisobot ma'lumotlari kongress yoki kengash a'zolari har bir xalqaro rivojlanish loyihasi yoki jamg'arma hisobot berishni talab qilganligi sababli to'planishini aniqlash uchun donorlarning buyrug'i bilan milliardlab dollarlar sarflanmoqda. RCT, so'rov ma'lumotlarini to'plash va boshqalar bilan juda qimmatga tushadi. Bu zaruriy yomonlik bo'lsa-da, donorlar bilan ishonchni yaratishda deyarli foyda keltirmaydi. Markazdagi manfaatdor tomonlar bilan ta'sirni boshqarish amaliyoti uchun barni oshirish moliyachilar (aktivlar egalari, aktivlar boshqaruvchilari) va manfaatdor tomonlarga (aktivlarga) yaqin ishlaydigan tashkilotlar o'rtasida yaxshi muvofiqlikni yaratadi. Bu jarayon ta'sir madaniyati va natijalarni moslashtirish, ta'sirni o'lchashning yaxshiroq tilini va manfaatdor tomonlarning ta'sirini yaxshilash uchun ma'lumotlar madaniyatini yaxshilash bo'yicha kelishuvni talab qiladi.
3. O'zgarishlarga asoslangan ma'lumotlarni yig'ishning etishmayotgan nazariyasi
Aksariyat tashkilotlarning ma'lumotlar to'plash strategiyasi mavjud emas yoki yo'q. Agar ular ma'lumot to'playotgan bo'lsa, ular odatda tashkilotning asosiy missiyasi va qarashlarini mos kelmaydigan va tasdiqlamaydigan faoliyat va chiqish ma'lumotlariga e'tibor berishadi. O'zgarish nazariyasi va ma'lumotlar yig'ish o'rtasidagi mos kelmaslik ijtimoiy o'zgarishlarni tushunish uchun eng muhim to'siqdir. Ushbu moslashuvsiz tashkilot NIMA, KIM, HISSA, QANCHA va XAVF ni anglay olmaydi - bu ijtimoiy ta'sirni tushunish va etkazishning muhim shartidir.]
Batafsil o'qing: Ta'sir investitsiyalarini o'lchash bo'yicha eng yaxshi amaliyotlar
Jarayonni amaliy va samarali qiling.
O'ZGARISH NAZARIYASI (TOC) TO HARAKAT NAZORIYASI O'zgarishlar nazariyasi (ToC) tashkilotingizning tashabbusdagi sabab-oqibat bog'lanishlarini (ya'ni, uning qisqa muddatli, oraliq va uzoq muddatli natijalarini) belgilash orqali ta'sir qilish uchun mo'ljallangan yo'lini tushuntiradi. Harakat nazariyasi ijtimoiy ta'sirni maksimal darajada oshirish uchun harakatga yaroqli yondashuvni belgilaydi.
4. Ma'lumotlar orollari va rudimentar ma'lumotlarni yig'ish
Dastur natijalari yoki natijalarini yaxshiroq tushunish uchun ma'lumotlarni yig'ish tizimi o'zgarishlarga asoslangan yondashuv nazariyasiga mos keladi.

• 
  Faoliyat va chiqish ma'lumotlarini qayerda to'playsiz?
  
• 
  Bu maʼlumotlar toʻliqmi?
  
• 
  Siz erishmoqchi bo'lgan asosiy natija nima?
  
• 
  To'g'ri o'zgartirish kiritayotganingizni qanday bilasiz?
  
• 
  Qanday qilib natijalarni umumlashtirish va qisqa vaqt ichida qimmatli tushunchalarni o'rganish mumkin?
  

Bu erda muammo shundaki, ko'pchilik tashkilotlarning ma'lumotlar yig'ish va dasturlarni boshqarish ma'lumotlar tizimi hamma joyda mavjud. Ko'pgina tashkilotlar hali ham natijalarni MS Excel, Google Spreadsheets yoki maxsus ma'lumotlar bazasi echimlarida to'playdi. MS-Excel va Google Spreadsheet-ga asoslangan yechimlarni sozlash va o'rganish oson bo'lsa-da, ko'plab cheklovlar mavjud -

• 
  Ma'lumotlarni ishonchli boshqarishsiz, tashkilotlar ma'lum vaqt davomida ma'lumotlar orollarini yaratadilar, bu esa ma'lumotlarni kuzatishni qiyinlashtiradi.
  
• 
  Ta'sir doirasi va ko'rsatkichlari yildan-yilga o'zgarib turishi mumkin, bu esa ma'lumotlarni boshqarishni qiyinlashtiradi.
  
• 
  Excelda ham, har bir voqea yoki maydon ma'lumotlari yig'ilgandan so'ng, kimdir ma'lumotlarni birlashtirishi va ko'p xatolar va vaqt qo'shib formulani qayta qo'llashi kerak.
  
• 
  Excel tabiatan o'zgarish nazariyasini tushunmaydi
  
• 
  Excel eng yaxshi tahliliy platforma emas
  

Oxir oqibat, odatiy tashkilot ta'sirni o'lchashning barcha maqsadlariga erishish uchun 4 dan 6 gacha turli xil vositalardan foydalanadi, bu vaqt va resurslarni sezilarli darajada isrof qiladi.
Yalang'och ma'lumotlarni o'lchash va tahlil qilish
Impact Cloud kengaytiriladigan, aniq ma'lumotlarni o'lchash va tahlilini ta'minlaydi

• 
  O'zgarishlar nazariyasi va ma'lumotlarni moslashtirish
  
• 
  Kengaytiriladigan ma'lumotlar ombori
  
• 
  Standartlashtirilgan natijalar va dalillar kutubxonasini integratsiyalash
  

Bizning yakuniy maqsadimiz MS-Excel / Google Sheet-ga asoslangan yondashuvni eskirgan qilib, Salesforce kabi platformaga qaraganda eng jozibali yechimni taqdim etish orqali ta'sirni o'lchash va boshqarishni soddalashtirishdir.
5. Zaif ta'sir doirasi ta'sirni namoyish qilish uchun to'siqdir
Tashkilotingiz roliga qarab, ko'plab ramkalar mavjud bo'lsa-da, natijalar doirasi, ta'sir doiralari mavjud bo'lsa-da, ehtimol siz ulardan birini boshlaysiz va uni ichki maqsadlarga erishish uchun o'zgartirasiz. Eng yaxshi ramka ko'pincha turli xil ta'sir ko'rsatadigan ekotizim ishtirokchilarini moslashtirishga yordam beradi. Ammo bugun qaerdan boshlaysiz? Barqaror Rivojlanish Maqsadlari (SDG) va IRIS va GRI kabi boshqa hisobot tizimlari kabi yangi global hisobot formatlari paydo bo'lgan bo'lsa-da, aksariyat tashkilotlar o'zlarining barcha ichki o'zgarishlar nazariyasini yoki o'lchash maqsadlarini global standartlar va tuzilma bilan moslashtirish imkoniyatiga ega emaslar.
6. Ijtimoiy ta'sirni o'lchashda manfaatdor tomonlarning ovozi yo'qligi
Ta'sirni o'lchashning asosiy maqsadi benefitsiar uchun yaxshiroq natijaga erishishdir. Bizning manfaatdor tomonlarimiz kimlar? Ijtimoiy qiymat xalqaro tamoyillariga ko'ra , manfaatdor tomonlar sizning faoliyatingizga ta'sir qiladigan va ularga ta'sir ko'rsatadiganlardir. Biroq, sizda manfaatdor tomonlarning foydalanuvchi tajribasi yoki qoniqish yoki noroziligini bildiradigan tizim bormi?

• 
  Qancha benefitsiarga xizmat ko'rsatganligi haqida xabar berish mantiqiy deb o'ylaymizmi?
  
• 
  Ehtiyojlar ko'pincha har qanday aralashuvdan oshib ketganda, bolalarga ovqatlanish soni haqida xabar berish mantiqiymi?
  

Siz javob berishingiz kerak bo'lgan haqiqiy savollar:

• 
  Quyosh fonaridan qancha foyda oluvchilar foyda ko'rgani haqida gapirmang. Buning o'rniga, ularning qanchasi yangi xariddan xursand yoki norozi ekanligi haqida gapiring?
  
• 
  Ular ishdan qoniqish bildirishyaptimi?
  
• 
  Ular haqiqatan ham yangi kreditlash dasturi bilan natijalarni yaxshilashga qodirmi?
  

7. Donorlarni moliyalashtirishga ta'sirini bildirish qiyin
Qaror qabul qilishda moliyachilar uchun eng muhim to'siq moliyalashtirish va haqiqiy ta'sir o'rtasidagi ko'rinmaslikdir. Yaxshiroq ta'sir dalillari orqali ta'sir kapitalini taqsimlashning eng yaxshi usulini taqdim eting.

• 
  Yaxshiroq benefitsiar ovozi va manfaatdor tomonlar orqali maʼlumotlar masofasini kamaytiring
  
• 
  AI-ga asoslangan ma'lumotlar tahlili va ta'sir ko'rsatish ko'rsatkichlari kartasi bilan integratsiya
  
• 
  Taqsimlangan va ajratilgan ierarxik tashkilotlar uchun keng ko'lamli ma'lumotlar integratsiyasini ta'minlash orqali moliyalashtiruvchi va manfaatdor tomonlar o'rtasidagi masofani qisqartiring
  
• 
  Ta'sirni isbotlovchi eng yaxshi yondashuvni yarating
  

Ta'sir ekotizimini birlashtirish: ta'sirni oxirigacha boshqarish

• 
  2020 yilda ta'sir qiluvchi investitsiya tendentsiyalari.
  
• 
  Samarali notijorat ijtimoiy ta'sir hisoboti
  

8. Custom va Configure
Moslashtirish qimmat, moslashuvchan emas, vaqt talab qiluvchi va murakkab
Korporativ hamkasblardan farqli o'laroq, ta'sir ko'rsatadigan ekotizim tashkiloti yanada kengaytiriladigan va keng qamrovli echimlarga muhtoj. Yuqoridagi barcha to'siqlar bu savolga javob beradi. Agar biz moslashuvchan, keng qamrovli, sozlanishi mumkin bo'lgan tizimga ega bo'lsak, biz kamroq resurslar bilan o'zgarishlarga asoslangan ta'sirni o'lchash nazariyasiga ega bo'lishimiz va barcha manfaatdor tomonlarning bir xil stolda bo'lishi mumkin. Ta'sir buluti - Excel va moslashtiriladigan ilovalar platformalarini (masalan, Salesforce) ta'sirni o'lchash uchun eskirgan qiladigan eng innovatsion platformalardan biri.

While many nonprofits and INGOs may have Monitoring and Evaluation software, often, they are designed around a results-based framework. The results-based framework is often tightly coupled between different programs and focuses on project management, emphasizing collecting activity and output results. These systems has monitoring and evaluation challenges like they are often too simplistic to manage activities and output results or are too complicated. Either they focus on simple data collection, visualization, and documentation. Or some are sophisticated but overly complicated, with lengthy implementation, difficult to improve once implemented, and takes a long time to implement. Most monitoring and evaluation systems fail to provide scalable solutions to aggregate results regularly. Those that do may require a significant amount of customization or manual data aggregation.

So without further ado, let's dive into the eight worst mistakes to avoid when choosing monitoring and evaluation systems.
This article will describe the most common monitoring and evaluation challenges and give you in-depth solutions to overcome them.
Monitoring and Evaluation Challenges
So, let's start this with the most challenging obstacles in Monitoring and Evaluation and see how we can solve them! Step by Step -
1. Monitoring & Evaluation Is Luxury
This misconception cannot be further from the truth! In the social impact world, there is a fallacy that impact measurement is a luxury and necessary evil to satisfy a funder. I have met so many social entrepreneurs who throw the kitchen sink at you like this.

• 
  We know that we are already doing social good; why do we need to measure?
  
• 
  We are an early-stage social enterprise just barely struggling to build a business model; measurement is an unnecessary burden.
  
• 
  No one is paying for impact measurement.
  

Most of these arguments are so self-serving or demonstrate a lack of fundamental understanding behind impact measurement.
Our previous blog, SDG 3: Scaling Mobile Healthcare Through Evidence-Based Impact Measurement, describes how many mobile healthcare projects remain at the pilot level. However, a healthcare delivery organization in India can scale an entire program statewide with careful integration of impact measurement. Here is a clue - a carefully designed, iterative process with systematic data collection and community engagement can do magic.
Challenges of Monitoring and Evaluation in South Africa
2. Lack of data trust
There are billions of dollars being spent at the behest of donors to find that most reporting data are collected just because congress or board members require every international development project or foundation requires them to report, etc. Many of these program organizations take a long time and cost a lot with RCT, collecting survey data, etc. While this is a necessary evil, it is hardly useful in creating trust with the donors. Raising the bar for impact management practice with stakeholders at the center creates better alignment between funders (asset owners, asset managers) and organizations working close to the stakeholders (assets). This process requires a culture of impact & outcome alignment, a better language of impact measurement, and agreement on improving data culture to improve stakeholder-aligned impact. This is the single most missing reason for the lack of data trust and perhaps the most colossal waste of precious resources.
3. Missing theory of change driven data collection
Most organizations' data collection is either non-existent or missing robust data strategy. If they are collecting data, they often focus on activity and output data which usually do not align and validate the primary mission and vision of the organization. This lack of alignment between the theory of change and data collection is the most significant barrier to understanding social change. Without this alignment, an organization can't realize WHAT, WHO, CONTRIBUTION, HOW MUCH and RISK - a critical prerequisite of understanding and communicating social impact.]
Read More: Impact Investments Measurement Best Practices
Make process actionable and effective.
THEORY OF CHANGE (TOC) TO Theory Of Action Theory of Change (ToC) explains your organization's intended path to impact by outlining causal linkages in an initiative (i.e., its shorter-term, intermediate, and long-term outcomes). Theory of Action defines an actionable approach to maximize social impact.
4. Data islands and rudimentary data aggregation
To better understand program outcomes or results, the data collection system aligns with the change-based approach theory.

• 
  Where do you collect activity and output data?
  
• 
  Are these data complete?
  
• 
  What is the core outcome that you seek to achieve?
  
• 
  How do you know if you are making the right kind of change?
  
• 
  How can you aggregate results and learn valuable insight in a short time?
  

The challenge here is that most organizations data collection and program management data system is all over the place. Many organizations still collect results in MS Excel, Google Spreadsheets, or custom database solutions. While MS-Excel and Google Spreadsheet-based solutions are easy to set up and learn, there are many limitations --

• 
  Without robust data management, organizations create data islands over a period of time, making it difficult to track data.
  
• 
  Impact framework and metrics can keep changing year after year, making it challenging to manage data.
  
• 
  Even within excel, after every event or field data collection, someone must merge data and re-apply the formula adding lots of errors and time.
  
• 
  Excel inherently doesn't understand the theory of change
  
• 
  Excel is not the best analytics platform
  

Ultimately, a typical organization uses 4 to 6 different tools to achieve all the objectives of impact measurement, increasing significant time and resource wastage.
Lean Data Measurement & Analytics
Impact Cloud provides scalable lean data measurement & analytics, by

• 
  Theory of change & data alignment
  
• 
  Scalable data warehouse
  
• 
  Integrate standardized outcome & evidence library
  

Our ultimate goal is to make impact measurement & management simple by making MS-Excel / Google Sheet-based approach obsolete and providing the most compelling solution than a platform such as Salesforce.
5. Weak impact framework is a barrier to demonstrating the impact
While there are many frameworks - result framework, impact frameworks out there, depending on your organization's role, chances are you will start with one of them and modify it to meet internal goals. The best framework is the one that often helps align different impact ecosystem players. But where do you start today? While new global reporting formats such as Sustainable Development Goals (SDG) and other reporting frameworks like IRIS and GRI have emerged, most organizations do not have the capacity to align all their internal theory of change or measurement goals with global standards and structure.
6. Lack of stakeholder's voice in measuring social impact
The primary purpose of impact measurement is to drive a better outcome for the beneficiary. Who are our stakeholders? According to the principles of Social Value International, stakeholders are those who affect and are affected by your activities. However, do you have a system that communicates stakeholders' user experience or satisfaction or dissatisfaction?

• 
  Do we think reporting how many beneficiaries served makes sense?
  
• 
  Does it make sense to report the number of meals to children while needs often outstrip any intervention?
  

The real questions that you should answer are,

• 
  Don't talk about how many beneficiaries benefited from the solar lantern. Instead, talk about how many of them are happy or dissatisfied with a new purchase?
  
• 
  Are they expressing job satisfaction?
  
• 
  Are they truly able to improve outcomes with the new lending program?
  

7. Communicating Impact to Donor Funding Difficult
The most significant barrier for funders in deciding is a lack of visibility between funding and actual impact. Provide the best way to provide impact capital distribution through better impact evidence.

• 
  Reduce data distance through a better beneficiary voice & stakeholders
  
• 
  AI-based data analytics and integrate with actionable impact scorecard
  
• 
  Reduce the distance between funder and stakeholder by providing large scale data integration for distributed & disconnected hierarchical organizations
  
• 
  Build the best impact evidence approach
  

Uniting the Impact Ecosystem: End-to-End Impact Management

• 
  Some Impact Investing Trends to follow in 2020.
  
• 
  Effective Nonprofit Social Impact Reporting
  

8. Custom vs. Configure
Customization is expensive, non-flexible, time consuming, and complex
Unlike corporate counterparts, the impact ecosystem organization needs much more scalable and comprehensive solutions. All the above barriers sum up to this question. Only if we have a flexible, comprehensive, configurable system can we have a theory of change-led impact measurement with fewer resources and have all the stakeholders at the same table. Impact Cloud is one the most innovative platforms that can make Excel & Customizable Application Platforms (like Salesforce) obsolete for Impact Measurement.