Evaluation of MoE/UNICEF`s
Transcription
Evaluation of MoE/UNICEF`s
Sida and the Norwegian Embassy in Kabul Evaluation of MoE/UNICEF’s “Basic Education and Gender Equality Programme” for 2006-2008 Afghanistan Anders Wirak Janne Lexow Kabul and Oslo 29 October 2008 Table of Contents List of Tables ............................................................................................................................................ 3 List of Illustrations and Graphs ................................................................................................................ 3 List of abbreviations ................................................................................................................................ 4 Executive Summary ................................................................................................................................. 5 Introduction to the evaluation ................................................................................................................ 7 Note on education statistics ................................................................................................................ 8 Note on methodology ......................................................................................................................... 8 Answering the TOR questions ................................................................................................................. 9 The Programme ............................................................................................................................... 9 Community Based Schools (CBS) ................................................................................................... 24 Ownership and Transparency........................................................................................................ 25 UNICEF Country Office .................................................................................................................. 32 Discussion around the relevance, the effectiveness and the efficiency of the roll out of the BEGEprogramme. ........................................................................................................................................... 35 Main Conclusions and Recommendations ............................................................................................ 37 Recommendations ............................................................................................................................ 38 Annex 1 Terms of Reference ................................................................................................................ 40 Annex 2 Result table. The Log-Frame with UNICEF’s status for 2006 and 2007, and the evaluation team’s comments of August 2008 (in blue and cursive) ....................................................................... 46 Annex 3 Itinerary of the team ............................................................................................................... 50 Annex 4 Number of CBS Students as of 30th of August 2008 ................................................................ 54 Annex 5 Community Based School (UNICEF/MoE) Status in 4 Regions ................................................ 55 Annex 6 Financial information ............................................................................................................. 56 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 2 List of Tables Table 1 Number of students in CBSs - all organisations ....................................................................... 13 Table 2 Some selected materials and services provided by MoE/BEGE ............................................. 17 Table 3 Disadvantages of Kushi in Education ...................................................................................... 19 Table 4 Literacy achievements from 2006 to mid 2008 (all female) ................................................... 21 Table 5 CBE Students - total (G1-3), 2008, August 30th ...................................................................... 54 Tabel 6 Community Based School (UNICEF/MoE) Status in 4 Regions................................................ 55 Table 7 Summary of Available Resources by Donor, PBA and Amount in USD. 2006 ......................... 56 Table 8 Country-specific Thematic Contributions Received for Girls’ Education in USD in 2005 ....... 57 Table 9 Total approved budget by funding type and amount in US$ for 2007 ................................... 58 Table 10 Summary of available resources by donor, PBA and amount in USD for 2007 .................... 58 Table 11 Country-specific Thematic Contributions Received in 2007 (in USD) ................................... 59 Table 12 Financial Summary 2007, from 1 January to 30 November (USD) ....................................... 59 Table 13 Summary of financial implementation for Basic Education and Gender Equality (2007) (USD)...................................................................................................................................................... 59 Table 14 Financial implementation Rate All Resources 2008 (USD) ................................................... 59 List of Illustrations and Graphs Diagram 1 Diagram 2 Diagram 3 Diagram 4 Diagram 5 Diagram 6 Diagram 7 Diagram 8 Enrolment in Primary School (G1-6) by gender .................................................................. 10 Student population and absentees during headcount ....................................................... 11 Students in G1 and G6 by gender ....................................................................................... 12 Teachers by gender and province (1386) ........................................................................... 14 Students at TTCs by gender and province (1386) ............................................................... 15 Students in pre-, and in-service teacher training 2007-2008 ............................................. 15 Teachers trained in INSET I (2006-2007)............................................................................. 16 MoE and UNICEF - Arenas and links of cooperation for the Programme ........................... 27 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 3 List of abbreviations AFA AGEI AI-FLI ARTF BESST BRAC CAS CBE CBS CCA CCT CDCs CRC DED DEO DoL CESC ECG EFA EIC EQUIP EMIS GER GMO GoA GPI HSI IBE IIEP I-ANDS MDG MoE MoF MoLSAMD MoPH MRRD NER NESP NGO Norad NSP PACE-A PED PPO PTA SC-UK SC-SN SCA Sida SIP SMC TED TEP TTC UNGEI WASH WPF Afghanistan currency: the Afghani which is divided into 100 Puls Afghanistan Girls’ Education Initiative Afghanistan Integrated Functional Literacy Initiative Afghanistan Reconstruction Trust Fund Building Education Support for Teacher Training Bangladesh Rural Advancement Committee, or Bringing Resources Across Cultures Country Assistance Strategy Community Based Education Community Based School Common Country Assessments Core Curriculum Team Community Development Councils Child Rights Convention District Education Department District Education Officer Department of Literacy, MoE Cost Efficient School Construction Education Consultative Group Education for All Education for Indigenous Children Education Quality Improvement Project Education Management and Information System Gross Enrolment Rate Grants Management Unit Government of Afghanistan Gender Parity Index Healthy School Initiative International Bureau of Education, Hamburg International Institute for Educational Planning, Paris Interim Afghan National Development Strategy Millennium Development Goal Ministry of Education Ministry of Finance Ministry of Labour, Social Affairs, Martyrs and Disabled Ministry of Public Health Ministry of Rural Rehabilitation and Development Net Enrolment Rate National Education Strategic Plan Non Government Organisation Norwegian Agency for International Development National Solidarity Program Partnership Advancing Community-based Education, Afghanistan Provincial Education Department Programme Plan of Operations - Basic Education for All 2006-2008 Parent Teacher Associations Save the Children UK Save the Children Sweden and Norway Swedish Committee for Afghanistan Swedish International Cooperation Agency School Improvement Plans School Management Committee Teacher Education Department Teacher Education Programme Teacher Training College United Nations Girls’ Education Initiative Sustainable Water Sanitation and Hygiene World Food Program Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 4 Executive Summary 1. The clients for this evaluation; the Swedish and Norwegian governments have provided substantial support to the Afghanistan’s Ministry of Education (MoE) and UNICEF Basic Education and Gender Equality (BEGE) since 2006. The main purpose of this evaluation is to assess if UNICEF’s stated objectives has been accomplished during the evaluated program period (2006-mid 2008). 2. The mandate for the evaluation included very specific questions, mostly of rather quantitative nature. The report is organized according to the client’s request of strict adherence to these questions. 3. Field work was carried out in Balkh, Faryab and Sar-e Pol Provinces, in addition to Kabul City from 10-27 August 2008. It should be noted that security concerns have to be high on the agenda for any assignments in the prevailing circumstances in Afghanistan. The team conducted interviews with MoE staff at central, provincial, district and school level, with UNICEF staff, representatives from NGOs, UN organizations and bilateral donors to the education sector. The team visited one teacher training course, literacy classes, remote community based schools and formal schools. Representatives from the community “shuras”, elders, religious leaders and women were interviewed. 4. The team concludes that UNICEF through the MoE/BEGE programme has successfully reached most of the targets set and implemented the programme according to plans, and most of the initially planned activities are still on the programme. There have been a few changes due to shifting priorities or delays from MoE’s side. 5. Afghanistan has seen a colossal increase in enrolment at primary level over the last few years. The number of girls enrolled has increased with 18,29% which is close to the targeted 20%. There are, however, wide disparities between provinces. While figures are to some extent unreliable, girls are still grossly underrepresented in some provinces. Many children are also reported as permanently absent, despite being registered as enrolled. 6. UNICEF promotes its education activities through the concept “child-friendly schools”. In Afghanistan this concept must be understood in context. There are still more schools without buildings than schools with buildings, sanitation and water facilities are often non-existent, teachers have poor qualifications and the pedagogical methods are traditionally based on route learning. UNICEF has, through assisting the MoE/BEGE programme contributed to create a foundation for more child friendly schools through teacher training, provision of materials and textbooks, construction of schools and to some extent improved health, water and sanitation. 7. A main focus of BEGE has been to establish education opportunities for primary school age children in very remote areas where no other school exist. These community–based schools (CBSs) teach the regular primary school curriculum for Grade 1-3. MoE/UNICEF CBS schools are now found in 28 provinces in the country, catering for nearly 150,000 children, with a fairly 50:50 % distribution between girls and boys. UNICEF finances training and incentives for teachers, textbooks and supplies and support the MoE in monitoring of these schools. Women with educational background are usually hard to find. A total of 2,409 teachers have been recruited and trained for the CBSs as a result of the programme. Only 10% of them are women. It is without doubt that having access to a school close to home has greatly improved possibilities for girls to participate in school. It is also culturally acceptable for girls at a young age to have a male teacher, and for the age group in question, this factor does not seem to deter parent from sending their daughters to school. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 5 8. A major step forward has been the formalization of the CBSs and the recognition of these schools as part of Afghanistan’s regular formal primary school system. This can be greatly attributed to the programme. Before 2006 these schools were considered as emergency responses and gap filling. Teaching and learning were carried out in an often ad-hoc and unstructured manner, often by NGOs with weak coordination and follow-up from MoE. Today these schools have become linked to the nearest formal primary school. This primary school serves as a hub for up to ten CBSs. The hub system, which is recently developed, will facilitate distribution of materials, training and monitoring, as well as making transfer to Grade 4 easier. A common monitoring form has been developed by MoE, in consultation with other stakeholders that support CBSs. When put in use, this will facilitate government’s oversight of the system. To date UNICEF has strengthened the monitoring capacities at provincial and district level, through workshops on monitoring and joint monitoring exercises. There is particularly a need to improve monitoring to identify drop-outs and non-functional teachers more consistently. 9. Another focus of the programme has been to provide literacy training for women. So far achievements of this component have by far exceeded the targets. This component is undoubtedly very critical for empowerment of women. By mid-2008, 194,124 women had participated in a nine – month course. More than 7,000 centers had been established, all with one facilitator who had received training. With a few exceptions, the majority of these facilitators were women. In the remote areas there is a huge demand for literacy classes. Communities are mobilized and involved to a great extent and it is the communities’ responsibilities to provide room and select facilitators. UNICEF provides material support to the classrooms, and has produced a textbook which is distributed to all learners. This textbook was considered by the MoE Department of Literacy to be more relevant in content and easier to use than other textbooks. It should be noted that there are many stakeholders in literacy programme, and apparently several different textbooks in use. 10. In terms of curriculum development, UNICEF’s stronger point has been to assist MoE in decentralizing the curriculum framework to the provinces, schools and teachers through training and production of textbooks. More than 50,000 teachers (of which nearly 40% women) have received orientation of new textbooks as a direct result of the programme. INSET I is based on a cascade model where core teachers have been trained in Kabul to train provincial staff who then give training to the teachers. The weak part in this component is that little has been done so far to investigate how teachers translate what they have learned into practical classroom behavior. 11. So far UNICEF has not been very much involved in policies and curriculum with the aim to make the system inclusive for all children. There have been pilot schemes for both nomad and children with special needs, but these have not yet been institutionalized within the MoE. However, UNICEF has assisted MoE in developing curriculum for special courses for female students at the TTCs. 12. UNICEF is spearheading girls’ education on many fronts, including participating actively in mainstreaming gender issues into the current curriculum. According to MoE this work resulted in changing text and pictures. UNICEF has the secretariat function of AGEI (Afghanistan Girls’ Education Initiative), which is chaired by MoE and has all the major partners in education including donors, NGOs, UN agencies, as its members. AGEI was intended as a platform to influence policies and decisions. However, the effective functioning of AGEI has been questioned by UNICEF, as it has been difficult to work out common strategies and to attract senior decision-makers to the meetings. 13. There is no doubt that UNICEF plays a crucial role in the development of the education system in Afghanistan. Highlights which have led the team to this conclusion are as follows: Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 6 UNICEF is working through the government and not in parallel structures. Planning, monitoring and reviews are done jointly with the central, provincial and district levels. There is transparency and mutual accountability for both MoE and UNICEF. There is no doubt, however, that ownership was clear: MoE recognizes BEGE as its own programme. UNICEF has placed its resources strategically. The volume of aid is not huge compared to some donors, but through the strengthening of the capacity at various levels of the administration, UNICEF support seems to have prepared the grounds for expansion of MoE’s absorption capacity for larger programmes. UNICEF maintains a nation–wide perspective. This is very important under the prevailing conditions in Afghanistan where many major international actors earmark their funds to specific geographical areas. And it is critical for MoE’s efforts to achieve its equity goals as put down in EFA and MDGs. UNICEF is perceived as a neutral partner, with no hidden political, cultural or economic motives. UNICEF has a long history in the country and has delivered educational support under shifting regimes. UNICEF is seen as a credible and strategic partner. UNICEF has demonstrated that it can assist MoE in delivering positive outcomes for children and women. There is a reasonable balance between access issues and quality issues. Most other programmes focus more on access. The various components are relevant and will for the most continue to be so for a long time to come. The staffs are committed and motivated and although there are vacancies by and large the competencies of staff seem to match the requirements. 14. As a result of incomplete reporting, donors to UNICEF and other stakeholders have not acquired the accurate and full impression of programme activities and achievements. Monitoring and thematic reporting remain weak points. Improvements have been made, but there is scope for further streamlining of reporting systems and following up of effects of activities in the field. 15. A main recommendation is that the programme, with some modifications, should receive continued support, preferably with longer time frames than three years. Introduction to the evaluation 16. Afghanistan has been plagued by conflicts and war for almost three decades. Destroyed infrastructure, fragmented governmental institutions and uneven and non available social services have been the result. Although significant results have been achieved over the last few years, the security situation remains frail and in parts of the country even worsening. UNICEF (August 2008) reported that 40% of the country was inaccessible for its staff due to insecurity1. In addition, there are other calamities such as successive years with drought and dramatic crop failures in large parts of the country. 17. The context under which the BEGE is operating, is determining limitations as to what can be done. Schools, teachers and students, in particularly girls, are still under insurgent attacks in many parts of the country. Schools have been burnt, teachers and students killed in provinces such as Kunduz, Kandahar, Helmand, Paktia, Khost, Wardak and Farah. Ambitions for what can be accomplished must be set accordingly. 1 While inaccessible to UNICEF staff, MoE and usually continue its work in these areas. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 7 18. Most actors involved in development work in Afghanistan seem to agree on the importance of the education sector, and not least for educating girls. The evaluation team was informed that also Taliban, in order to obtain popular support, now promises to provide education for girls if they come back to power. The demand for education exceeds the capacity of supply. Before 2001 there were fewer than one million children in school, and almost no girls in mainstream education. Today there are about 6 million pupils, enrolled in basic education (Grades 1-12), with almost 35% being girls. MoE has now developed the National Education Strategic Plan (NESP) which has been endorsed by all main stakeholders. This represents an important milestone, and together with new curriculum, textbooks, teacher training, school building activities, improvements in statistical overviews due to the EMIS2, Afghanistan and MoE has a much stronger basis today for reaching the aim of providing quality education for all. 19. The clients for this evaluation; Sida and the Norwegian Embassy in Kabul have provided substantial support to UNICEF and MoE BEGE Programme for the period from 2006 to 20083. The main purpose of this evaluation is to assess if UNICEF’s stated objectives have been accomplished during the evaluated program period. More information about the clients, the background for the BEGE programme and motives for undertaking this evaluation are found in Annex 1 – Terms of Reference. Note on education statistics 20. Over the years unreliable educational (and other) statistics for Afghanistan have hampered proper planning and reporting. Data have been incomplete and erroneous. With among others UNICEF support, collection of information for an EMIS was undertaken in 2007 and the first report was published in January 2008. This has greatly improved the basis for planning. When the MoE/UNICEF BEGE programme was planned in 2005/06 one had to base both baseline and projections on data which were much more uncertain. Hence the issue of inaccurate data and statistics has been a considerable challenge for planning and reporting throughout the BEGE programme and also for the current evaluation. Note on methodology 21. Due to considerations both to Ramadan and the clients’ request for reporting deadline, the evaluation had to be conducted at a time which was not ideal. At the onset of the assignment, schools were still closed due to vacation, and many key stakeholders in the international community had left for holidays. Security concerns limited the range of places which could be visited and the length of time that could be spent in each place. Security threats to the international community, closed down UN offices for days in a row. The tragic loss of three international aid workers and the severe loss of French troops just outside Kabul, clearly influenced mobility. A life attack on the Minister of Education happened the same day as the team was scheduled to meet him. Delays, change of flight schedules and other obstacles became the order of the day. 22. In spite of this, the team visited three provinces, four districts, and several villages and met with MoE and UNICEF staff at the relevant levels. One INSET teacher training course, six Literacy Classes, three CBSs in remote areas and two formal schools were visited. To a large extent the evaluation decided which routes to take and sites to visit. Rather than rushing to many places the evaluation team preferred to stay for some time in each locality with the intention to collect more qualitative information from beneficiaries and stakeholders. Meetings with PoE, for instance, lasted for several 2 Education Management Information System. The first report from this countrywide collection of school based statistics (in 2007) was issued in 2008: ”1386 (2007) School Survey Summary Report” 3 Major donors to the programme are Sweden, Norway, Canada, Japan, UNICEF Nat. Committee Germany, Netherlands, UK and US. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 8 hours, and also visits to individual Literacy Classes took considerable time. In most instances representatives from the villages, elders and Mullahs were present. Representatives from eight NGOs, three UN organisations and several donors were interviewed. As Annex 3 illustrates a large number of persons were contacted and met during some hectic days in Afghanistan during August 2008. 23. The team would like to draw attention to the narrow perspective of this evaluation. It is not a broad study of all problems and issues in the education sector. The short time available (2 persons and 4 weeks) and TOR’s restriction of main report only to be 30 pages long, allowed only for strict adherence to the TOR questions posed in the TOR. Answering the TOR questions 24. The main part of the TOR consists of specific questions, often related to the BEGE Programme’s results and achievements. The clients for the evaluation have requested that these questions should be replied to one by one. The consultants appreciate this approach, and, consequently, this report is organized in accordance with the TOR questions. The Programme 1. To what extent has the programme been successful in achieving its planned results4? 25. Despite of the large challenges and difficulties facing development organisations in Afghanistan it is concluded that MoE/UNICEF has been relatively successful in implementing its plans and targets set for the BEGE programme. Some results are achieved better than intended, some more or less as planned, some activities have been taken out of the programme and some activities are new compared to the original programme plan. In total, however, and after line by line check of the programme’s Log-frame the current evaluation concludes positively in relation to its assessment of the totality of the programme’s achievements. 2. Has the gross enrolment in basic education for girls increased by 20%? 26. In 2005 1.64 million girls were enrolled in basic education (grades 1-9). According to the EMIS statistics collected in 2007, the number had increased to 1.94 million5. This represents an increase for girls of 18.29% which is a fairly satisfactory result. Gross enrollment data are, however, very rude and un-precise indicators. There are wide disparities between the provinces. Helmand, Zabul and Uruzgan have female enrolment in primary schools below 20%. 27. It should be noted that documents related to the BEGE programme contain some inconsistencies in information of what is expected at this level of measurement: In PPO (page 11) the specific objective to achieve by December 2008 is “to increase of primary school net enrolment for girls by 20% “. Since the baseline was 40% the objective is read by UNICEF’s Education Division as 48%.6 The document is however also referring to CCA indicators7 (page 6) where “net enrolment rate in primary education of 7-12 year olds is 40,5 (in 2003?). 4 As presented in the UNICEF and MoE programme document. “Basic Education for All 2006-2008” and UNICEF “Programme Plan of Operations”, these documents are the baseline to assess all achievements and results. 5 Islamic Republic of Afghanistan, MoE: 1386 (2007) School Survey, Summary Report, January 2008, (p. 10). The number for 2007 is a sum of Primary and Lower Secondary. 6 Information from UNICEF’s Education Head 22 August 2008 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 9 One of the UNDAF indicators is given (page 8) as “20-percentage-points increase in net enrolment rate in primary education for girls (goal=66%)”. The “Expected outcome of “Basic Education for All” Programme” is then specified (for this item) as “1.8 million girls are enjoying child-friendly schools” (page 9). From this one can conclude that this target was ambiguously interpreted from the start. 3. How many girls and boys respectively are enjoying child-friendly schools and have attained acceptable level of basic competences? 28. According to the EMIS (2007), there are 5,950,455 students registered in MoE and Community Based Education delivering primary and secondary education. Approximately two-thirds were male.8 There were 2,116,234 female students representing 35.56% of the student population, and the number of male students was 3,834,221. 29. The graph below shows huge provincial differences in primary school enrollment. Primary school female enrolment varies between 8.78% in Hilmand province as the lowest to nearly 90% in central areas. Figures may not be totally reliable, but confirms nevertheless that girls are severely underrepresented in primary schools in many provinces. Diagram 1 Enrolment in Primary School (G1-6) by gender 9 30. Official figures for enrolment do not always give true picture of actual attendance in the class. A headcount conducted as part of the EMIS School Survey process shows that only 75.5% of the students were present in the class. Of these 555,764 (or 9.6%) were absent at the day of head counting and as many as 855,548 (14.8%) were “permanently absent”.10 This concept is defined by the EMIS report as students who are enrolled but have been absent from the starting of the school year till the survey was conducted.11 The survey report did not split absentee data into gender 7 Common Country Assessments draws extensively its core indicators on various official reports by different agencies of the Government. In the absence of statistics from the Government, other contributors include UN Agencies, local and international NGOs and others. 8 MoE 1386 (2007) School Survey Summary Report – ”EMIS Report” 9 Source: School Survey 1386 table 6 10 This includes both the General and Islamic Education Programmes 11 Op cit page 12 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 10 categories. Many actors in the education sector were of the opinion that girls constitute the majority of those who were permanently absent. Diagram 2 Student population and absentees during headcount 555764 Absent on day of counting 855548 4539143 Permanently absent Present 31. The concept of “child friendly school” is usually associated with quality learning environments (adequate classrooms, clean water supplies and sanitation facilities, health and safety, quality teaching-learning processes, policies which prohibit corporal punishment of children, quality outcomes with defined learning in a broad sense of knowledge, attitude and skills) and which is inclusive and gender-sensitive throughout. In the present context of Afghanistan, one has to lower the ambitions quite considerably. Basic requirements for school buildings, access to water and sanitation, qualifications of teachers are far from being met. An overcrowded “school” for girls visited during the evaluation gave brief reality check on schools. Hundreds12 of girls had to study in the open air without any protection from sun and rain. In Afghanistan schools without buildings (4,956) still outnumber schools which have a building (3,704)13. Girls talked to said that for them a friendly school, and a prerequisite for their possibility to attend, was a wall to protect them from the public gaze. The number of girls’ schools without a surrounding wall was 935 (table 58). Mixed schools (boys and girls in separate shifts during the day) seldom had walls. MoE school construction design does not include walls. 32. The BEGE Programme has moved some way down the road to create a foundation for a “child friendly “ school: Improvement and expansion of teacher training. Provision of teaching-learning materials for all students. Provision of teaching and learning materials as well as textbooks for MoE/UNICEF CBSs. Construction of 340 “cost effective schools” (139 schools’ construction completed) with WASH facilities for over 180,000 children. And HSI is being implemented at 1,415 schools at the moment, providing protective and healthy learning environment for 342,699 children in 34 provinces. 12 13 The number of girls students at Qarashaikhi Girls School was 777 Source: School Survey Summary Report, p.14 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 11 Diagram 3 Students in G1 and G6 by gender 14 Students in G1 and G6 by gender 500000 0 Grade 1 Grade 6 Boys Boys 408808 393596 Girls Girls 315895 200523 33. It should be noted that overall the school population was much lower when the current sixgraders started their school career six years ago. But it is still of great concern that many children do not complete primary education. Exam results show that already in Grade 1 more than 20% of the children fail the exam. In Grade 4 35% and in Grade 6 another 25% fail the exam., many after having sit for a “second chance” exam. There is no information about repetition, but there can be no doubt that many children are far from having “attained basic competencies”. 4. How many learning spaces (CBS) have been provided for girls and boys respectively in remote areas? 34. Learning spaces in CBS can be a room in a private house, a tent, the mosque and similar structures. A total of 3,724 CBSs are currently functioning under the MoE/UNICEF programme 15 which provides education for a total number of 148,340 children. 74,026 are girls and 74,314 are boys. A large majority of the CBSs are located in remote areas. The MoE/UNICEF CBSs are found in 28 provinces. (The names of these provinces are given in Annex 5). 35. A major achievement in the programme has been that CBSs are now formally recognized primary schools offering the lower grades (1-3 and sometimes 4). Each CBS or more correctly “outreach school” has become linked to a formal primary school. This school will serve as a hub for several CBSs. This system is assumed to have several advantages: (1) Easier transfer of children from Grade 3 to Grade 4 in the hub school. (2) Hub school will serve as a center for distribution of textbooks and other material (3) Monitoring will be facilitated as the hub school headmaster will also formally be responsible for the outreach school, and (4) Conditions and provisions will be streamlined and thereby making the system more fair and equitable. (5) Information on performance of CBSs will be improved as information and statistics will be transmitted from the CBS, via the “hub schools” and to the District and Provincial MoE Office and up to central levels of both UNICEF and MoE. 36. One can also add that as a result of the facilitators of CBSs receiving monetary incentives for their work, the monitoring and reporting system seem to have improved considerably. 14 Source: School Survey 2007 UNICEF data of 27th August 2008, but based on information collected by PEDs. Includes 9 CBS for Grade 4. See annex 5. 15 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 12 Table 1 Number of students in CBSs - all organisations 16 PACE-A BRAC SCA SC-SN UNICEF/MoE SCUK Total Total 45879 71154 30728 11631 148172 5362 312926 Per cent 14,7 22,7 9,8 3,7 47,4 1,7 100,0 37. This table presents number of students in CBSs under various organisations. UNICEF/MoE is by far the largest with almost half of the students, while the second largest is BRAC. With more than 310 thousand students in CBSs, these schools have definitely been established as important providers of education in Afghanistan. It should be noted that organizations remunerate teachers differently. SC-SN pays AFA 2,750, BRAC 1,000, SCA 3,000. In comparison MoE/UNICEF programme pays AFA 1,750 per month17. 38. There is contrasting information with regards to the persistence of CBSs over time. The intention behind MoE/UNICEF CBSs is to enroll a batch of children in Grade 1 and then follow this group through Grade 2 and 3 (typical a CBS has only one class). The team observed that of the 2,385 CBSs which were established for Grade 1 in 2006, only 1,446 CBSs taught at Grade 3 level in 200818. 98,016 students started Grade 1 in 2006, but only 41% made it to Grade 3. Apparently there are many reasons for this and there are also observations suggesting that the CBSs have fewer drops out than formal schools.19 Data on drop out from formal schools are not entirely reliable (students once registered in G1 may still appear on the list for G3 enrollment despite having dropped out due to inaccuracy of the registration system). UNICEF explained that many of the children who had “disappeared” from the CBS had become enrolled in formal schools as these become more accessible and more attractive. Some CBSs had been closed because teachers had not been given financial incentives in the first year. Furthermore, quite a few children had moved. Finally, some children may also have dropped out or pulled out by their parents for various reasons. Counting of students in the CBSs visited during fieldwork largely confirmed that conventional dropout is quite rare. Teachers with whom this issue was brought up could usually explain individual students’ absence from school, but there has been no systematic follow up of this point. 16 Data received from MoE in August 2008. There are slight differences in numbers for the UNICEF/MoE category from different sources. 17 Information from MoE, August 2008 18 This figure for number of CBSs Grade 3 in 2008 (1446) was presented by UNICEF in at table ”Community Based School Status in 4 Regions for 2008. Updated as of 30 June 2008”. The evaluation has observed that there are inconsistencies in numbers when comparing this with the Annex 5 table (which gives 1603 CBSs) 19 Also as observed by Karlsson, Pia and Shirin, Khan (2007) Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 13 5. How many teachers, male and female respectively, have been recruited and trained and are still working? Diagram 4 Teachers by gender and province (1386) 20 39. Based on the School Survey only Kabul City has more female teachers (12,504) than men (5,608). Most other provinces have severe female under-representation among its teaching staff. This is a serious obstacle for girls’ education. Teachers in general education (G1-12) have much poorer qualifications than required to become permanently employed by MoE. For primary school teachers a minimum of G14 is required. Only 10% of the total teaching force for general education has this level. 48.9% of the male teachers and 43.3% of the female teachers have G12 only and 12.7% men and 9.8% of the female teachers have qualifications corresponding to G7-11 (School Survey table 41). There are wide geographical disparities. The majority of female teachers with Grade 14 work in Kabul city. In Uruzgan there are no female teachers with such qualifications. The few female teachers present are in the G7-11 category of education background. 40. Recruitment of teachers to formal schools is the responsibility of MoE and outside UNICEF’s direct sphere of influence. However UNICEF is supporting MoE in its efforts to recruit teachers for the CBSs. They become contracted as CBS teachers by MoE, and are supported financially from UNICEF. These incentives were included when it was found that many teachers stopped working because the communities could not support them as intended. Furthermore UNICEF is assisting MoE and communities in selecting facilitators for the literacy centers. UNICEF is supporting the training of these facilitators as well as training of CBS teachers and formal school teachers. 41. Within MoE the Department for Teacher Training is responsible for national teacher training policies, programmes and recruitment issues. This department also manages the Teacher Training Colleges (TTCs) in the provinces. Most TTCs are in urban areas and it is very difficult for female students to move away from their villages and attend TTCs. 20 Source: School Survey: Table 35. The graph shows total for General Education (Grade 1-12) Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 14 Diagram 5 Students at TTCs by gender and province (1386) 21 42. A total of 14,294 students were enrolled in 2007, 36% of them women. The largest number of females is found in Kabul City. This is the only place where female students significantly outnumber men. In several TTCs there are hardly any female students at all. Balkh, Nuristan, Ghor, Paktika, Zakul and Kabul Province established TTCs in 2007/08. Recent figures obtained from the Teacher Training Department show a significant increase in number of students at the TTC. 22 Diagram 6 Students in pre-, and in-service teacher training 2007-2008 12000 10000 8000 6000 4000 2000 0 Pre-Service In-Service Pre-Service 2007 In-Service 2008 Men 5816 6655 9793 9376 Women 1922 4757 4181 9387 43. The above graph shows progress on many fronts with regards to teacher training. The total number of students in 2008 is exceeding 32,000 enrolled in 34 TTC. According to Teacher Training Department (TED) staff this is a significant jump from 2005, when only 2,000 students were enrolled in 4 TTCs. Recent development show that the gender gap is closing. In 2007 there was a GPI of 0.33 for pre-service training and 0.70 for in-service training;23 the GPI for 2008 was 0.40 for pre-service training and a clear 1.0 for in-service training. With the support of several stakeholders including UNICEF, the MoE/TED attributed these positive results to: 21 Source: School Survey 1386 table 8. Source: TED Aug.2008 23 ”Pre-service” is the ordinary two-year full-time course which gives graduates the possibility to become regular permanent teachers. “In-service” – is a combination of courses, mostly associated with multi-donor INSET-TEP programme. 22 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 15 i. ii. iii. iv. v. vi. vii. viii. Continuous advocacy to promote women teachers Accelerated program where possibilities are given to teach on a contract basis and at the same time obtain a 12 grade certificate (in 23 provinces) Support (jointly with GTZ) a special teacher course for females with lower qualifications than Grade 12 (from G 9) Recruitment of Grade 12 women (3,000) in Kabul city, providing them with a one-month crash-course and facilitating their in-service training at a TTC so that they eventually will become formal teachers Establishment of decentralized small satellite TTCs at district level to make access easier for women. Only 5,714 students (majority males) have access to dormitory facilities. UNICEF and GTZ support to develop a curriculum to train core teachers Improved infrastructure with UNICEF‘s support to nine TTCs. Support to the two-year pre-service teacher education. 30 books for the first semester have been developed and 60 books for the second and third semester is soon to be completed. Diagram 7 Teachers trained in INSET I (2006-2007) 22385 Male 31890 Female Source: UNICEF Thematic annual reports 2006 & 2007 44. The INSET 1 package is divided in a three week module split in three parts: orientation in the new curriculum and textbooks, pedagogical methods (13 days), practice (7 days) and refresher course (8 days). UNICEF’s focus is on training those teachers in CBSs which are supported in the programme. The training is based on a cascade model. A team of master trainers from provinces are trained in Kabul by a number of core trainers from Teacher Training Department. 120 master trainers from provinces have been trained in Kabul through this support programme. The master trainers will then train in the provinces and then those people from the province will train the teachers in the districts. So far in the programme 1,395 provincial trainers have been trained, approximately 40% of them are women. In this programme there are also many support staffs in logistics, finance, and administration. 108 staffs have for example been trained in finance and logistics. All of these were men. 45. The 2007 teacher training programme of 48,000 teachers in INSET 1 was postponed due to delays in textbooks for Grade 3 and 6. This delay affected implementation of plans for all stakeholders in the TEP programme, and these plans had to be pushed forward to the 2008 annual work plan. The training of the remaining teachers is supported by USAID and the World Bank. The training package used by these donors, however, has been provided by MoE with the support of UNICEF. 46. UNICEF reports that teachers trained to teach in the MoE/UNICEF community based schools total 2,409. Out of these 226 or just under 10% are women. Women are always considered first priority. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 16 Very often it is impossible to find women with acceptable educational background. In such cases educated men is second priority with Mullahs coming as a third priority. 47. Most male teachers are Mullahs. They usually enjoy considerable prestige and are often the only literate persons in the communities. UNICEF has long experience, in cooperation with the Mullahs, to use the Mosques as arena for information and communication. UNICEF has found that Mullahs often become agents of change in the communities after they have received training which also includes child rights issues in the context of Islam. Mullah teachers observed in class by the evaluation team were asking girl students to sing, recite poems and come to the blackboard. Whether this was representative for many Mullah Teachers is of course not known. Other NGOs such as SC-SN, confirmed that they have been inspired by UNICEFs approach to involve religious leaders in the education system and has consequently picked up a similar approach for their own programme. 48. There are still many challenges with regards to teacher training: 1) It is culturally unacceptable for women to travel unescorted by male relatives to training courses at the TTCs in many rural communities. 2) It is easier to recruit female teachers and students in the urban areas, and very difficult to motivate them go to rural areas after graduation. It is a lot more than money which is at stake in this. Teachers’ salaries are indeed poor and partly de-motivating, but prevailing cultural perceptions that women cannot seek employment in areas where they cannot be chaperoned by their family, seems to matter more. The current strategy of decentralizing the teacher training opportunities to make them accessible in rural areas seems to be the right way to go. 3) TTCs have few female teachers. Of a total of 788 lecturers employed at the TTCs in 2008, only 22 % (173) were women. 22 TTCs had no female lecturers at all. 4) Cascade training always constitutes a risk of diluting messages as one move down to the districts. Too little is done to find out whether the teachers actually implement what they have learned after some time, or whether they relapse into old habits of route learning. 5) The need for new teachers is growing day by day. In the five year National Education Strategic Plan (1385-1389) MoE estimates a need to increase its teaching numbers by a minimum of 95,000. 6) The school survey (EMIS) does not survey teacher retention or numbers of teaching days the teachers are absent. 6. Have the following been distributed and arranged: teaching-learning materials, sports equipment and games, health education, recreational facilities, awareness campaigns, teacher and management training? Has UNICEF specified standards for the quality of these materials, equipment and services? Are they up to these standards? Table 2 Some selected materials and services provided by MoE/BEGE Teaching and learning materials Sport equipment and games Health education In 2006: Distributed to 2.71 million children and 61,780 teachers 24 2007: Distributed to 5.16 million children and over 96,428 teachers 25 2008: Distributed to 2.16 million children and 85,787 teachers as of March UNICEF reports that these items are incorporated in the emergency education kits and are not yet distributed. There are examples, however, that MoE through UNICEF support has established play grounds around some schools. In 2007 1,000 recreational kits were bought for 1,000 schools and about 200,000 children. In 2008: more 1,500 recreational kits, including sport materials are being procured for the distribution to 2,500 schools (all the primary and lower secondary schools) in 13 provinces as part of the psychosocial support. De-worming activities delivered as part of the Healthy School Initiative. The largest problem is said to be lack of coordination between water and sanitation engineers 24 These are information from UNICEF 2008 08 21. The 2007 ”Thematic Report” however gives 110,312 teachers 25 Information from UNICEF 2008 08 21 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 17 Recreational facilities Awareness campaign Teacher and management training in Govt. 2007 (Annual Report): HSI – Training manual for teachers developed, 6 national facilitators, 68 master trainers and 2,200 teachers trained on the package National de-worming for 5.6 mill grades 1-9 children completed. Pilot project on Inclusive Education started in 3 schools. 34 teachers and head teachers trained. See above under “sport equipment and games” UNICEF has in many instances in previous years been among the most visible actors in terms of supporting and implementing campaigns. The “Back to School” and “Meena” have become famous in this regard. Currently campaigns have been modified in order to reduce attacks on schools. Instead of traditional campaigns there has been more focus on posters/booklets and mass media. UNICEF is also giving financial support to MoE to organise School Days and Literacy Days. See answer to Question 5 in the main text. This is one of the main areas of UNICEF’s support. Management training has not been so much covered. 49. Setting of educational standards is the responsibility of the MoE. There are, however, continuous discussions and communication about standards and norms between MoE and UNICEF and UNICEF is reckoned to be among the most important contributors in this context (including establishing of criteria, norms, policies, strategies). In addition to staff at its Country Office, UNICEF can utilize resources in regional offices and centrally as well as involve Technical Assistance staff from other countries. For international purchases UNICEF relies on regulations and routines defined by the head quarter and the services provided by the Copenhagen Office. 50. For books and other printed material UNICEF in consultation with MoE specifies quality of the materials before printing or procurement, as a standard procedure. Some textbooks examined were glued instead of being stitched. Even normal handling of these textbooks by children may easily result in reduced life-time for the books because pages can easily fall out. 51. UNICEF procures printing of books through its own procurement system. MoE staff felt that this was a wise decision, in order to reduce delays. Distribution of books through the regular MoE system appears to be rather problematic. The team was told that usually, books were piled up in MoE’s central warehouse for very long time. UNICEF follows a system of prepositioning books in the districts before the winter, so that books can be distributed on time when schools reopen. Some stakeholders raised the concern that public procurement and distribution of books appeared to be vulnerable to corruption and that UNICEF’s hands on approach had minimized such problems. 7. Assess to what extent and how UNICEF has supported MoE in developing policies for girls’ education and for education of disadvantageous children including nomad children? Asses what have been accomplished. 52. UNICEF is perceived in MoE and among other education stakeholders to be spearheading gender issues. Various working groups are operational to influence decision-making process in the MoE and higher levels to ensure that girls' education is getting priority. One arena for gender issues is the education working group, which has been convened 3 times so far in 200826. UNICEF's role has been to mainstream gender issues in policy areas, but it is not possible to trace any policy to UNICEF in particular. In addition, UNICEF has promoted specific activities for girls’ education. A noticeable result of UNICEF's own actions has been the launching of AGEI (Afghanistan Girls' Education Initiative) in March 2007, as a girls' specific policy platform. This is a policy forum for MoE and the partners in education, including donors, NGOs, UN agencies, to follow up progress and achievement in the area of girls' education specified in the National Education Strategic Plan (NESP) which was launched in December 2006. The NESP is the five-year guiding framework for all educational activities throughout the country. AGEI is the institutional setting for exchange and development and 26 As per October 2008 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 18 as a network it has political backing from the Minister himself. AGEI has 21 members, including all major donors to the education sector. AGEI is supposed to serve as a network and information hub. AGEI has conducted a situation analysis on girls' education in Afghanistan, drafted the ECE policy, developed girls’ education communication strategy and is according to its TOR expected to review the government's work and provide linkages between the NESP and Education for All, the MDGs, the I-ANDS and so forth. AGEI is supposed to meet monthly and is chaired by the gender focal point in the MoE. 53. To the team's knowledge, AGEI has so far not evolved to its full extent according to intention. AGEI is an example of the advantage for UNICEF to draw upon its global agenda for the United Nations Girls' Education Initiative (UNGEI). UNGEI is a 10-year inter-agency initiative to which UNICEF has been designated as the lead agency. However, following the initial euphoria after the establishment of AGEI, some problems have emerged. The number of organizations financing activities under the AGEI is still limited. Meetings tend to be attended by a mixture of representatives with various positions from partners including staff in junior positions, which is a weakness in leading to policy level discussions and coming up with decisions in the meetings. Its membership base has proven to be very wide, and is difficult for all members to be represented. Members are also often too busy with implementing their own planned activities. Another problem is that there are too many working groups with little power to influence decisions in own agency or MoE. It has proven to be difficult to take AGEI to the provinces. A sharpened focus around a few areas may be a solution to this. 54. Policy development for other disadvantageous children including nomads has been less visible on the part of UNICEF. UNICEF is experimenting a model schools and literacy courses (through special CBSs and women’s literacy centre) for Nomad children and women in Northern region to influence policy decision. UNICEF is also supporting implementation of inclusive education in small scale in Kabul, with technical support from UNESCO and UNDP to influence policy decisions of MoE. Among the UN agencies, UNESCO seems to have been the active agency in inclusive education. On the other hand, UNICEF has accomplished much in emergency education, where curriculum is in the process of being developed. This work takes place in the newly established Emergency Education Cluster chaired by MoE. Whereas supply issues have been, and still are very focused in emergency education activities, this work is now including a more structured and streamlined approach to training of teachers in psycho-social issues, gender sensitive approaches and other quality measures. 55. The Kuchis are nomadic pastoralists (an estimated 1.5 million people) and are traditionally dependent upon livestock and migration for their livelihood. In terms of school enrolment (age 6-9) the Kuchis are particularly disadvantaged. Table 3 Disadvantages of Kushi in Education 27 Group Female % Male % All % Kuchi 5 5.8 5.4 Rural 20.1 28.8 24.6 Urban 34.7 34.9 34.8 All 21.2 28.4 24.9 56. Two CBSs for Kuchi children have been established in the Northern region. So far, no initiative has been taken as part of UNICEF’s current programme to develop specific policies or initiatives for the Kuchi population. For those Kuchis that have been settled, the children are likely to attend ordinary classes in the formal or community-based schools. 27 Source: World Bank staff estimates based on 2005 National Risk and Vulnerability Assessment (NRVA) Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 19 57. UNICEF has supported MoE in development of textbooks for ethnic minority group languages: Uzbaki, Turkmani, Pashayee, Nooristani, Baluchi and Pamiri. This has improved the education opportunities for ethnic minorities. 58. The overall issues of inclusive education are currently given attention within the MoE. One expert in inclusive education is financed by UNESCO and Inclusive Education Working Group, in which UNICEF is active, has been established. A Needs Assessment has recently been undertaken and results will be presented at an international conference on inclusive education in Geneva (Autumn 2008). The intention is that this Needs Assessment will feed into the ongoing policy work within MoE. UNICEF is involved in this work through a few pilot projects in Kabul City. 100 children have been enrolled in ten schools, and their teachers and parents have received training (one month). UNICEF’s intention is to collaborate with the Swedish Committee for Afghanistan which has considerable experience in this regard, but this collaboration has not yet been formalized. 8. Assess to what extent and how UNICEF has supported MoE in developing new gender sensitive curriculum and textbooks, improving teaching-learning methodologies and introducing assessment systems. Assess what have been accomplished. 59. It is necessary to draw attention to the fact that the framework curriculum for primary education was completed in 2003. The general view among stakeholders is that the whole process of developing the curriculum was done rapidly, with enthusiastic MoE staff and with critical technical assistance e.g. from UNICEF. The process, which was lead by MoE, was perceived as interactive, participatory and involved major donors in the process. UNICEF’s contributions in this process have been crucial, although UNESCO was directly engaged by MoE to drive the process forward. UNICEF recruited and financed 15 technical experts (from Teacher College at Colombia University) and financed several workshops both in Afghanistan and abroad (Jordan). The outcome of this process was that gender equality became one of the 6 cross-cutting issues. According to MoE’s curriculum experts, UNICEF has been, together with UNESCO, the two agencies which have assisted MoE in developing the texts. 44 titles have been completed. 8 texts (for example the text for religious education) remain. In terms of gender content all texts, pictures and other materials have been scrutinized to remove possible unbalanced or discriminatory parts. 60. Key partners to MoE in this process have been USAID, IIEP, UNESCO, IBE, UNICEF and Danida. The major role UNICEF has played in “curriculum development” in the programme, has been to “take the curriculum to the provinces and schools” as it was put by MoE staff. This has been critical. After the initial drive to develop the curriculum, the whole process seemed to have come to a standstill. Very few schools and teachers knew about the new curriculum and little was done to make it generally know, or to develop syllabi and textbooks aligned with the new curriculum28. UNICEF’s major accomplishments in BEGE has been to assist MoE to disseminate the curriculum and decentralize it to the provinces, districts and schools levels through orientation workshops, training, and provision of materials. In 2006, MoE also embarked on the challenging task of developing a curriculum for lower and upper secondary education. This has been one of the key areas for UNICEF’s work in curriculum development in the BEGE programme. 61. UNICEF has also played a critical task to assist the Teacher Training Department (MoE) with the development of the specific condensed training programme for female teachers. By and large 28 Dakman Georgescu UNESCO IBE expert for curriculum development to MoE. In ”Prospects 2007”. 37:427448 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 20 UNICEF is perceived as a consultative partner in all curriculum development activities, but that UNESCO has played a more direct role through provision of technical expertise. 62. Assessment of learning achievements of learners is in progress with UNICEF support and the Department of Training of MoE is working on it. It was unclear to the team when results can be expected, but it was apparent that possibilities for continuous assessment have been improved. All texts in all subjects are accompanied by questions which should assist the teacher to grasp who have learned what. 9. Assess how many women have attended learning centres and if they have gained functional literacy skills as a result of UNICEF activities. 29 Table 4 Literacy achievements from 2006 to mid 2008 (all female) No of courses/centres Eastern Region Northern Region (NER) Western Region Central Region Southern Region* Total UNICEF National target UNICEF target No of learners 1788 2061 1075 1689 569 7182 7000 44570 53233 30681 48609 17031 194124 375000 90000 * Southern Region not reported 2008 63. UNICEF started supporting MoE’s 9 months literacy program for women in 2006. UNICEF has provided training of facilitators and supervisors, monthly incentives and materials. Achievements in terms of number have exceeded the target. Literacy is singled out as a separate programme (Programme 7) in the NESP. Programme 7 does not point out specific indicators for functionality as a result of the literacy training, and neither the DoL nor UNICEF have yet established any mechanism for following up of longer term effects for the learners. 64. The literacy programme relates to functional literacy in the sense that all examples and lessons are dealing with reading, writing and numeracy using examples related to participants’ daily lives. The content and learning process is more related to the social benefits (health issues, community issues, children, life skills, pregnancy, motherhood, and societal issues) than economic benefits such as vocational skills or income generating activities. 65. Random tests during the field work of the participants’ ability to read, write and do simple arithmetic on the blackboard, confirmed the impression that women were devoted learners. Many women expressed that knowing how to read a sign outside a store in the village was a fantastic new experience for them. Learning symptoms of serious health issues were also clearly benefiting them. Many women looked forward to be able to use a mobile phone and send messages to friends and relatives. 10. Assess how many decision-makers and communities have been mobilized by UNICEF in favour of adult literacy in general and women’s literacy specifically. 29 Source: UNICEF Provincial Reports. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 21 66. It should be noted that MoE staff in general has a very favorable opinion of UNICEF’s support for community mobilization. It was, for example, noted by previous leadership in EQUIP, that UNICEF had been the principle advocate for bringing the community into all decisions regarding school development. 67. Communities in which a literacy centre has been established require significant mobilization for adult and women literacy. This does not, however, take form of a special sub-committee within the local governance system. The communities are mobilized for 1) Allocation of a room (often a private home) which can serve as a classroom 2) door-to door advocacy to obtain husbands’ consent for wives’ participation 3) annual celebration of International Literacy Day. 68. It is evident that the close interaction between the Department of Literacy’s focal point and the communities has generated general awareness and enthusiasm for literacy in general and women’s literacy in particular. The demand is high and exceeds the capacity for the facilitators to take on more than 20 participants in a course. In one village visited in Faryab, the team was told that it would be no problem of increasing the number of participants three-fold. From discussions with women, it was quite clear that participants never before had been part of an education opportunity. 69. A short answer to the question is that a large number of local decision-makers and communities have been mobilized, and the proof is the impressive scale of activities which would not have taken place otherwise. And as a consequence of the great interest for literacy work, the number of mobilized decision-makers is growing fast, also at central governmental levels. 11. Assess how many learning centres with female teachers have been provided by UNICEF. Assess the teaching materials of these centres. 70. There is no exact number of female teachers (hereafter called facilitators), although it is estimated over 80%. Male facilitators are only found in Nangarhar and Bulkh provinces. The facilitators are often high school students or primary school teachers who take on this task to earn a little extra (25$) monthly. All facilitators are provided with 6 days training, which includes elementary training in how to organize a lecture, how to interact with the participants and how to use the textbooks. Facilitators interviewed were content with the training, but less content with the low level of the incentive. 71. UNICEF has supported MoE in developing a special textbook which is in line with the national literacy policies30. All participants in centers visited had received a package containing the book, notebooks and stationary. The centers are supplied with blackboards and floor mats. Facilitators receive stationary and guides. 72. MoE/Department of Literacy staff reported that the UNICEF-supported textbooks were considered comparatively better than textbooks used in other literacy programs. Quality was measured in the relevance of content, that text and pictures corresponded, and that the books were easy to use and comprehend. The team noted that the life-time of the books was expected to be a minimum of two years, and preferably three. This makes the textbooks more cost-efficient, but in order to sustain literacy after the completion of the course, a more ideal situation would be if the women could take the books (or other material) back home to read. 73. Other organisations are now coming on board to take a lion’s share of the responsibility for support to literacy programmes. The MoE has succeeded in securing other large-scale support to its 30 UNESCO’s programme LIFE (Literacy Initiative for Empowerment) has been chosen as the national framework for literacy. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 22 literacy programmes (e.g. USAID through UN-HABITAT). It is not clear as yet how these programmes will roll out, and whether or not one might find duplication of work. The programme will be implemented by relative massive technical assistance (20 persons to MoE). It is clear, however, that UNICEF’s support to MoE in literacy is being considered as having strategically built the system’s absorption capacity. 12. Assess to what extent and how has UNICEF increased the capacity (management and monitoring) at the Department of Literacy and 34 Provincial Education Offices. Asses what have been accomplished 74. UNICEF is supporting one advisor to the Department of Literacy to provide overall guidance to the department and on the job-training of its staff to develop capacity to manage literacy programmes. There have been two rounds of management training for 68 provincial and central staff of the Department of Literacy. This training has focused on the importance and process of monitoring, reporting, how to ensure community involvement in the centers affairs, and assisting the facilitators at the centre. At central level staff expressed that its monitoring activities had been greatly improved and that staff undertook monitoring visits to the provinces and districts at least three times a year. Literacy officers and monitors had gained competence to collect, analyze and disseminate data on literacy from literacy centers to province and to the central Department of Literacy in Kabul. Staffs were able to prepare monitoring plans, including their costing, actual monitoring and reporting. UNICEF has supported the central Department of Literacy with computers, printers, scanner and photocopying equipment. The major units within the department were linked electronically and this had facilitated information sharing. The documented results were available only in Dari. 75. At provincial levels the monthly education meetings do provide a good deal of capacity building for the provincial and district staff. UNICEF has also arranged special thematic meetings on topics such as the Child-Rights Convention (CRC). There has been no session related to gender equality issues. There are no systematic efforts to support a staff-development plan for provincial and district personnel. 13. How many campaigns and seminars have been arranged for local communities by UNICEF and have the topics of these been relevant? 76. UNICEF does not arrange campaigns or seminar for local communities. This is under the responsibility of MoE but often with support from UNICEF. Campaign-strategies under the programme have been significantly more modest than the very successful “Back to School “campaign in 2002. UNICEF supports various events that involve high rank officials, community leaders, school children and teachers in connection with National School Day and International Literacy Day. It has not been possible to arrange big events at community levels because of fear of disturbances. In this programme period, UNICEFs main emphasis has been advocacy through the media. The cartoon series “Meena” which runs on TV and radio in both Dari and Pashtu is assumed to have been particularly useful as a tool for promoting girls’ education. It has become popular and attracts a wide audience. Three radio and TV spots have been aired though the major national media outlets as planned. UNICEF is in the process of completing a women’s literacy media programme. 300 banners with messages focusing on literacy have been displayed in major cities and public spaces. Placing banners across the streets has gradually been reduced as effects in areas where literacy levels are low are questionable. 14. To what extent is the UNICEF education programme coordinated with the joint Healthy School Initiative (which includes the special Sida support to Sustainable Water Sanitation and Hygiene (WASH) and to what extent have the results of the Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 23 Healthy School Initiative been seen to sustainable contribute to the results of the education programme, especially in terms of increased girl’s enrolment? 77. MoE staff reported that a weak point in the system is the lack of coordination between MoE and MRRD (under which the WASH programme belongs), both at central and provincial levels. So far there has been little success to incorporate WASH aspects (water and sanitation) in the design and construction of schools at MoE level. The national education programme, EQUIP, has not included water and sanitation systematically. There are currently 4,400 schools without water facilities (well and hand pumps). In the BEGE UNICEF has supported 492 schools to install water and separate toilets for girls. Linkages between these investments and girls’ enrolment are believed to be positive, but have not been verified through actual following up. 78. Other health related areas have progressed better, i.e. hygiene education and distribution of deworming tablets to the children. There has been much better climate for inter-ministerial collaboration in these activities. For example, the course for teachers on health education and childfriendly schools has been developed as a collaborative result between MoE, MRRD, MoPH and other UN agencies. UNICEF hired a consultant to help developing the material into a six-day course to be held first for national facilitators who in turn trained facilitators at provincial levels. All national and provincial trainers were drawn from MoE’s own staff. It appears that UNICEF has played a major role in also motivating a number of NGOs to take on HSI projects. 79. No study or analysis has been undertaken which proves the linkages between the health activities and girls’ enrolment. Community Based Schools (CBS)31 15. Assess the quality and accuracy of the available UNICEF CBS data. 80. Statistics related to CBSs in general, their number and number of students, and distribution on gender, have been unreliable for several years. This is attributed to the following factors: Lack of security has made flow of information from the ground difficult In many Districts CBSs are recently introduced and there have been scanty routines for collection of data. The proliferation of stakeholders and NGOs involved over the last few years, with multiple systems and different monitoring systems. It has been difficult for MoE to keep a complete oversight. Quite a few CBSs have been terminated of different reasons32. Such information is not always reported to MoE. There is too few staff specifically designated to CBS at provincial levels. The CBS Focal Points (who are supported by UNICEF) have the responsibility for monitoring tasks, but this is an overwhelming task for one person alone. 31 Karlsson, P, and Khan, S (2007) propose to use the concept ”CBE” (E for education) and not ”CBS”. As CBS seem to be the most common name; as these small units actually are ”schools” – with students, classrooms and teachers; as ”education” normally is a much boader concept and as the TOR for the current evaluation is refering to CBS, this concept is utilised in this report. 32 Karlsson, P, and Khan, S (2007) indicate following reasons for closure, among which the following are mentioned: a) teachers have quit since they do not receive payment; b) community participation is weak; c) the CBE class has been upgraded to a primary school; d) the CBE class has been merged with a primary school; e) monitoring and coordination have been weak. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 24 A general phenomenon is that data very often are presented without mentioning of source or of time of data collection. Updating of data seems often simply to be made by adding new figures into former tables, and the result is often very confusing. 81. There are reasons to believe that the statistics have become more trustworthy and reliable during the last months for the following reasons: With the introduction of incentives for the instructors at CBS schools the reporting system has improved significantly. The structure where CBS schools are connected as “satellite” schools to a “hub” formal school represents an enhancement in the potential for statistics to get better. The “culture of statistics” is improving within the education sector as a consequence of the EMIS. (And for the next School Survey CBSs will be incorporated). 82. MoE at central and provincial levels were optimistic with regard to prospects of obtaining more correct information in the future. One major step forward, is the development of a common, unified monitoring form for all CBSs. This form, which has been developed in the monthly meetings held between MoE and donors, will be filled in and signed by representatives of CBS and HUB schools, and the District Education Officer. UNICEF has participated actively in the process of developing the new forms. 83. It is MoE’s responsibility to produce statistics on CBSs. For those CBSs supported in the BEGE programme, monitoring which produces the basis for statistical information is done jointly with MoE and UNICEF staff. In 2007, UNICEF took the initiative to carry out a survey or physical verification of the CBS. Structures which did not function were closed down. 84. The new system requires verification of data by District Education Offices and Provincial Education Offices before reporting to MoE central level. MoE is also in the process of hiring monitoring staff to provinces and districts. While concrete results remain to be seen, at least the mechanisms currently being introduced put MoE and its partners in a better position to produce more accurate and reliable data. Ownership and Transparency 16. Assess to what extend UNICEF has worked within the framework of the MoE management system with regard to administration and financing of programme delivery. 85. Ownership issues must be understood in the historic context of aid delivery in Afghanistan where much of the support to education has been implemented outside MoE’s own system. This has not been the case in BEGE. MoE claims full ownership of the programme and underlines the equality which is built into the partnership between MoE and UNICEF. 86. Representatives of UNICEF underlined that in addition to the policy of the organisation to work through Government, it is in practice not possible to operate independent from MoE and other ministries’ representatives at Central, Province or District levels. The Governmental offices at local levels are handling the relationships with beneficiaries and local communities. In addition to working within the MoE system of administration and financial rules, UNICEF helps to strengthen weak areas that affect implementation, and technical support is provided when required in order to improve quality of implementation. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 25 87. Transparency is ensured through the joint planning and review meetings between MoE and UNICEF. These meetings, held at zonal level, involve district and provincial education officials and culminate at the national level with open debates on progress and shortfalls. Based on inputs from the provincial levels, MoE’s Focal Points of each project plan the implementation of the activities with the UNICEF counterpart, and based on these plans, required fund for their implementations are transferred to the MoE. Funds are transferred at national level or provincial levels as appropriate as per request. MoE or its provincial/district office then implement the project activities following MoE's standard policy/procedures. MoE has to account for the funds and submit implementation report as per UNICEF’s rules and regulations. 88. Financial flows for the BEGE Programme are as follows: Cash assistance is channeled through the MoE and its departments Supply items are procured following UNICEF’s standard procedures through UNICEF Copenhagen (for offshore items) and following standard procedures by Supply and Procurement Section of UNICEF (for local procurement). MoE provides details of items required including the specifications of items and its distribution list. Joint planning and budget according to projects and activities as well as implementation timeframe prepared jointly with the MoE. The cash and supply requests are prepared by the respective departments of MoE and are submitted to UNICEF through MoE Financial/Administration Department with official letter and other relevant documents. 89. UNICEF staffs assess their financial control system to be very tight and that incidences of economic irregularity are extremely rare. A lot of staff time and efforts are put into ensuring that all receipts are collected and to double check that supplies have reached the intended beneficiaries and not disappeared on the road. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 26 Diagram 8 MoE and UNICEF - Arenas and links of cooperation for the Programme 17. To what extent and in what way is UNICEF building capacity of the MoE? 90. Based on assessment of information from many different sources the evaluation team concludes that UNICEF is assisting in building capacity of the MoE in Kabul as well as at the government education offices at Provincial and District levels. Provision of assistance takes many forms and is processed through different channels, some of it being direct and some more indirect. Probably one of the most important ways of assisting a government is to strengthen its own capacity to define need for capacity development. Then capacity will have a chance to be enduring and sustained. 91. The following broad categories indicate capacity building of MoE 1) Upgrading of Teachers: teacher training, TEP (13 days), refresher, practice. This is targeted capacity building directed at MoE/UNICEF’s supported schools, CBS, literacy centers. 2) Support to MoE central, PEO and DEO offices through workshops, conferences. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 27 3) Sector strengthening- advocacy at national and local levels 4) Technical assistance such as staff from Colombia University teacher college to do technical support to curriculum development 5) Technical experts (5) in MoE on curriculum, literacy, procurement and communication/media. 6) Linking up with relevant MoE staff for monitoring, reviews, assessments 7) Close interaction between designated staff within UNICEF-MoE. Knowledge and exchange. 92. The specific number of variables of the above is very high, and it is not possible to produce accurate figures for all those events. In view of the team, there is a need for more specific training in systematic improvements in staff development at provincial and district level. It was also noted that there had been no orientation or training in gender issues at provincial level. 93. A general observation of UNICEF’s work in Afghanistan is that many activities and achievements are not appropriately reported to the donors (or other stakeholders). The evaluation team, while not able to identify many issues in periodical reports and papers, got relevant information when UNICEF’s staff was questioned directly. 94. A very direct and essential way of building capacity in the education sector and among the most important categories of MoE staff is to enhance the competence level of teachers. UNICEF has assisted MoE in Teacher education and training over a long period of time. In addition UNICEF is building capacity of MoE staff at all levels (community to national level) through: Regular meetings/discussions, quarterly, annual reviews, and planning meetings provincial and national levels. Provision of computers, printers, photocopiers, scanners for MoE and its provincial education offices to strengthen the capacity of overall management of educational activities and operationalization of EMIS. Provision of technical support in specific areas at MoE (providing experts in curriculum, literacy, programme communication and procurement service). Meetings for working groups dealing with specific issues such as girls education, CBS, Inclusive education etc. Orientation on the financial procedure and accountability to the MoE staff of finance section. Various workshops and training within and outside country, including:, (i) Education in Emergencies Workshop, Planning Workshop of Afghanistan Girls’ Education Initiative, (ii) CBS Provincial Focal Points’ training, (iii) Planning Workshop of Psychosocial Support through Schools, (iv) Management training of literacy, (v) Girls’ Education Initiative, Global Advisory Committee Meeting, (vi) Early Learning and Development Standards Training. 18. To what extent has the MoE ownership of the programme? 95. The answer to this question is “to a very large extent”. This was quite evident from responses throughout the entire fieldwork. BEGE is first and foremost a MoE programme which receives support from UNICEF. References to UNICEF were frequently expressed as “UNICEF works through us”, “UNICEF answers our requests efficiently and swift”, UNICEF is a “part of us”, “we control the resources” and similar statements. Other stakeholders also confirmed that BEGE was fully integrated as a MoE programme. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 28 96. The forms of collaboration and ownership is formalized and regulated in agreements and plans. In practice and in reality today: MoE staff at national, provincial and district levels, and not UNICEF are the implementers. Programme planning, reviews and Annual Work Plans are prepared jointly. Projects and activities budgeted for in the AWP receive financial and technical support from UNICEF. This strengthens the capacities and competencies of MoE staff and enhances prospects for sustainability. 19. What are the main achievements and the main challenges in the cooperation between MoE and UNICEF? 97. Most of the main achievements of the cooperation have already been covered, hence the following is only a summary list, not necessarily in prioritized order. It is important to underline that there are many stakeholders in the education sector and the MoE/UNICEF cooperation can of course not take the honor alone for the achievements. Large increase in school enrolment from 2005 to 2007. Impact on strategies for cost-effective school construction. Supported in development and operationalization of EMIS and teacher registration process. The teacher training has become structured. A little less than 200,000 illiterate women got opportunity for literacy course. Established CBSs, mainly in rural areas for almost 150,000 students. Considerable influence provided in policy development and preparation of position paper development on CBE, whereby the CBS becomes part of the formal education system, connected to Hub-schools. Building strong MoE ownership of the UNICEF supported activities, outputs and processes. Provision of special facilities for upgrading educational qualification of female teachers; Mix of top down and bottom up planning processes initiated, including many stakeholders. Contributed in development of National Education Strategic Plan through engaging national consultants and participating in working groups. Launched Emergency Education Cluster Working Group in July 2008. Distribution of teaching and learning material to all students and the same plus textbooks distributed to MoE/UNICEF CBS schools. 98. There are also a number of challenges. General insecurity in many areas of Afghanistan is of course a severe problem for all parties. Inaccessibility of large parts of the country during winter time represent a large challenge. And the current (September 2008) drought in many areas in the North will impact on all development activities. In addition there are challenges within the development of the education sector per se as well as in the cooperation between MoE and UNICEF: Risk of sustainability - the main BEGE donors might change to other sectors, or other programmes and projects within the same sector. This will hamper the long term perspective and sustainability in education work, which is very crucial. Risk of other actors in the education sector to take over parts of the programme without continuing the processes of working through MoE and strengthening the ministry’s capacity. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 29 Risk for widening the agenda of the BEGE programme too much, for instance in areas where UNICEF as an agency has less experience or in areas that are not related to quality of education (e.g. construction of schools): A challenge of not processing too fast in areas which are considered culturally and historically sensitive. UNICEF seems in many ways to have been balancing well in terms of emphasizing on different issues, policies and inputs. What will the future be for the CBSs? Identifying strategies and resources of further development of the CBS is a challenge. Despite the fact that AGEI was established, its functioning remains a challenge. Inadequate linkages between various departments of MoE. Inadequate coordination and supervision from MoE at National, Provincial and District levels. Shortage of technical staff and frequent transfer of staff in MoE. 20. What is UNICEF’s value added for the MoE (compared to other NGO/donors/advisors)? 99. Generally, MoE staff perceives UNICEF as a strategic partner, not just like another organisation (bank, donor or NGO). UNICEF is considered to offer highly relevant technical advices based upon experiences from its global work. The combination of top-down and down-top relationships was said to put UNICEF in a fairly unique position in conglomerate of agencies working in the education sector in Afghanistan. The top-down dimension was illustrated by UNICEF’s ability to mobilize MoE leadership and also the donor community for flagship issues such as gender equality and disadvantaged children. It was particularly underlined that UNICEF could advocate for these issues through media, both radio and TV, and had funded translations of the global “Meena” cartoons to promote girls’ education. This had become a very popular show which attracted a large audience. UNICEF adds values through the down-top dimension, because UNICEF staff was close to the ground realities even in difficult parts of the country. UNICEF was never out of touch with the security realities, but was nevertheless in close contact with the people on the ground. Its national coverage with rural focus helped MoE to achieve equity in delivering education services more effectively than other agencies which had an earmarked geographical focus around its own PRT establishment. UNICEF was considered to a neutral partner, without hidden political agendas and motives for its support. 100. Although UNICEF is not amongst the largest financial contributors to MoE, it was underlined that UNICEF scored very high on a close relationship scale, as its mode of operation was more of the “accompanying and based on mutual trust “than the “demanding” kind. UNICEF teamed up with MoE staff and provided technical assistance when it was real need for this, not as a more or less standard procedure like some other organisations appeared to do. MoE staff highlighted that UNICEF did not see itself as a competitor to others in the education field. On the contrary, UNICEF was positively seen as a bridge builder between MoE and other stakeholders. For example, UNICEF’s assistance to building the capacity, developing the curriculum and textbooks for adult literacy, made it possible for MoE to expand its absorption capacity for larger programmes. A case in point was the large-scale initiatives from USAID with UN-HABITAT as implementing partner to fund adult literacy. UNICEF’s flexibility was highlighted. During the programme period there were several examples of shift in strategies because other actors came on- board to do training. Instead of duplication of activities, which unfortunately was seen as a result of many other approaches, UNICEF backed out of areas where others could contribute more volumes or more effective support. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 30 21. Have the intended beneficiaries been involved/consulted in the program formulation, planning and goal identification? 101. All MoE/UNICEF activities with a local outreach are planned and implemented involving local communities. The tribal and village councils, known as “Shuras” play an important role in all matters. The Shuras traditionally comprised respected male elders who take decisions in community related affairs. In communities which observe purdah men and women always meet separately. Through the National Solidarity Programme (NSP), Community Development Councils (CDC) have been charged with development tasks on behalf of the communities. The CDCs have technical sub-committees. The team was told that usually the same people were sitting on all committees. Formal schools have School Management Committees (SMC) and PTAs. No formal community-based committees have been established for CBSs or literacy centers. It was argued that adding more committees would confuse the mandate of the existing committees. The team would like to point out that it was not easy to obtain information to confirm that already existing SMC s would take on tasks to ensure true involvement of the communities which have CBSs and not a full-fledged primary school. 102. Even without a specifically responsible committee, communities seemed well position to influence decision-making through the already existing arrangements. A lot of contributions (land, buildings, and time) indicate this, and frequent interaction between MoE, UNICEF staff and the local population seem to take communities on-board in most decisions. MoE has, however, a considerable shortage of female professionals, and the team is concered that because women in most communities can only be reached through separate meetings, women’s voices are not fully heard. 103. In some localities communities are involved in protecting the schools through regular daily and nightly patrols. Parents are little involved in matters directly related to the teaching-learning process. This may not be a loss of opportunity, as many parents are illiterate or have only experienced “old-fashioned” route learning and are unaware of the values associated with improved teaching and learning methods. There is a scope for improving community involvement through orientation in what parents should expect in terms of learning outcomes and teachers behavior. 104. At the level of teachers, all trainings involve evaluation sessions, where the learners can offer their opinion on weak and strong points. This information feeds back to MoE staff at provincial and district levels through regular meetings. 105. UNICEF has financed the training and incentives for 84 so-called Education Protection Officers. They were supposed to be a link between MoE and the communities and to ensure mobilization of the communities for critical decision- making and contributions. The support to these officers has been discontinued. There is no information of whether these officers have functioned according to the intentions and MoE and UNICEF has agreed to evaluate this component by the end of 2008. 22. What mechanisms exist for citizen/community oversight? 106. The most significant recently introduced mechanism is that of a “contract”, between CBSs, MoE and local leaders. This contract is signed, with name and thumb-mark, and states what sort of responsibilities, supplies and functions each partner in the contract should have. Duplications of all contracts are kept at district office, provincial office and at UNICEF office. The contracts are tools for empowering the communities. People will now know what they can expect in terms of books and materials, and at what time. It remains to be seen how responses from “hub-schools” will materialise in practice. But with the contracts in hand the communities at least has a formal back-up for their claims. The system of contracts is not fully institutionalised yet, but the evaluation team is Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 31 very supportive of the attempts to introduce this mechanism to strengthen communities participation in the education of their children. UNICEF Country Office 23. How does the UNICEF country office follow up results of the country programme? Are systems/methods used for the follow up and for the result based management reliable, accurate and effective? Assess the capacity of UNICEF Country Office in terms of number of staff, quality of staff, management, financial management systems, monitoring and evaluation systems, capacity to follow up result, accurate reporting systems from provincial offices to the country office? Is improvement of the systems part of the programme? UNICEF Presence Uzbekistan Tajikistan Badakhshan Kunduz Jawzjan Turkmenistan Balkh Takhar Faryab Baghlan Sari Pul Panjshir Nuristan Parwan Kapisa Kunarha Laghman Kabul Badghis Bamyan Hirat Wardak Ghor Nangarhar Logar Daikundi Paktya Khost Ghazni Pakistan Uruzgan Paktika Farah Zabul UNICEF Country Office UNICEF Zonal Offices Iran Helmand Kandahar UNICEF Outposts Nimroz 107. For managing the UNICEF supported programme in Afghanistan the organisations has a total of around 260 staff. There are 4 Zonal Offices and 10 Outposts Offices. With technical guidance from the Education Section in Kabul, the zonal offices have one education officer designated. Outposts’ staff manages all programmes, including health and education. 108. An overall impression of UNICEF staff was their commitment to the programme. They are highly motivated to travel to remote areas and engage themselves actively in dialogues with the local communities along side with their partners in MoE. Staff competencies seem by and large to match the needs. UNICEF may also draw upon its international pool of staff from the regional office (ROSA) and in some cases the HQs in New York. 109. As with all organizations working in Afghanistan it is difficult to recruit international staffs, especially women, and retain them. Because of the security risk Afghanistan is a non-family duty station. This will automatically limit the range of people interested to come and work there. The Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 32 education section has a total of 14 staff, with 5 internationals. Two positions of the internationals are vacant. 110. In Afghanistan, UNICEF stands out in its efforts to work through the government. Milestones in this process are the joint preparation of annual work plans (AWP) at provincial and central levels. Indicators and result matrix result from this collaborative work. Joint mid-term reviews and end-of year meetings feed into new plans and are the basis for mutual learning. 111. Much of UNICEF’s interaction with others is workshop-based. Reports from the workshops are produced and disseminated. There is, however, little information on how these reports constitute a basis for internal organizational learning. 112. Human resource management involves a range of issues that was beyond the team’s capacity to assess. A few aspects can nevertheless be mentioned. Staffs are encouraged to participate in UNICEF’s computer based learning programmes. This e-learning is also a viable option for national staff to improve its competencies and jump steps up on the carrier ladder within the organizations. This is very positive and creates motivation to stay in the organization at the same time as it provides UNICEF with the competencies needed. 113. There appear to be few opportunities for staff to get involved in internal technical discussions on quality issues and outcomes. Supply issues, quantities and outputs have a tendency to pre-occupy the performance discussions. New staffs joining the programme need better orientation on concepts and issues such as CRC, child friendly schools and how these relate to the Afghanistan context than is currently provided. 114. There is no doubt that MoE has improved its monitoring system with the help of UNICEF. But internally UNICEF should devote more attention to find out what works and what does not work to achieve quality results of programme activities. The reporting to external donors has been of some concern to the latter, and they have often pointed to difficulties in identifying achievements and plans. Donors have voiced their comments and seen considerable improvements lately. Furthermore, a lot of the rich experience that UNICEF has from the field seems to get lost in the present reporting. This is of detriment to both UNICEF and the children of Afghanistan, as donors might not easily see the added value that UNICEF actually provides. 115. UNICEF and MoE have close interaction, but this does not mean that communication cannot be improved. Due to high rotation of staff within the MoE itself, it is important that critical information is put down in writing. 24. To what extent have lessons learned led to relevant changes in the programme? 116. Over the programme period systems appear to have been developed whereby main stakeholders in education sector including MoE and UNICEF have arenas to meet, present achievements, results and share experiences. The programme’s annual meeting in 2007 was an example of a function which creates a basis for joint education sector assessments and learning from experiences33. 117. The need to introduce cash incentives to facilitators and teachers has been one of the most critical lessons that have shaped the future directions of the programme. Afghanis face numerous 33 National End-Year Review Report of 2007 Workplan and Planning Exercise for 2008 AWP 27–28 November 2007 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 33 disasters that are not only related to security issues, but to dramatic crop failure as a result of successive years with drought (Northern Region), high unemployment, displacement of people etc. While future prospects might have looked brighter when the programme was designed, most people met said that their lives had badly deteriorated over the last few years. In short, there is no economic foundation for the communities to provide teachers and facilitators with what was originally expected. The expansion of WFP food for literacy and school feeding programmes clearly illustrates the point. The decision for UNICEF to provide incentives was relevant and much needed. 118. The initial focus on supplying only girls with materials and books soon proved to provoke negative attitudes among the beneficiaries. Parents and children felt that it was unfair to the boys. MoE/UNICEF changed their strategies accordingly. 119. Non-functioning systems or projects UNICEF cannot be accountable for, has been stopped. The decisions not to continue supporting the Education Protection Officers and to close nonfunctional CBSs are illustrative cases to this point. 120. The entire process pursued to reach the point where MoE has formalised the CBS as part of their regular schools, is also a point of change which has altered the profile of the programme. 121. But more should be done to learn from the programme. When pilot projects are established, these cannot be taken to scale unless careful methods are established to find out whether they work or not. The team did not come across current designs or methodologies for such follow up. 122. UNICEF should look more carefully into whether or not it takes on too many tasks for the staff to actually follow them through. It is good that UNICEF has a very flexible approach. This means that the organisation can respond to needs as they emerge. But sometimes there is a risk of taking on too much because the needs are so apparent and visible. A case in point is the construction of cost-effective schools which is usually an area in which UNICEF as an organisation is normally not involved in. The team had no means to compare these schools with those constructed by other organisations, but a concern can be raised of whether UNICEF disposes of adequate competencies to deal with such construction issues. 25. Assess to what extend UNICEF funds to activities (supplies and cash assistance) have been channelled through the government system and the efficiency of the preferred funding mechanism.34 123. In 2006 the United Nation Country Team selected UNICEF as a pilot to try channeling UNICEF’s support through the Government Core Budget. In September 2006 UNICEF entered into Financial Agreements for this purpose with the Ministry of Finance (MoF), Ministry of Public Health (MoPH), MoE, Ministry of Rural Rehabilitation and Development (MRRD) and Ministry of Labor, Social Affairs, Martyrs and Disabled (MoLSAMD). In order to implement this UNICEF assisted the line ministries to route their requests for assistance through MoF. Series of meetings and training were conducted to orient counterparts in the respective line. UNICEF supported MoE with one international and one national consultant to develop procurement procedures in line with Government policy and to train staff at central, provincial and district level. In addition UNICEF recruited a staff to serve as a liaison between line ministries and MoF to make the process functional. 34 MoE was selected by the government to pilot implementation of the new budgeting system (programme budget) for the funding of its eight priority programmes. This was to provide the mechanism for longer-term coordinated donor funding and make resources for planning and implementation more stable and predictable. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 34 124. The experience from this exercise was negative. Despite all efforts, there were serious problems in implementing the process due to its complexity and multitude of activities across all Ministries and provinces. As this caused serious delays in implementing of the programmes, jeopardizing UNICEF’s ability to provide services to children and women in Afghanistan, as well as the organisations ability to raise fund for future activities, the exercise was terminated. In July 2007 UNICEF withdraw from the “core budget exercise”. 125. The financial management system applied by UNICEF in Afghanistan reflects the standard UNICEF financial management system that is in use in all UNICEF assisted countries. Based on the AWPs UNICEF prepares a budget and MoE makes request to UNICEF for fund placement. UNICEF reviews the details of activities and budget line, places fund and monitors implementation of activities at the time of actual implementation at the field level. Implementing partners then submit the report of completion of works and details invoices. The Staff who monitors the activities reviews the documents, certifies invoices and submits to office for processing for liquidation. If any deviation is found in the invoices, UNICEF returns the documents to implementing partners for rectification. Discussion around the relevance, the effectiveness and the efficiency of the roll out of the BEGE-programme.35 126. There is no doubt that the objectives and the main design of the BEGE Programme are as relevant today as when the BEGE programme was started early in 2006. Many agencies have focused on access for education. BEGE has moved a far way towards assisting Afghanistan on quality issues. The relevance of the approach of working through the MoE, may not produce the grandest and most visible results within a short period of time. There may be obvious short time benefits in doing everything oneself, using own staff and avoid the cumbersome bureaucratic processes and capacity shortfalls within the MoE, like many other actors in the education sector appear to be doing. In long run, enhancing capacity and competence within the country’s own national education system, is the only way to ensure sustainability. 127. Provision of literacy classes, outreach schools for remote areas and teacher training will be a focus for a long time in Afghanistan. UNICEF has been a very visible actor in policy discussions, and is perceived by main actors, including MoE to be spearheading in particular girls’ education. There are still huge gaps in educational opportunities for girls and women at all levels. The focus on remote rural areas is obviously relevant also from a security point of view. 128. Then what about the way the BEGE Programme was organized and planned? The approach focusing on close cooperation between UNICEF and MoE seems to become more and more 35 RELEVANCE - The extent to which the objectives of a development intervention are consistent with beneficiaries’ requirements, country needs, global priorities and partners’ and donors’ policies. Note: Retrospectively, the question of relevance often becomes a question as to whether the objectives of an intervention or its design are still appropriate given changed circumstances. EFFECTIVENESS - The extent to which the development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance. Note: Also used as an aggregate measure of (or judgment about) the merit or worth of an activity, i.e. the extent to which an intervention has attained, or is expected to attain, its major relevant objectives efficiently in a sustainable fashion and with a positive institutional development impact. Related term: Efficacy. EFFICIENCY - A measure of how economically resources/inputs (funds, expertise, time, etc.) are converted to results. (Source Sida Evaluation Manual 2004) Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 35 important. Selection of UNICEF, with its long time experience with GoA and MoE is still is very relevant. This report has repeatedly stated the main criteria in this connection: UNICEF works through the Government and not in parallel structures, UNICEF has a national scope and the organisation has its main global mandate and not many other alternative open or hidden, motives. In many ways one can say that UNICEF is a very good strategic partner for MoE – in order to develop the Afghanistan education sector. 129. The BEGE Programme has reached targets set to a relatively high extent. In Afghanistan there are many obstacles for organizational operations and in this light the team concludes that effectiveness in the programme has been good. Delays have to be factored in e.g. it is not possible to proceed unless MoE has worked out its standards, content of books etc. Analyzing line by line in the Log-frame shows that results are obtained. When changes in the programme have happened and new activities have replaced old ones, the evaluation team has been given reasonable explanations. As effectiveness also has a more general connotation the evaluation team underlines that the programme has attained (or will attain when the programme period is over) its major relevant objectives and that elements of sustainability and positive institutional development impacts have been attained. Major unintended negative effects have not been identified. 130. UNICEF is going to conduct an internal review and audit of the Afghanistan programme by the end of 2008. For the team it was a concern, however, that it is difficult to get a consistent oversight over UNICEF’s use of funds allocated over time. Tables do sometimes not consistently report on the issues under the same headings and this make following the expenditure patterns difficult for outsiders. In 2007, the utilization of budgets for the three project categories was as follows 1) Support to Sector reform and Community Development - 89%, 2) Quality of Primary Education with a Special Focus on Girls’ Education - 82% and 3) Women’s Literacy and Gender Empowerment - 76%. Remaining funds are transferred to the next year. 131. In terms of cost-efficiency analysis of the BEGE programme, or comparison of achievements with other countries, one needs to consider the special Afghanistan challenges. The harshness of nature, environment and climate add to costs of all development work, and hostility and war make large parts of the country insecure or even inaccessible. It has been estimated that security measures add 30-40% to UNICEF’s expenditures in education related work. The approach taken by the organisation is often to develop models and pilots, to open new visions and methods, to motivate and motivate others. Almost per definition this costs. Another is the UNICEF practice of working through, capacitating and mobilizing the MoE and GoA structures. One would presume this is more expensive than the alternative; to establish a “parallel structure”; to implement what is needed and then disappear. The advantage of the UNICEF approach is, however, to be measured over time and in sustainability and capacity building terms. 132. However, this does not imply that UNICEF is more expensive than other actors. The organisation and its staffs, to the knowledge of this evaluation, are very cost-sensitive. Highly qualified staff with long experience from Afghanistan means also a lot in terms of efficiency. And in certain fields UNICEF is reckoned by other stakeholders to be cost-efficient. This is for instance in the field of school building and in distribution of teaching and learning materials. And not least, UNICEF in Afghanistan is under very strict rules and regulations, set by the UNICEF organisation with the imperative to work efficiently to satisfy the global mandate to assist children and women. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 36 Main Conclusions and Recommendations 133. UNICEF and the Government of Afghanistan have had an agreement of cooperation for 56 years, and UNICEF has worked in the country under very shifting frameworks and conditions. UNICEF is among the oldest and most reputed actors in the field of development in the country. The evaluation team concludes that UNICEF undoubtedly has played a very significant and crucial role in development of education over the years and not least from 2006 to 2008. UNICEF is providing important added values, compared to many other stakeholders. Some of the main aspects are: 134. UNICEF is primarily working through the Government and not in parallel structures. This is essential to strengthen Afghan government’s capacity dealing with education and training. 135. UNICEF maintains a nationwide approach. Currently many donors and actors in Afghanistan earmark their support to limited geographical areas. For GoA and MoE it is very important to collaborate with strategic partners which maintain a nationwide scope to facilitate planning, monitoring and reporting, for principles of equity and equality, and in order to pursue Education for All and Millennium Development Goals. 136. The volume of assistance is modest, compared to some of the large donors. UNICEF does not come with huge technical assistance programmes to be placed in respective departments within MoE. On the contrary, UNICEF seems to place its resources strategically, for instance by capacitating and strengthening institutions so that they can take on larger programs supported by others. The Department for Literacy might serve as an example in this perspective. 137. UNICEF is operating in accordance with its fundamental mandate – for children and women – and has no other hidden political, cultural or economic motives. In a country like Afghanistan this characteristic is only shared by a few others organizations. UNICEF has maintained this profile over time and through different regimes. The traditional national game Buzkashi is said to reflect the boldness and fierce competitive spirit of the Afghan people. In this game which is played on horseback in competition between two teams a carcass (headless calf or goat) is dragged, pulled and carried and the objective is to ride with the carcass over a certain distance and then drop it at the “goal”. In an interview with one MoE official the evaluation team was told that MoE (sometimes) was felt to play the role as the Buzkashi calf or goat, helplessly pushed and dragged between strong actors. This picture is not exactly illustrating an active Government Ministry who is to be in the driver’s seat with regard to education development. During complicated and complex times in Afghanistan, where nation building is assumed to be in focus, many national and international organisations are giving priority to their own interests; political, cultural/religious, economical or geographical. UNICEF is instead focusing on MoE’s ownership and has, contrary to many others, the same national scope and coverage as MoE and with the interests of the Afghanistan children in focus. 138. At the operational level, the various components have been relevant and critical to empower children in remote areas and women who have never before had opportunities for education. UNICEF has helped MoE to structure approaches, supporting the district and province levels, in primary school education through the formalization of CBS, teacher training and women literacy. Girls’ education is high on the agenda. Female teachers are prioritized, and progress has been made, but in rural areas it is still very difficult to find enough women to teach. 139. UNICEF is a flexible partner in its provision of assistance, funds and services, compared to other actors. Through BEGE UNICEF has demonstrated its ability to respond to emerging needs and shift strategies that prove not to work as intended. Flexibility in this sense does not mean unplanned Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 37 or unstructured. Because of its rapid procurement systems UNICEF can also respond to emerging needs and adapt quickly to changes. 140. Transparency on both UNICEF’s and MoE’s side through the mid-term and end of year review. UNICEF’s education programme is demand driven and plans are aligned to provincial and district capacity to implement. The system enhances accountability. 141. Monitoring of activities is still a challenge. UNICEF has improved both own systems and not at least that of MoE. But monitoring still tends to focus on the quantitative sides at the cost of following quality processes through and find out what really happens at the other end. The drive for quantification is also reflected in the reporting system which often was found lacking information of processes and information about effects and outcomes. 142. Internally, more could be done for new staff to refine their understanding and knowledge of essential concepts such as child-friendly schools, improved teaching –learning outcomes, CRC and so forth. Furthermore, there are still few arenas for staff to reflect on effectiveness of strategies pursued and their impact. 143. UNICEF is visible at the education scene, and was characterized by all sources of information, to be spearheading gender issues. In this connection UNICEF can utilize its international network and establish international cooperation and relationships between actors in Afghanistan and the rest of the world. 144. UNICEF appears to work effectively and efficiently and it is the impression of the team that staffs are very committed, hard working and carrying out their assignments professionally. Competencies seem to match with requirements, and in many cases achievements exceed targets set. There might be a tendency to take on too much in the programme, given the difficulties in recruitment of staff and the security concerns of the country. 145. MoE staff consistently confirmed their ownership of the programme. Recommendations 146. The evaluation team has read and generally supports the recommendations made during the Preparation Meeting for Mid Year Review with Ministry of Education on 21st of July 2008. In the following, some additional recommendations are provided: 147. → Continue support Donors, including countries as Sweden and Norway should continue supporting the MoE/UNICEF education programme. UNICEF has national coverage and straightforward policy to support MoE ‘s own efforts and is considered a credible partner in the development of the education system in Afghanistan. Secondly, it s quite clear that UNICEF delivers on its agenda and that the combined access/quality approach bears fruits. Other programmes tend to have a more narrow approach on access issues. Thirdly, UNICEF has demonstrated that strategic capacity building of MoE can be more efficient than sending in an army of more or less permanent technical advisors to do the work on their own. 148. → Follow up CBSs There is an urgent need for a review focusing on results and impact of the CBSs. It is particularly important to find out what happens with the Grade 3 leavers (tracer) so that necessary follow-up action can be taken. Local conditions (and distance to formal schools) will define whether one should add grades at CBSs or develop other solutions. Further expansion of the CBS systems in new Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 38 localities seems also to be needed. Development of the CBS system requires long term planning and financing framework. 149. → Improve monitoring There is a need for studies and specific initiatives to find out the longer term effects of the programme’s activities. Pilots need to be assessed for their potential for larger scale expansion. 150. → Give literacy learners more to read! Women should receive reading materials after they have completed the literacy training. In rural areas of Afghanistan there are often few incentives for new literates to continue to read and extend their information basis. Literacy and numeracy need to be maintained and supported over time and there are no libraries to borrow books from in rural Afghanistan. The evaluation team will recommend that UNICEF produces a source book to be given as a graduation gift to take home. The source book could include information about the society, governance, practical information related to nutrition, education, agriculture, basic health care etc, and introduction to the world, with maps, information about other countries, information about modern equipment etc. It is of course crucial that this source book is based on the knowledge levels of the learners – and is presented in an accepted cultural and religious way and form. The evaluation team believes this proposal is very important and that UNICEF, in close cooperation with MoE, is the right organisation to do it. 151. → Revisit AGEI There is a risk that AGEI will slowly dwindle away unless this platform or network get a significant boost and energy injection which enable it to become a real advocacy factor for girls’ education. Because women’s situation is so vulnerable in Afghanistan, there is a risk of including too many aspects into a working group approach. AGEI should focus its advocacy sharply and strategically. A matter of immediate concern seems to be to focus on the impact of boundary walls for girls’ enrollment, and to follow up this issue. 152. → Reconsider whether school construction should be UNICEF’s focus There are many other actors in school construction, and very few in areas concerning reaching the most vulnerable children such as those currently outside the mainstream education. Inclusive education should come higher up at UNICEF’s agenda. 153. → Streamline reporting Throughout the evaluation it turned out to be a concern that external partners found that UNICEF’s thematic reports were too vague on achievements and analysis and that it was not always clear what the agency was doing, and why. These reports do not give full justice to what is actually done and the evaluation team found that many interesting and important aspects of the programme were never reported. 154. → Special project to bring urban female teachers to rural schools. It is proposed to study ongoing pilots where female teachers living in urban areas are provided support (transport and some incentives) to teach in rural schools. If feasible such pilots could be developed further and expanded with the aim of attracting more female students to school. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 39 Annex 1 Terms of Reference UNICEF (United Nations Children’s Fund) education programme: “Basic Education and Gender Equality Programme (BEGE ) for 2006-2008” Purpose of the Evaluation The main purpose of this evaluation is to assess if UNICEF’s stated objectives has been accomplished during the evaluated program period. Background The overall objectives of the BEGE programme are to reduce gender disparity in basic education and to improve the quality of education for all children and increase adult literacy focusing on women. The Ministry of Education (MoE) being the leading partner is providing the overall framework for support. MoE and its line departments as well as provincial and district education offices are responsible for management and implementation of the programme. The programme shall address the following key issues related to girls’ education and female literacy through five strategies; disparity reduction, capacity building, institutional linkages, community participation and expanded educational facilities. Information about Sida The overriding goal of Swedish development cooperation is to contribute to making it possible for poor people to improve their living conditions. Sida works on behalf of Sweden's Parliament and Government to reduce poverty in the world. Its activities range over many areas. Sida has more than 120 partner countries in Africa, Asia, Latin America, Europe and Central Asia. Sida has in-depth programmes of cooperation with some 50 of these countries. It is Sweden's Parliament and Government that stipulate the budgets, the countries that shall be included in Swedish development cooperation, and the focus of cooperation. One important point of departure is that each partner country is responsible for its own development. Sida's mission is to create opportunities for change and development. In addition to direct cooperation with individual countries, Sida also administers the Swedish contributions to the development cooperation programmes of the UN and EU. Every year Sida implements more than 5 000 contributions. Sida implements are in the fields of education, health, private sector development, housing, rule of law, research, infrastructure and trade. There is a large budget for emergency assistance for people affected by wars or other disasters. Poverty has many aspects and requires different solutions. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 40 Sida's staff rarely works with the projects. Instead, they are implemented in practice with the aid of some 1 400 partners in cooperation, often Swedish, financed by Sida. Since Swedish organisations, companies, government agencies, societies and experts are involved in the work, development cooperation also contributes to development in Sweden in the long term. For more information, please see Sida’s homepage: www.sida.se 1 Evaluation Purpose Sida’s ongoing agreement with UNICEF Afghanistan will come to an end in December 2008. Norway’s agreement is valid for the same programme period. Sida and the Norwegian Embassy have commissioned this evaluation jointly. Norway entered into the agreement with UNICEF following a review of the education sector in early 2006. The review recommended using UNICEF as a channel until the preferred transfer of funds directly to government for EQUIP (the education programme with MoE) would be up and running. The evaluation will feed into the internal discussions within Sida36 on future support to the UNICEF Education Programme, while for Norway it will be an end-review. In addition a new Swedish Strategy for Development Cooperation with Afghanistan will be finalized in the first half of 2009. The evaluation will feed into the overall analysis of the education sector in Afghanistan in preparation of the upcoming strategy. 2 Intervention Background Sweden has given support to education in Afghanistan since early 1980’s. Sida has three partners in the education sector; Swedish Committee for Afghanistan, Bangladesh Rural Advancement Committee and UNICEF. UNICEF has received thematic funding for a girls’ education programme since 2003 through the agreements 2003-2005 and 2006-2008. During 2006-2009 Sida also provides global funding to UNICEF for Sustainable Water Sanitation and Hygiene (WASH) in schools, out of which 700 000 USD have been programmed for activities in Afghanistan. The Norwegian Embassy is currently providing thematic support to the UNICEF Afghanistan Education Programme, namely to child friendly schools to increase attendance of girls and the number of trained female teachers, as well as literacy training particularly to women. In addition UNICEF has global funding from Norway being used in Afghanistan. The Norwegian Embassy is co-financing the UNICEF education programme with NOK 21 million 2006-2008. There have been major discrepancies in the thematic financial reports from country level (UNICEF Afghanistan Country Office) and HQ (UNICEF HQ in New York). After Sida commented on this, the reports were revised. In May 2007, Sida commissioned a study on Sida supported Community Based Schools (CBS) in Afghanistan. The study showed that there might be UNICEF registered CBS which are not listed with the MoE. The UNICEF Afghanistan Country Office decided not to call for an extra audit from UNICEF HQ or a 36 The Sida office in Kabul, ASIA Department and UND Division. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 41 special investigation on this. Therefore, Sida decided to commission this evaluation of the UNICEF Education Programme. 10% of Sida’s support for 2007 is withheld until the evaluation is finished. Norway joined Sida in the evaluation, for the purpose as mentioned above. Since this initiative was taken, UNICEF has decided to carry out an evaluation of the whole UNICEF programme in Afghanistan. Sida and the Norwegian Embassy were invited to take part in this evaluation. However, due to the concerns raised above, both Sweden and Norway decided to commission a separate evaluation. Sida and the Norwegian Embassy will give input on the ToR for the UNICEF evaluation. During the preparation of the ToR for the evaluation, Sida and the Norwegian Embassy have had discussions with and have received input from UNICEF and comments from the Ministry of Education (MoE). 3 Assumptions and Risks The volatile security situation in Afghanistan is the major risk for not achieving this assignment. 4 Contract objectives The evaluation team shall present a design, approach and the methodology to answer the evaluation questions. This will be assessed according to price, competence and composition of the teams, design of the evaluation, approaches and methodology. The evaluation team shall present a methodology in their tender on how to design the evaluation in order to answer the evaluation questions (see Tasks-Evaluation Questions on page 4-5). The methodology shall be discussed with, and accepted by Sida before signing the contract with the evaluators. Scope of Work The evaluation team shall indicate for each output and outcome results37 what have been accomplished in the relation to the UNICEF stated objectives during the identified program period. The answer to the evaluation questions shall include an analysis of the programme performances, problems and limitations. The overall evaluation shall also include a discussion around the relevance, the effectiveness and the efficiency of the roll out of the BEGE-programme. The evaluation shall give recommendations and provide input on how to improve and develop the UNICEF Education Programme. Lessons learnt, if any, shall be mentioned. In addition, recommendations in terms of amount of funding, design of the funding and possible future support to the UNICEF Education Programme shall be given. 37 As defined in Sida’s publication “Strengthening Sida Management for Development Results”. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 42 Tasks-Evaluation Questions 4.1 The Programme 1. To what extent has the programme been successful in achieving its planned results38? 2. Has the gross enrolment in basic education for girls increased by 20%? 3. How many girls and boys respectively are enjoying child-friendly schools and have attained acceptable level of basic competences? 4. How many learning spaces (CBS) have been provided for girls and boys respectively in remote areas? 5. How many teachers, male and female respectively, have been recruited and trained and are still working? 6. Have the following been distributed and arranged: teaching-learning materials, sports equipment and games, health education, recreational facilities, awareness campaigns, teacher and management training? Has UNICEF specified standards for the quality of these materials, equipment and services? Are they up to these standards? 7. Assess to what extent and how UNICEF has supported MoE in developing policies for girls’ education and for education of disadvantageous children including nomad children? Asses what have been accomplished. 8. Assess to what extent and how UNICEF has supported MoE in developing new gender sensitive curriculum and textbooks, improving teaching-learning methodologies and introducing assessment systems. Assess what have been accomplished 9. Assess how many women have attended learning centres and if they have gained functional literacy skills as a result of UNICEF activities. 10. Assess how many decision-makers and communities have been mobilized by UNICEF in favour of adult literacy in general and women’s literacy specifically. 11. Assess how many learning centres with female teachers have been provided by UNICEF. Assess the teaching materials of these centres. 12. Assess to what extent and how has UNICEF increased the capacity (management and monitoring) at the Department of Literacy and 34 Provincial Education Offices. Asses what have been accomplished 13. How many campaigns and seminars have been arranged for local communities by UNICEF and have the topics of these been relevant? 14. To what extent is the UNICEF education programme coordinated with the joint Healthy School Initiative (which includes the special Sida support to Sustainable Water Sanitation and Hygiene (WASH) and to what extent have the results of the Healthy School Initiative been seen to sustainable contribute to the results of the education programme, especially in terms of increased girl’s enrolment? 4.2 Community Based Schools 15. Assess the quality and accuracy of the available UNICEF CBS data. 4.3 Ownership and Transparency Please specify the criteria used in the assessment. 38 As presented in the UNICEF and MoE programme document. “Basic Education for All 2006-2008” and UNICEF “Programme Plan of Operations”, these documents are the baseline to assess all achievements and results. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 43 16. Assess to what extend UNICEF has worked within the framework of the MoE management system with regard to administration and financing of programme delivery. 17. To what extent and in what way is UNICEF building capacity of the MoE? 18. To what extent has the MoE ownership of the programme? 19. What are the main achievements and the main challenges in the cooperation between MoE and UNICEF? 20. What is UNICEF’s value added for the MoE (compared to other NGO/donors/advisors)? 21. Have the intended beneficiaries been involved/consulted in the program formulation, planning and goal identification? 22. What mechanisms exist for citizen/community oversight? 4.4 UNICEF Country Office 23. How does the UNICEF country office follow up results of the country programme? Are systems/methods used for the follow up and for the result based management reliable, accurate and effective? Assess the capacity of UNICEF Country Office in terms of number of staff, quality of staff, management, financial management systems, monitoring and evaluation systems, capacity to follow up result, accurate reporting systems from provincial offices to the country office? Is improvement of the systems part of the programme? 24. To what extent have lessons learned led to relevant changes in the programme? 25. Assess to what extend the challenging of UNICEF funds to activities (supplies and cash assistance) have been channelled through the government system and the efficiency of the preferred funding mechanism. 5 Logistics and timing UNICEF Education Programme “Basic Education and Gender Equality Programme (BEGE) for 2006-2008” is carried out in Afghanistan and the evaluation shall take place in Afghanistan. Due to possible security restrictions, the team of consultants will have to coordinate and consult the UNICEF Country Office as well as the Swedish Development Cooperation Office in Kabul, in order to define which provinces to visit. However, field visits shall take place in at least two locations. The evaluation shall take place as soon as possible by the latest the evaluation shall be finished and the final report shall be received by 15 September 2008. The evaluation should cover the UNICEF Education Programme “Basic Education and Gender Equality Programme (BEGE) for 2006-2008” during time period 2006-mid 2008. 6 Gender balance The assignment of this evaluation shall follow Sida’s Gender policy. The team of consultants shall be gender balanced. 7 Reporting and Documentation The report shall be written in English and shall include an overview, executive summery, results in comparative manner, all easy to overview. The report shall not exceed 30 pages. A draft shall be presented to Sida and the Norwegian Embassy as specified in the contract with the consultants. After the evaluation team have received comments from Sida, the Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 44 Norwegian Embassy, MoE and UNICEF, and acceptance of the final version by Sida and Norwegian Embassy, a final report shall be presented in a printable version. The conclusions shall be presented at a seminar in Kabul where UNICEF and MoE will be invited for a discussion on the report’s findings. 8 Profile of the Consultants and Staffing Requirements The evaluation team for this study shall be experienced in evaluation methods, have documented experience of the education sector in transition/post-, conflict countries. The team leader shall have documented working experience in leading evaluation teams. The team shall have competency in inclusive education, rights-based approaches, and gender equality perspectives and have a high degree of cultural knowledge when it comes to education in Islamic countries. 10 Budget The estimated amount of man weeks is 8 weeks. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 45 Annex 2 Result table. The Log-Frame with UNICEF’s status for 2006 and 2007, and the evaluation team’s comments of August 2008 (in blue and cursive) Columns below are copied from Annex 3 to UNICEF’s Thematic Report of 2007. Results Indicator Strategic Result 1 Increased basic education net enrolment for girls by 20% by 2008. Net enrolment ratio in primary school - Girls Outcome 1 1.8 million girls are enjoying child-friendly schools -Number of girls enrolled in school from grade 1 to 6 -Number of girls reached grade 6 in 2007 Output 1.1 Output 1.2 Output 1.3 Policy/strategy developed for girls’ education and education of disadvantaged children including Kuchi children of Afghanistan. -Existence of Girls’ education policy/strategy Status (2006-2007). UNICEF’s comments Evaluation notes August 2008 -1,738,326 girls enrolled in schools grades 1-6 UNICEF was not clear whether this was (G1-6) or (g1-9). EMIS 2007: (G1-6): 1,738,326 and (G1-9): 2.11 mill. -200,523 girls reached in grade 6 in 2007 When a student is enrolled - registered as that for 3 years, whether s/he is in school or not -AGEI launched in collaboration with 20 partners and AGEI workshop held as an entry point to Girls’ education policy High level workshop. -Situation Analysis of Girls Education in Afghanistan undertaken. Needs Assessment for disadvantaged children underway (UNESCO).UNICEF piloting in three schools. -Number of community based schools established in rural areas; -3,643 community-based schools established for 136,611 out-of-school children; Baseline was 1,725 and target 16,725. As per Aug 2008: 3,724 CBSs for 148,340 children (UNICEF data) -Number of classroom constructed - Construction of 1,180 classrooms completed. -Number of temporary learning space (classroom tents) installed and used as classroom -3,028 classroom tents provided as temporary learning space. 3,458 classroom tents/learning spaces provided to MoE. Can be several shifts in school also 15,000 qualified teachers in place in rural schools. - Number of teachers working in rural schools. EMIS does not split for rural/urban but UNICEF works mainly in rural and remote areas. EMIS distinguishes between cold, very warm etc. not F/M -Number of female teachers working at rural schools - 100,814 (with 14,314 female) teachers working in rural areas. 54,275 teachers in total have been trained in INSET 1. 14,872 are CBS teachers (only 10% are female) 15,000 learning spaces for girls are in place at remote rural areas. -Number of female teachers got training -14,314 female teachers working in rural schools Girls are getting priority. Government accepting CBS 139 schools been constructed with 900 classrooms. 1,309 classrooms in progress. -22,385 female teachers ( both from rural and urban areas) got training during 2006-2007 Female: 2006:8,110 2007: 14,285 Output 1.4 Teaching-learning materials for 1.8 million girls of 7-12 years - Number of girls received T-L Materials - 1,738,326 girls received TLM in 2007. Result is 2.16 million children and 85,787 teachers in 2008 (UNICEF data.) CBSs also get textbooks. UNICEF’s support development, Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 46 Columns below are copied from Annex 3 to UNICEF’s Thematic Report of 2007. Results Indicator Status (2006-2007). UNICEF’s comments Evaluation notes August 2008 Danida the printing. From 2009 no textbooks, but only notebooks and stationary. Changed strategy to also include boys. Output 1.5 Safe learning environment established in all girls schools -Number of schools established WASH facilities; - 492 schools provided with safe water, 460 provided with separate toilets for girls and boys and hand washing facilities. -Number of schoolteacher received hygiene training; - 68 master trainers trained and 2,200 teachers trained on school hygiene in 2007. -Number of children received deworming tablets. Output 1.6 Recreational facilities in place for 1.8 million girls at schools. MoE cancelled - sports and games. Instead this will be included in the psychosocial package Output 1.7 7,800 schools and office practiced improved management Output 1.8 900,000 families sent and retained their girls at schools. Outcome 2 Emergency supply at stock for 40,000 students and 1,333 teachers 50% girls completed primary grade attained acceptable level of basic competencies Deworming is also taken up by e.g. SCUS. Target reached. Teacher training 48,000) (which had to be dropped 07- energized. All preparatory activities. Printing of resource guides, facilitators, master trainers, manuals -Number of teacher received training on participatory learning methodologies -61,306 teachers received training on participatory methods. (INSET I) -Number of schools that have recreational facilities -1,000 recreational kits bought for 1,000 schools for about 200,000 school children (will be distributed in 2008). Recreational kits part of emergency ed. An Education in Emergency cluster has been established. Workshop. MoE requested World Bank and USAID to implement this activity UNICEF is more directed towards DEO and PEO administrators -1,738,326 girls enrolled in grades 1-6. Retention is very low in CBS. Formal school has a big drop-out. -Number of children benefited with recreational kits -Number of girls enrolled in school from grade 1- 6 -Number of girls reached grade 6 Output 1.9 -5.6 million Grades 1-9 children received a round of deworming in 2007. These are related to formal schools. Still a huge problem as construction design is not including this. Problems of coordination between MoE/MRRD HQ and Province levels. EMIS: G1: 480,808 (Boys) 315,895 (Girls) -200,523 girls reached in grade 6 in 2007 - Number of targeted student and teachers that have supply in UNICEF’s warehouse as emergency preparedness and response plan -Emergency supplies for 40,000 students and 1,333 teachers were in stock as emergency preparedness and response plan. - Number of children received emergency supply items -68,064 children received emergency supply items. (2006+2008) % of girls got pass marks in grade 3 qualifying examination. 70.76% girls got pass marks in grade 3 qualifying examination in 2007 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan No cohort analysis is found. Supplies in the ware house are always there. Items procured one year in advance Survey does not distinguish girls and boys Fail in one subject, will reappear on exam Grade 2 and Grade 3 exam. Page 47 Columns below are copied from Annex 3 to UNICEF’s Thematic Report of 2007. Results Output 2.1 Gender sensitive curriculum and textbooks developed for grade 2-9. Indicator Status (2006-2007). UNICEF’s comments Evaluation notes August 2008 -Number of textbooks developed -14 textbooks of local language developed. All titles were said to be scrutinized for possibly gender discrimination- -One sample chapter developed for each of 152 titles of textbooks- Science, math, languages, and 24 titles of Islamic education. UNICE has been a very central actor in Curriculum and textbook development. Output 2.2 Improved teaching-learning methodologies practice at 70% schools - Number of teachers trained on teachinglearning methodologies (Of all schools 1-9) - Number of trained teachers practiced trained methodologies at classroom Output 2.3 Improved pupils’ assessment system in place and practiced. As part of teaching learning methodology-in built. Not end of sector or of months Strategic Result 2 Outcome 1 Output 1.2 -Number of trained teachers practiced trained methodologies at classroom An increase of 50 % in literacy rates among females of 15-49 years old by 2008 - Literacy rate of 15-49 year-old 90,000 illiterate adult, especially women attend learning centre and empowered with literacy skills. -Number of illiterate women enrolled in literacy centres Some inconsistencies in figures Output 1.1 -Number of teachers trained on improved assessment system; -Number of women empowered with literacy -Number of illiterate women who completed 9-month literacy course -61,306 teachers trained on teaching-learning methodologies including assessment system. -Assessment not carried out on how many teachers are practicing -61,306 teachers trained on teaching-learning methodologies including improved assessment system. -Assessment not carried out on how many teachers are practicing TTCs incorporated gender as a course component UNICEF seems to have a fairly hand-on approach as far as distribution to CBs is concerned 2007: approx 140,000 teachers in general education. TEP package Ok, target will prob. Be reached in 2008. MoE does not have a system for following up. USAID will do something on competence based assessment. Cannot be assumed that because teachers have got training, things are solved. But potential is there through the continuous assessment which is made possible due to new textbooks. Baseline 14% and target 21%. Very uncertain baseline. -86,030 women empowered with literacy - 224,028 new illiterate women enrolled in literacy centres. -86,030 women completed a 9-month literacy course UNICEF reports 192 000 enrolled, this far exceeds the target. 7,000 learning centre are in operation. -Number of functioning literacy centres established 7,466 centre of a 9-month literacy course established. Target exceeded 1,200 female teachers (facilitators) taught at learning centre -Number of female teachers recruited at learning centres -7,466 teachers (with about 70% female, no exact sex segregated data available) recruited in learning centres Satisfactory. Target exceeded. - Number of female teachers trained Private homes used as “centres” - 7,466 teachers (exact number of female teachers not known) trained. 7,466 teachers taught the 9month literacy course in literacy centre. -Number of female teachers taught the 9month course of literacy at literacy centre Output 1.3 Learning materials used by 90,000 illiterate female in the -Number of women learners received teaching-learning Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan -224,028 women learners received teaching-learning Target exceeded. Also including blackboard and floor-mats. Also Page 48 Columns below are copied from Annex 3 to UNICEF’s Thematic Report of 2007. Results classroom. Indicator Status (2006-2007). UNICEF’s comments Evaluation notes August 2008 materials. materials. supporting other agencies (WFP). But have to give back after course Output 1.4 Output 1.5 Outcome 2 Improved management practiced by Department of Literacy (DoL) and 34 Provincial Education Office Improved monitoring practiced by DoL and 34 provincial education staff Decision makers and community mobilized in favour of adult literacy especially for women’s literacy. -Number of staff trained on monitoring and evaluation; -Number of monitoring visits made by DoL and PEO staff -Figures not available with UNICEF -Number of monitoring reports made by DoL and PEO staff -Figures not available with UNICEF -Number of monitoring visits made by DoL and PEO staff -Figures not available with UNICEF. Monitoring by DoL and PEO done regularly - a learning centre visited every 3 months. -Number of monitoring reports made by DoL and PEO staff -Monitoring reports prepared on quarterly basis with findings of monitoring visits -Number of illiterate women enrolled in literacy centres - 224,028 new illiterate women enrolled in literacy centres. -Number of illiterate women who completed a 9-month literacy course Output 2.1 Output 2.2 -68 literacy staff of central and provincial levels trained; Presidents’ office, relevant ministries and development partners motivated in favour of literacy programme focusing on women. -Literacy in priority list of MoE Communication campaign implemented at national level and intervention area. -Number of TV and radio spot broadcasted in favour of women’s literacy. -MoE develop a national literacy programme involving major donors Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan - 86,030 women completed a 9-month literacy course -Literacy is one of 8 priority programmes in MoE’ 5-year strategic plan Direct monitoring by supervisors who are responsible for ten classes each (average). The system improved. Weekly meetings between supervisor and facilitators. Satisfactory. Monitoring improved. Observations from all people met during fieldwork indicate that communities are mobilized. No problem to fill “classes”. Participants eager to explain benefits Satisfactory -National literacy programme developed 2 for each of TV and radio spots developed and broadcasted. Satisfactory Page 49 Annex 3 Itinerary of the team Evaluation of MoE/UNICEF BEGE When What Where Saturday August 9 Team arrives in Kabul Kabul 09.00-12.00 Introductory meeting Ann Marie Fallenius, Robert Peszowski and Marina Nawabi (from Swedish Embassy) and Kristin Hauge (from Norwegian Embassy) Swedish Embassy, Kabul 12.30 Meeting with Norwegian Embassy: Morten Bjørnenak, Arne Knapskog Norw. Emb. Kabul 16.00 UNICEF, Catherin Mbengue, (UNICEF Representative), Fazlul Haque, Abdul Samad Ghafoori and Miki Tanae MoE, Susan Wardak, (Senior Advisor and Head of Teacher Education Department), Seddiq “Weera” UNICEF Sunday August 10 Monday August 11 09.30 10.15 MoE, Mr. Basir, (Advisor/General Education) 10.45 MoE, Mr. Abdul Wassay Arian(Senior Advisor, Curriculum Development) MoE 12.30 15.30 20.00 Tuesday August 12 10.00 12.00 14.10 MoE, Shafiq Quarizada, (Senior Advisor, Literacy). Ata Mohammad, (Head of Planning Dept, Department of Literacy). MoE, Eng. Salim Qayoum (EQUIP, MoE). Several other staff from EQUIP. Informal dinner with UNCEF Representative Catherin Mbengue, Fazlul Haque, Departure to Mazar Meeting UNICEF office in Mazar, Ahmadshah Azizyar (Education Specialist), Hashmat Latifi, (Programme Assistant), Sebghatullah Eng. Salimi (PO – WES), Samad A.S. Shafouri (Education Specialist), Khatol Axbary Basir (Programme Assistant), Mauloada Yaquby (Programme Assistant), Suman Shanshoeva (Project Specialist), Khaled Sadiq (PME Officer), Zabiullah Wahedi (Supply Officer) Kabul Mazar Balkh Province Visit MoE/UNICEF literacy class (21 women present) in Mazar. Ms. Kobra Jan (Instructor), also present: Abdul Satar Mirza (Literacy Director), Najiba Jan (Master Trainer), Muhboba Jan (Supervisor) Visit MoE/UNICEF literacy class (16 women present, Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 50 When What Where 2 babies) in Mazar. Ms. Kobra M. Mosa (Instructor), Ms. Masouma 15.30 Wednesday August 13 06.30- 09.30 10.00 11.10 11.30 12.00 12.30 13.30 15.10 15.45 Thursday August 14 Friday August 15 Saturday August 16 16.10-19.00 09.00 11.50 12.50 Visit MoE/UNICEF literacy class (15 women present, several absent due to funeral). Ms. Nelofar (Instructor) Meeting Visiting MoE Office for Northern Region, Mazar. 10 staff members present, including: Satar Mirza (Literacy Director), Sadiq Khan (Supevisor), A. Ghafar Dashti (CBS Focal Point), Zekrullah Khan (Supervisory of Teaching), Jalis Halimshah (Supply and Logistics), Qanoon Haider (Deputy Director), Zinab Azizi (Teaching Deputy) Travel from Mazar to Keshindeh District Meeting with Keshindeh District Education Office. Jan Mohd (District Education Officer), A. Ghafar Dashti (Provincial Ed. FP), Rahmatullah (Teacher, Boys Lycee Agkupruk), M. Sarwar (Teacher Girls Lycee Aqkupruk), Abdullah (Head of Bakhtar Shoura), Khair Mohd (Teacher, Boys Lycee Aq Kubruk), Jamaluddin (Elders, Aq Kubruk Village), Abdul Karim (Teacher, Boys Lycee Aq Kubruk), Khal Mohd (Teacher, Girls Lycee Aq Kubruk), other elders and tribal leaders, students Literacy class for men. Aq Kubruk Village. Sebghatullah (Instructor) Literacy class for women. Aq Kubruk Village. Mawjoda (Instructor) Literacy class for women. Aq Kubruk Village. Habiba (Instructor) Lunch – by invitation of Jan Mohd (District Education Officer) Meeting at DEO’s office, collection of information. Sar-e-Dewan Village, Community Based School. Naser Mohammed (Teacher) Quara Tery Village, Community Based School, Najibullah Jadoc, (Teacher) Travel back to Mazar Wrap-up meeting UNICEF Office in Mazar. Departure to Kabul Arrival Kabul Sar-E Pol Province Keshindeh District, Aq Kubruk Village Sar-e-Dewan Village Quara Tery Village Mazar Mazar-Kabul p.m. Report writing Report writing Kabul Kabul a.m. 15.00 15.30 Planning and Report writing Departure to Maimana Norwegian Embassy, Egil Thorsaas (Political Adviser) Kabul Kabul- Maimana Faryab Province 16.00 16.15 Arrival Maimana Fazil Ahmad, (UNICEF Faryab Head), Dr. Ghafouri (UNICEF Kabul), Ahmadshah Azizyar (UNICEF, Mazar) Meeting with Faryab Education Director, Mr. Abdul Hai Yaseen and Shuaib Nazari (Support Officer), 16.30 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 51 When What Sunday August 17 12.00-13.00 Abdul Samad (Service Officer), Abdul Shokor (Monitoring Unit), Ghaus Hohammed (TTC), Ghulam Nabi Oyghan (Deputy Education Officer), Moh’d, Yasin Arsalan (Officer in Charge, PED Faryab), Abdul Razaq (Planning Department), Abdul Hakim (Head of Literacy), Hayatullah (Monitoring Unit) Nawayee Formal School, (1-12) Principal Muhamed Qhasim Arab, Teacher Amir Ali Sher Nawayee. Teacher Training, Teacher Haji Noorzat Mohammed, 21 Teacher Students, 3 female. Qarashaikhi Girls School, Khaja Sabz Poush District. Meeting with 14 persons. Khair Mohd (Teacher), Haji Kateeb (Mullah in Madrasa), Abdul Razaq (Representative Community), Jora Qul (Teacher in girls schools), Mohammad Azam (Community Representative), Haji Ali Murad (Community Representative), M. Eshaq (Head Master of Girls School), Haji Mohammed Noor (Head of Shura), Taj Mohammed (Elder of Community), Niaz Mohammed (Teacher in Girls School), Dadiallah (Head of Shura), Mohammad Sarwar (Representative of Community), Ahmad Fayaz (Community Representative), Karamhud District, M. Qasim (DEO), Abdul Ghani (Acting Chief of Police), Hayatullah (Member of Supervision and Maintenance), Sayed Nizamuddin (Superviser, MoE) CBS, Aq Gozar, Abdullah (Teacher), 16 boys and 6 girls in class 3. Dawlatabad District, Ramatullah Nerob (DEO), Hakim (Monitoring and Evaluation Section). Literacy Class Quzbai Quala Village, Instructor: Fahima. UNAMA Head of Office, Maimana Communitcation with Ostad Salsi Mohammed, and Save the Children, Maimana. Norwegian Church Aid, Maimana, Phone interview with Saliha Olker Norwegian Refuge Council, Maimana Phone interview with Thomas Wafi, UNICEF, Maimana, meeting, Fly from Maimana to Kabul left 30 minutes too early and the team had to go back to UN guesthouse Reading and report writing in Maimana Norwegian Church Aid in Maimana: Jalaluddin Akram (Senior Program Officer, NCA Afghanistan Program) and Saliha Olker (Program Officer) Reading and report writing UNICEF, Maimane, Meeting, Amanullah Shahir (Programme Assistant) Departure from Maimana to Kabul p.m. Report writing Kabul 11.30 Save the Children US, Interview with s. Lisa K. Piper, (Program Manager, Northern Region) BRAC, Contact with Shahabuddin Ahmed UNESCO, Interview with Parween Azimi (MoE Focal Kabul 08.00 10.00 12.55 13.25 15.05 15.20 Monday August 18 08.00 09.00 09.30 10.00 11.55 Tuesday August 19 p.m. 09.00 10.20 Wednesday August 20 Where 15.00 16.45 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Faryab Province Khaja Sabz Poush District Karamhud District Dawlatabad District Quzbai Quala Village Maimana Maimana Page 52 When What Thursday August 21 Friday August 22 19.00 11.00-15.45 11.00 13.00-18.00 19.00 Saturday August 23 Sunday August 24 Monday August 25 10.30 14.30 08.00 09.00 UN HABITAT, Lisa Deyo (Education), 10.00 UNICEF meeting with Fazlul Haque, Dr. Abdul Samad Ghafoori and other UNICEF professionals 15.00 MoE Mr. Basir (Advisor/General Education) 15.30 MoE, Susan Wardak, (Senior Advisor and Head of Teacher Education Department) End meeting and presentation of findings with Mette Sunnergren (SE) and Kristin Hauge (NO) 10.30 13.00 Tuesday August 26 August 28 to Sept. 15 Point for Inclusive Education) Anne Hertzberg UNICEF, Dr. Brandao Co (Acting Deputy Representative), Fazlul Haque (Chief of Education), Attaullah Wahidyar (Education Officer) Miki Tanae (Education Specialist), Calister Mtalo (Education Specialist) MoE/DANIDA Paul Gibbings, Textbook Printing & Distribution Consultant Report writing Norwegian Save the Children, Inger Guddal, Anne Herzberg MoE, Meeting with Muhammad Suliman Kakar, (Senior Advisor on Program Coordination & Social Mobilization) CIDA Michel Tache (Education Board) Swedish Afghanistan Solidarity Committee: Lailuma Hameed (Head of Education) Save the Children, (Sweden and Norway) Lailuma Hassani (Senior Programme Officer) Evaluation team departure from Kabul to Dubai and Oslo Report writing. Contacts with Randi Gramshaug, previous UNICEF Junior Expert in Afghanistan Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Where Kabul Kabul Kabul Kabul Kabul Kabul-Oslo Page 53 Annex 4 Number of CBS Students as of 30th of August 2008 Table 5 CBE Students - total (G1-3), 2008, August 30th Province PACE-A BRAC SCA SC-SN UNICEF SC-UK Total Badakhshan 1356 0 756 0 1426 0 3538 Badghis 2359 0 0 5199 1058 0 0 2840 3787 0 Baghlan 0 706 Balkh 3248 12126 0 4917 0 1571 21862 Bamyan 0 0 0 526 0 2504 0 3030 Daykundi 0 0 0 0 7158 0 7158 Farah 0 0 0 0 4158 0 0 0 818 Ghazni 0 0 3816 4158 818 0 0 1246 0 11200 0 16262 Ghor 3017 0 0 0 13171 0 16188 Hilmand 0 4985 0 0 0 0 0 0 12284 0 0 0 21651 1691 0 1606 38920 7500 3719 750 21370 Faryab Hirat Jawzjan Kabul 0 2030 13296 0 0 1575 0 0 0 6356 0 0 5024 0 0 0 0 889 Kapisa 0 2573 Khost Kunar Kandahar 5551 10797 1435 1435 2170 0 11099 0 4845 0 9869 0 7 554 686 0 8443 0 6778 5 044 0 9298 0 975 0 1009 6092 1343 0 927 Logar 5002 0 0 9048 1814 7871 0 7351 4046 Nangarhar 0 3678 20 567 0 41281 0 0 80 0 0 0 80 0 1366 0 3058 0 4424 0 0 0 2952 0 7988 Kunduz Laghman Nooristan Paktya 0 5036 Panjsher 1141 0 0 0 2627 0 3768 Parwan 1641 6925 0 0 0 14309 Samangan 0 3787 0 0 5743 1338 0 5125 luP -e-raS 0 0 0 1778 0 3576 0 0 7745 3576 0 3374 766 0 10289 0 3731 0 4160 0 11265 0 0 0 0 0 0 0 Paktika Takhar Wardak Uruzgan Zabul Total 0 0 0 0 0 0 0 45879 71154 30728 11631 148172 5362 312926 Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 54 Annex 5 Community Based School (UNICEF/MoE) Status in 4 Regions Tabel 6 Community Based School (UNICEF/MoE) Status in 4 Regions Regions Updated as of 27 August 2008 Province Grade 1 CBS 2008 Total no of Grade 2 CBS 2008 Total no girls & No No of CBS No of student of girls & No of boys boys of teachers CBS CBS M Gs Bs F Total No No of CBS of teachers CB M F Total S 62 0 0 62 No of student Gs Bs 1912 1215 3127 27 65 38 41 1 0 0 0 30 24 10 60 331 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 65 38 41 1 0 0 0 30 24 10 60 331 854 772 838 30 0 0 0 700 568 165 1679 7518 1304 304 719 40 0 0 0 464 352 187 592 5177 2158 1076 1557 70 0 0 0 1164 920 352 2271 12695 70 70 0 70 7 0 0 7 52 0 0 52 35 0 0 35 76 67 9 76 70 64 6 70 172 95 77 172 40 29 11 40 20 18 2 20 185 0 0 185 54 50 4 54 808 393 109 808 0 14 0 0 0 0 0 14 0 222 0 156 0 378 0 2 0 2 0 0 0 2 0 40 Jawzjan Badakhshan Kunduz Takhar Baghlan Samangan Saripul Total for Northern Region Heart Badghis Farah Ghor Total for WR 12 46 0 0 20 2 12 106 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 12 46 0 0 20 2 12 106 107 486 0 0 307 20 80 1222 178 472 0 0 242 60 168 1276 285 958 0 0 549 80 248 2498 0 0 0 0 0 0 2 4 0 0 0 0 0 0 2 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 4 32 6 30 0 29 14 30 0 121 20 26 0 6 0 32 32 30 20 30 112 704 313 268 702 1987 824 627 739 827 3017 1528 940 1007 1529 5004 96 92 52 52 20 17 128 128 296 289 4 0 3 0 7 Nanagarhar Kunar Laghman Total for Eastern Region Sub total 170 167 50 50 0 0 220 217 3 0 0 3 170 50 0 220 4339 802 0 5141 3239 829 0 4068 7 578 1 631 0 9209 226 197 29 0 0 0 0 0 0 226 197 29 778 237 35 769 15868 13538 29406 Logar Eastern Region Western Region Northern Region Central Region Khost Kabul Parwan Bamiyan Paktika Paktya Daikundi Kapisa Panjshir Ghazni Wardak Total for Central Region Balkh Faryab 0 0 27 416 503 Grade 3 CBS 2008 No of CBS teachers M F Total No of student Gs Bs 919 0 0 0 0 2687 377 1350 2378 3058 2952 7158 1006 604 6254 1889 30632 0 77 119 1 0 0 0 0 41 154 0 392 0 0 0 0 0 0 0 0 41 0 0 41 0 0 0 0 0 0 0 0 0 0 0 0 0 77 119 1 0 0 0 0 41 154 0 392 1366 1482 26 0 0 0 0 863 2167 0 5904 0 0 0 40 162 13 149 13 162 13 0 13 0 0 0 0 0 0 36 76 0 0 0 0 0 0 54 54 0 0 0 0 0 0 90 130 59 15 11 21 66 27 95 469 57 2 59 14 1 15 11 0 11 19 2 21 58 8 66 26 1 27 94 1 95 441 28 469 96 52 20 128 296 2138 534 359 3194 6225 2336 1005 400 3425 7166 4474 1539 759 6619 13391 226 0 0 226 5 074 0 0 5074 4 297 0 0 4297 1334 883 145 1334 26802 26722 388 2299 222 155 947 403 1103 1275 1393 1665 1163 1789 3833 3325 757 249 400 204 3613 2641 1192 697 15427 15205 Total no of Grade4 CBS 2008 girls & boys No No of CBS No of of teachers student CB M F Total Gs Bs S 0 Total no of girls & boys Total (Grade 1 to 4) Girsls Boys Total 2328 1718 4046 3603 1359 2476 1345 1665 1789 3325 713 796 5255 1289 25333 4845 3719 5743 2504 3058 2952 7158 2170 2627 11200 4160 54182 900 1354 30 0 0 0 0 240 2427 0 4951 0 2266 2836 56 0 0 0 0 1103 4594 0 10855 0 0 0 0 0 0 0 1242 2360 3267 1159 1393 1163 3833 1457 1831 5945 2871 28849 2136 219 2781 181 4917 400 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2136 481 2781 337 4917 818 460 237 297 290 1411 383 1411 6844 946 231 389 476 1827 875 1827 9533 1406 468 686 766 3238 1258 3238 16377 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 567 723 297 290 1718 403 1527 8142 1124 703 389 476 2069 935 2049 10863 1691 1426 686 766 3787 1338 3576 19005 292 8 81 0 381 292 0 292 7448 8 0 8 88 71 10 81 785 0 0 0 3202 371 10 381 11523 7813 213 1486 3222 12734 15261 301 2271 6424 24257 0 0 0 0 0 10290 935 1412 7098 19735 10973 1845 2625 7474 22917 21263 2780 4037 14572 42652 9 371 0 0 9371 54 155 152 361 51 150 3 5 9 0 0 0 9 0 184 194 0 0 378 0 8 2 781 5 718 5 044 13543 9 0 201 1263 3274 2105 6642 9 9 0 9 184 194 378 11115 3246 2939 17300 8993 4103 2105 15201 20108 7349 5044 32501 53524 1603 1054 46 1603 31172 33860 65032 9 9 0 9 184 194 378 74026 74314 148340 54 155 152 361 1518 2444 2939 6901 0 0 Total Girls Grade 1-4 75026, Total Boys Grade 1-4: 74 314 Note 1: The grade one CBS will be reported later, Note 2: all 23 CBS in Takhar is now Grade 3, according to PED due to poor quality of teaching they asked the teachers to repeat grade 2 again in 2007. Note 3: 64 grade-3 CBSs promoted to G4 and integrated to nearest primary schools (9 G-3 CBSs promoted to G4 and will be continued as CBSs in one cluster , since there is no primary school nearby the village) Remar ks Note 1 Note 2 Note :3 Annex 6 Financial information Table 7 Summary of Available Resources by Donor, PBA and Amount in USD. 2006 (Source: Thematic Report 2006) Donor Name Programme Budget Allotment Reference Programmable Amount A: Basic Education Regular Resources GC/2002/6031-01 1,158,700.00 Regular Resource – set aside GP/2004/8119-01 1,000,000.00 Regular Resource – set aside GP/2005/8117-01 2,694,256.77 Korean Committee for UNICEF SC/2003/3074-01 215,582.86 Japan Committee for UNICEF SC/2003/3094-01 60,281.71 Japan Committee for UNICEF SC/2003/3112-01 52,391.21 U K Committee for UNICEF SC/2003/3257-01 69,308.64 Belgian Committee for UNICEF SC/2003/3263-01 30,238.80 USA( State) BPRM US Bureau of Population, Refugees SC/2004/0405-01 777,146.02 German Committee for UNICEF SC/2004/3028-01 479.38 Japan Committee for UNICEF SC/2004/3029-01 1,212.23 German Committee for UNICEF SC/2004/3171-01 312,208.89 German Committee for UNICEF SC/2004/3255-01 76,351.09 U K Committee for UNICEF SC/2004/3255-02 127,010.57 U K Committee for UNICEF SC/2004/3255-03 84,673.72 Japan Committee for UNICEF SC/2004/3255-04 186,960.00 German Committee for UNICEF SC/2004/3255-05 474,947.35 German Committee for UNICEF SC/2004/3255-06 225,253.15 Canadian Committee for UNICEF SC/2004/3255-07 97,374.61 SC/2003/9901-35 9,360,638.25 Other Resources- Regular Thematic Funding Thematic allocation for Girls’ Education programme in Afghanistan Total Other Resources- Regular 15,846,315.25 Other resources- Emergency Consolidated Funds from NatComs SM/2001/3254-04 39,578.25 Japan SM/2002/0641-01 78,675.93 USA( State) BPRA United Department of State SM/2003/0564-01 24,466.46 Japan SM/2003/0136-01 374,005.90 German Committee for UNICEF SM/2003/3205-01 26,361.88 Donor Name Programme Budget Allotment Reference Japan Committee for UNICEF SM/2003/3305-01 79,636.32 Japan SM/2004/0141-01 677,979.80 Japan Committee for UNICEF SM/20043009-01 2,382.00 Germany SM/2005/0635-01 352,723.19 U K Committee for UNICEF SM/2005/3182-01 56,723.19 Netherlands Committee for UNICEF SM/2005/3292-01 Total Other Resources- Emergency Programmable Amount 477,618.06 2,190,150.98 Total funding available from all sources 19,195,166.23 Thematic allocation for Girls’ Education programme in Afghanistan allocated to Cross Sectoral Programme SC/2003/9901-35 Total funding available for Basic Education including amount of thematic funds allocated to cross sectoral 1,308,891.00 20,504,057.23 B: Water and Environmental Sanitation Regular Resources GC/2002/6031-01 1,235,394.00 USA (State) BPRM US Bureau of Population, Refugees SC/2004/0405-01 185,000.00 Regular Resources – Set aside GP/2004/8119-01 245,709.00 SC/2003/9901-35 810,516.00 Other Resources – Regular * Thematic funding Global – Girls Education (Thematic) Total Other Resources- Regular 1,241,225.00 Other resources- Emergency Japan SM/2003/0136-01 12,902.00 Japan SM/2004/0141-01 747,428.00 Netherlands SM/2005/0096-01 1,275,490.00 Total Other Resources- Emergency 2,035,820.00 Total funding available from all sources 4,512,438.00 Table 8 Country-specific Thematic Contributions Received for Girls’ Education in USD in 2005 (Source: Thematic Report 2006) Country-specific Thematic Donors Sweden Contribution Amount 7,662,181.68 Korean Committee for UNICEF 285,720.00 United States Fund for UNICEF 34,076.87 TOTAL Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan 7,981,978.55 Page 57 Table 9 Total approved budget by funding type and amount in US$ for 2007 (Source: Thematic Report 2007) Funding Type Approved Programme Component Amount (US$ in million) Regular Resources (RR) 2.85 Other Resources (OR) 22.19 TOTAL (RR and OR) 25.04 Table 10 Summary of available resources by donor, PBA and amount in USD for 2007 (Source: Thematic Report 2007) Regular Resources Programme Budget Allotment Programmeable Amount( US$) Regular Resources GC/2005/6036-01 5,776,031.29 German Committee for UNICEF SC/2004/3171-01 728,875.69 United States Fund for UNICEF SC/2005/0731-01 443,553.66 Netherlands Committee for UNICEF Jacob van den Eyndestraat 7 SC/2006/0610-01 397,204.68 United Nations Joint Programme SC/2007/0471-00 370,677.56 Japan Committee for UNICEF SC/2005/0740-01 180,936.68 United Kingdom Committee for UNICEF 5th Floor Africa House SC/2004/3320-01 95,533.41 Canadian Committee for UNICEF SC/2005/3404-01 47,080.14 Global - Thematic Humanitarian Resp THEMATIC FUND SM/2006/9906-23 1,217,496.84 Netherlands Committee for UNICEF Jacob van den Eyndestraat 7 SM/2005/3292-01 374,438.68 Canada SM/2007/0040-00 258,000.00 UNOCHA UN Office for the Coordination of SM/2007/0176-00 167,090.46 Norway XI/2006/7515-01 135,546.33 Other Resources- Regular Other Resources – Emergency Thematic Funding BASIC EDUCATION AND GENDER EQUALITY SC/2006/9901-15 11,949,960.00 Global - Girls Education (Thematic SC/2003/9901-35 1,140,830.88 Total funding available from all sources Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan 23,283,256.30 Page 58 Table 11 Country-specific Thematic Contributions Received in 2007 (in USD) (Source: Thematic Report 2007) Country-specific Thematic Donors Contribution Amount Sweden 7,817,764.50 Norway 1,279,740.00 Korean Committee for UNICEF 300,905.96 Total 9,398,410.46 Table 12 Financial Summary 2007, from 1 January to 30 November (USD) (Source: End Year Review Report, 2007) Projects Planned Funded Support to Sector Reform & Community Development 14,181,179.00 15,944,153.35 112% 14,192,440.90 89% Quality of Primary Education with Special Focus on Girls' Education 7,106,500.00 2,936,642.13 41% 2,398,025.54 82% Women's Literacy & Gender Empowerment 2,587,435.00 2,583,864.74 100% 1,963,852.42 76% 23,875,114.00 21,464,660.22 90% 18,554,318.86 87% Grand Total Utilized Table 13 Summary of financial implementation for Basic Education and Gender Equality (2007) (USD) (Source: End Year Review Report, 2007) All Resources Allocation Regular Resources Other Resources- Regular Other Resources – Emergency Total- YE302- BASIC EDUCATION AND GENDER EDUCATION AND GENDER EQUALITY Provisional Expenditure % Utilized 5,776,031.29 5,753,384.40 99.61% 15,354,652.70 13,307,151.35 86.67% 2,152,572.31 2,060,675.21 95.73% 23,283,256.30 21,121,210.96 90.71% Table 14 Financial implementation Rate All Resources 2008 (USD) (Source: UNICEF as of 31 July 2008) All Resources Total Regular Resources Total Other Resources Total Emergency Sub total all Allocation Expenditure Implementation Rate/Expenditure 7,798,921.00 6,546,599.73 83.94 14,596,539.75 5,418,891.66 37.12 3,714,327.25 780,798.20 21.02 26,109,788.00 12,746,289.59 48.82 Education has received 9.2 million USD from SIDA, which is not allocated to the project yet. Evaluation of MoE/UNICEF’s BEGE Programme in Afghanistan Page 59