Middle East & North Africa development of smes exports through virtual market places

Monitoring and Evaluation of Results

111. 
     A monitoring and evaluation (M&E) framework is detailed in the Annex I of this concept note. The framework is centered on the PDO and includes indicators to assess accomplishment against it. Primary responsibility for results monitoring will fall on the RIA with continuous follow up from the Bank. ITC will present an M&E report to the Oversight Committees and to the World Bank on a semiannual basis and during regular implementation support missions. The M&E will be disaggregated to account for country results.
     

112. 
     A mid-term review will be carried out to assess, draw lessons from the project and provide an opportunity to adopt any corrective action that may be required to ensure that the project meets its development requirements. The M&E framework controls for all the key indicators to assess the success or failure of the project. Through the regular monitoring based on the feedback from export advisors, the PIU and ITC will be in a position to introduce changes during the implementation phase. The assessment on the success or failure of the project will be done on the basis of the indicators, mainly, SMEs in VMP, volume and value of transactions as well as achievements on institutional reform component.
     

113. 
     It is proposed to conduct an impact assessment at the end of the project. The impact assessment would aim at assessing the impact on SMEs as member of the VMPs. Selected beneficiary SMEs would be asked to provide data on i) the number of export transactions, and ii) their turnover, to be compared with similar SMEs (in size, sector, etc.) that did not joined the VMPs. The selection criteria to identify the “comparable” test group would be detailed in the terms of reference for the impact evaluation ³⁴. The cost of the project includes an impact evaluation subcomponent and it is expected to involve DECTI.
     

9. Sustainability

114. 
     It is expected that SMEs may want to continue getting support from the EAs for specific exports transactions on a regular or more punctual manner. The impact evaluation outcomes will allow each CP to decide whether the support to the SMEs should continue on a reimbursable mode (SMEs will pay the EAs directly for their services provided) or if EAs services must continue to be partly of fully subsidized. In addition, sustainability will also be granted through the training of specific staff in chambers of commerce and sector associations. This was specifically requested by many organizations during the preparation phase of the project.
     

H.TEAM, TIMELINE AND BUDGET

Preparation Schedule and Resources
.
Preparation Schedule
Milestone	Basic	Forecast	Actual
AIS Release	11/25/2012
Concept Review	12/20/2012	12/20/2012
Auth Appr/Negs (in principle)
Bank Approval	date of RVP approval
.
Sector Unit Estimate of Resources Required from Preparation through Approval
Source of Funds	Preparation Expenses to Date (USD)	Estimate of Resource Requirements (USD)
		Fixed	Variable
Bank Budget
Trust Funds		100,000	100,000
.
Team Composition
Bank Staff
Name	Title	Specialization	Unit	UPI
Laurent Gonnet (TTL)	Senior Financial Sector Specialist	Financial Sector	MNSFP	319004
Natsuko Obayashi	Consultant		MNSED
Djibrilla Issa	Private Sector Development Specialist	Private Sector Development	MNSFP
Hassine Hedda	Finance Officer
Steve Yu Wan	Operations Analyst
Marjorie Espiritu	Program Assistant
Syed I. Ahmed	Lead Legal Counsel	Legal	LEGAM
Non-Bank Staff
Name	Title	Office Phone	City
Faouzi el Mufti	Consultant		Tunisia
Sonia Sanchez Quintela	Consultant		Tunisia

Annex 1: Results Framework

Indicators by Component	Unit	Baseline	Cumulative Target Values			Frequency	Data Source/ Methodology		Responsibility for Data Collection	Description (Indicator Definition, etc)
			2014	2015	2016
PDO Level Results Indicators: The proposed project development objective (PDO) is to (i) increase SMEs access and exports via Virtual Market Places, and (ii) support institutional reforms to create an enabling environment for e-commerce in targeted countries.
Indicator 1: Registered SMEs with at least one export transaction completed via VMPs	Number	0	120	200	300	Quarterly	Statistics VMP platforms/ Feedback from surveys/M&E Database	PIU		Number of transactions conducted by SMEs registered Value of Exports increase since VMP access
Indicator 2. Roadmap for the reform of the enabling business environment for e-commerce in each participating country and integrated in national commerce strategies	Yes/No	No	No	Yes		Bi-annual	Reporting by the Oversight Committee; Ministries of Trade	PIU - ITC		Roadmap document endorsed by the OC
Indicator 3. SMEs registered in VMPs	Number	0	300	600		Quarterly	Captured by EAs and monitored through M&E Database	PIU-ITC		Registration involves opening of a VMP account and uploading of product and contact information.

INTERMEDIATE OUTCOMES
Component I. Institutional Reform
Indicators by Component	Unit		Baseline		Cumulative Target Values			Frequency	Data Source/ Methodology	Responsibility for Data Collection	Description (Indicator Definition, etc)
					2014	2015	2016
Workshops conducted	Number		0		1	2	3	Bi-annual	Reporting PIU-ITC	PIU-ITC	Output Delivered – Workshop report
Analytical Work delivered on key e-commerce topics	Number		0		2	3	4	Bi-annual	Reporting PIU – ITC	PIU-ITC	Output delivered – Workshop Report
Component II. Export Markets accessed through VMPs
Indicators by Component	Unit		Baseline		Cumulative Target Values			Frequency	Data Source/ Methodology	Responsibility for Data Collection	Description (Indicator Definition, etc)
					2014	2015	2016
Export Advisors Trained	Number		0		50	75	0	Bi-annual	Reporting PIU-ITC	PIU/ITC	Captures number of EAs trained on VMPs
Export Advisors Certified	Percent		0		50%	90%	0	Quarterly	Training provider assesses performance	PIU-ITC	Percent of EAs who receive certification, out of total number of trained EAs; Not all EAs may end up qualifying; target for 2016 expects 90% to obtain it.
Indicators by Component	Unit	Baseline		Cumulative Target Values				Frequency	Data Source/ Methodology	Responsibility for Data Collection	Description (Indicator Definition, etc)
				2014		2015	2016
Training program for TSIs delivered (# activities)	Number	0		1		2	3	Quarterly	M&E Database	PIU-ITC	# Training sessions Report disseminated and workshops evaluations # Number of advisory services provided #SMEs satisfaction with TSIs service delivery
Component III. VMP Partnerships, Certification and Business Intelligence
Indicators by Component	Unit	Baseline			Cumulative Target Values			Frequency	Data Source/ Methodology	Responsibility for Data Collection	Description (Indicator Definition, etc)
					2014	2015	2016
Collaborative partnerships with VMPs	Number	0			2	4	4	Quarterly	Project implementation reports	PIU	MoU, Letter of Intent or other agreement-related documentation.
Newsletters published by TSIs to roll out the Business Intelligence Mechanism	Number	0			10	25	50	Quarterly	PIU and RIA	PIU and EA	# product (newsletter) delivery by TSI main partner

Indicators by Component	Unit	Baseline	Cumulative Target Values			Frequency	Data Source/ Methodology	Responsibility for Data Collection	Description (Indicator Definition, etc)
			2014	2015	2016
Premium Accounts awarded – Certifications	Number	0	30	40	50	Quarterly	Project Implementation Reports M&E Database and VMPs	ITC/PIU	Trust label certificates
Assessment body created and operational	Yes/No	No	No	No	Yes	Quarterly	Project Implementation Reports	WB/ITC/PIU	Creation of Conformity Assessment body

Annex II. Economic Value (for the case of Tunisia)

Annex III. Workflow and Actors


Annex 3: Implementation Arrangements

Jordan, Morocco, Tunisia: Export Development through Virtual Market Places

1. 
   Project Institutional and Implementation Arrangements
   

1. 
   ITC will implement directly and with the support of country PIUs project activities with oversight provided by the Oversight Committee and the World Bank. The selected Regional Implementation Agency is the International Trade Center, a specialized trade agency of the United Nations (ITC). ITC will be hired following WB processes on a single source basis given their expertise. ITC strategic objectives are:
   

• 
  Building awareness and improving the availability and use of trade intelligence
  
• 
  Strengthening TSIs
  
• 
  Enhancing policies for the benefit of exporting enterprises
  
• 
  Building the export capacity of enterprises to respond to market opportunities
  
• 
  Mainstream inclusiveness and sustainability into trade promotion and export development policies.
  

In addition to the complementarities with the WB work, ITC has also a broad knowledge and experience of Morocco, Tunisia and Libya and have already designed and implemented projects with the stakeholders that the projects is engaging.

ITC is in an ideal position to support project’s implementation.
ITC will:

• 
  manage all funds and procurement for activities
  
• 
  open a Designated Account into which funds from the World Bank will be deposited
  
• 
  organize regular steering committee meetings to provide operational guidance
  
• 
  appoint staff and recruit consultants where necessary for project implementation (PIU) , Virtual Market Places experts, Export Advisors
  
• 
  ITC will coordinate the communication campaign and outreach
  
• 
  maintain and, where necessary, update the Operations Manual
  
• 
  monitor implementation with the support of the PIU
  
• 
  responsible for all the financial aspects of the project
  
• 
  ensure proper financial management of funds and compliance with World Bank’s requirements when applicable;
  
• 
  ensure proper and appropriate procurement procedures
  
• 
  submit regular reports and disseminate findings
  
• 
  organize workshops
  
• 
  provide business intelligence
  
• 
  set up partnerships with VMPs with the participation of the WB.
  

2. 
   The Oversight Committee (OC) will ensure the good governance, timely delivery and provide the adequate reporting to the concerned government agencies, the WB and the RIA. The role of the OCs consists of:
   

• 
  oversight and approve major directions and changes in the program
  
• 
  discuss and decide on any proposal/issues raised by the PIU
  
• 
  facilitate the dialogue across institutions and organizations.
  
• 
  support the PIU in the dissemination, communication and outreach of the project.
  
• 
  jointly develop a scorecard to monitor project implementation and results.
  
• 
  support the inter-ministerial committee on institutional reform by providing analysis and information on VMP and related overall e-commerce regulatory and institutional bottleneck and,
  
• 
  other relevant aspects of the project.
  

Members of the OC are:

• 
  representatives from: Government (Ministry of Planning, Ministry of Trade, Ministry of Finance, Information Technologies).
  
• 
  representatives from WB and ITC.
  
• 
  representatives of the TSI.
  
• 
  representatives of business associations and sectors.
  
• 
  representatives from women and youth business associations.
  
• 
  project Coordinator (Country PIU).
  

The PIU will be a light structure (1 person paid by the project, the assistant to be provided by the host institution) hosted by the designated agency in each of the countries. The PIU will coordinate level the implementation of the project on a day-to-day basis under the regular supervision of ITC. The PIU will be composed of one senior and one junior staff whose main task will be to liaise with EAs, OC and ITC.
The responsibilities of the PIU are:

• 
  monitor the work of the Export Advisors
  
• 
  organize the outreach campaign
  
• 
  ensure adequate communication between EAs and SMEs
  
• 
  provide support to Chambers of Commerce, sector associations and civil society organizations engaged in the project
  
• 
  report to ITC
  
• 
  fill the M&E framework and monitor the evolution on a quarterly basis
  
• 
  ensure that all financial aspects (payments, expenses) are adequately reported to ITC to ensure timely payment of consultants and services by ITC
  
• 
  make the necessary logistical arrangements for the training events
  

2. 
   Experts
   

Two main types of experts will be recruited by the project.

• 
  An expert on Virtual Market Places – Responsible for the delivering of training to the main counterparts, export advisors and partners: TSI, chambers of commerce and sectors associations and consultants.
  

• 
  Export Advisors – EAs will be hired using current networks of export advisors already trained under previous technical assistance activities provided by donors. Their role is fundamental in coaching the SMEs throughout the process from entering to VMPs to transactions. The relation between the EA and the SMEs is fundamental for the success of the project. An adequate incentive mechanism is been put in place which will reward EAs based on performance. EAs will be assigned taking into consideration sector expertise. The PIU will organize regular meetings of the EAs to assess the progress in their activities.
  

3. 
   Trade Support Institutions
   

The project will engage different types of country partners with the support of the PIU and Export Advisors. The engagement of these TSIs will be done in a systematic manner and they will be regularly informed of activities, training and workshops. The mission team met with many of these organizations which show high engagement with the objectives of the project.

Main Trade Support Institution Partner – Public Institution per country responsible for of trade and trade promotion. The PIU is based in the main TSI.
Other TSIs: Other TSIs include chambers of commerce, professional and business associations including sector and even product specialized organizations. All these organizations support very actively their members providing export support services and information as well as a platform to engage in dialogue with the authorities. Using these networks will facilitate the dissemination of information, the access to SMEs in remote areas and a better qualitative understanding of the potential of SMEs in each of the sectors. Besides the main partner institution, where the PIU will be hosted, the project will benefit from the engagement with chambers of commerce, business and professional associations, universities, business incubators and others. By doing so it will indirectly foster the introduction of e-commerce and IT-related matters upstream in the educational curricula. Many of them were engaged during the mission. This bottom-up approach will also facilitate the dialogue with the country task forces in charge of the policy reform component.
Civil Society Organizations: CSOs around women, young entrepreneurs are also part of network of actors that will be engaged in and support the project.

4.