NTA Level 6 • Semester 2 • PST06211

Introduction to Monitoring and Evaluation

Monitoring and Evaluation of Medicine Use • Source Session/Topic 1

Full source-text version: all educational wording from the extracted learning source is retained; only presenter/tutor metadata and web-layout noise are removed, while formatting is improved for readability.

Session 1: Introduction to Monitoring and Evaluation

Total Session Time: 120 minutes + 2 hours of Assignment

Prerequisites

• None

Learning Tasks

By the end of this session students are expected to be able to:

• Define terms in monitoring and evaluation

• Differentiate between monitoring and evaluation

• Explain importance of monitoring and evaluation in pharmacy practice

Resources Needed:

• Flip charts, marker pens, and masking tape

• Black/white board and chalk/whiteboard markers

• Computer and LCD projector

• Handout 1.1: Glossary of Monitoring and Evaluation Terms

• Handout 1.2:Difference between monitoring and evaluation

SESSION OVERVIEW

Activity/

Step Time Content

Method

1 05 minutes Presentation Introduction ToLearning Tasks

2 40 minutes Presentation Terms used in Monitoring and Evaluation

25 minutes Presentation and Differences Between Monitoring and

Buzzing Evaluation

30 minutes Presentation and Importance of Monitoring and Evaluation in

Group Discussion Pharmacy Practice

5 10 minutes Presentation Key Points

6 05 minutes Presentation Evaluation

7 05 minutes Assignment Take home assignment

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

SESSION CONTENTS

STEP 1: Presentation of Session Title and Learning Tasks (5 minutes)

READ or ASK students to read the learning task and clarify

ASK students if they have any questions before continuing.

STEP 2: Termsused in Monitoring and Evaluation (40 minutes)

• Monitoring refers to reviewing on a continuous basis, the degree to which program activities

are completed and performance targets or milestones are being met.

o Typically monitoring focuses on trucking program inputs such as funding, staff

facilities, supplies and training

o As such monitoring is part of the operational management of a program

o Monitoring also track output such availability of medicines and supplies

o It help in identifying potential problems and corrective action to be taken during

program implementation

• Evaluation refers to analysing progress towards meeting established objectives goals or

results.

o It provides feedback on the outcomes of activities such as changes in prescribing

behaviour and health care seeking behaviour, whether plans have been met and reason

for success or failure.

o Monitoring can be done through various informal and informal methods: supervisory

visits, routine reporting, sentinel reporting system, and special studies.

• Monitoring and evaluation plan—a multi-year implementation strategy for the collection,

analysis and use of data needed for project management and accountability purposes.

• Surveillance—the ongoing, systematic collection, analysis, interpretation, and dissemination

of data regarding a health-related event for use in public health action to reduce morbidity

and mortality and to improve health.

• Target—the objective a program is working towards, expressed as a measurable value or the

desired value for an indicator at a particular point in time.

• Validity—the extent to which a measurement or test accurately measures what is intended to

be measured.

• Summative evaluation—a type of evaluation conducted at the end of an intervention to

determine the extent to which anticipated outcomes were produced. It is designed to provide

information about the merit or worth of the intervention.

• Results—the outputs, outcomes, or impacts of an intervention

• Quantitative data—data collected using quantitative methods, such as surveys. Qualitative

data—data collected using qualitative methods, such as interviews, focus groups,

observation, and key informant interviews.

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

• Project—an intervention designed to achieve specific objectives within specified resources

and implementation schedules, often within the framework of a broader program.

• Prevalence—the total number of persons living with a specific disease or condition at a

given time.

• Performance—the degree to which an intervention or organization operates according to

specific criteria or achieves results in accordance with stated goals or plans.

• Objective—a statement of a desired program result that meets the criteria of being Specific,

Measurable, Achievable, Realistic, and Time-phased (SMART).

• Intervention—a specific activity or set of activities intended to bring about change in some

aspect(s) of the status of the target population.

• Health information system (HIS)—a data system, usually computerized, that routinely

collects and reports information about the delivery and cost of health services, and patient

demographics and health status.

• Goal—a broad statement of a desired, usually longer-term, outcome of a program.

• Indicator—a quantitative or qualitative variable that provides a valid and reliable way to

measure achievement, assess performance, or reflect changes connected to an intervention

• Inputs—the financial, human, and material resources used in a program.

• Outputs—the results of program activities; the direct products or deliverables of

intervention activities.

Refer students to Handout1.1: Glossary of Monitoring and Evaluation Terms

STEP 3:Differences between Monitoring and Evaluation (25 minutes)

Activity: buzzing (5 minutes)

ASK students to pair up and buzz the following question

• What is the difference between monitoring and evaluation?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

The difference between monitoring and evaluation is summarized in the table 1.1 below;

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

Table 1.1; Differences between monitoring and evaluation

MONITORING EVALUATION

clarify program objectives Analyzes why intended results were or were

not achieved

Link activities and their resources to Assesses specific causal contribution of

objectives activities to results

Translate objectives into performance Examine implementation process

indicators and set target

Routinely collects data on these indicators Explore unintended results

compares actual results with target

Ensures project accountability Judge the overall merit of the project

It is an essential part of good day to day It is an essential activity in a longer term

management process

Takes place during the implementation phase Mid-term or final evaluation is important for

making decision on overall project direction

Focus on tracking performance Focus on judgement learning and merit

Internal management responsibility Usually incorporate external agencies

Refer students to Handout1.2: Difference between monitoring and evaluation

STEP 4: Importance of Monitoring and Evaluation in Pharmacy Practice

(30 minutes)

Activity: group discussion (10 minutes)

ASK students to pair up and discuss the following questions

• What is the importance of monitoring and evaluation in pharmacy practice?

ALLOW few pairs to respond and let other pairs to add on points not mentioned

WRITE their response on the flip chart/board

CLARIFY and SUMMARIZE by using the content below

• The following are importance of monitoring and evaluation in pharmacy practice

o It help to obtain Information from patients, healthcare providers as well as other

sources such plays a critical role in providing the data necessary for

pharmacovigillance to take place.

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

o It help to improve the process of pharmaceutical care such us data collection, identifying

drug related problem and develop therapeutic plan

o It help in obtaining drug safety information to health care professionals and other

stakeholders including WHO adverse drug reactions (ADRs) Monitoring Centres, It

help to make informed decisions regarding program operations and service delivery

based on objective evidence which will help to link the objectives together with

resources available ;

o It help to ensure the most effective and efficient use of resources.

o It help to assess the extent to which the program is having or has had the desired

impact, in what areas it is effective, and where corrections need to be considered;

STEP 5: Key Points (10 minutes)

• Evaluationrefers to analyzing progress towards meeting established objectives goals or

results.

• Monitoring refers to reviewing on a continuousbasis, the degree to which program activities

are completed and performance targets or milestones are being met.

• Surveillance—the ongoing, systematic collection, analysis, interpretation, and dissemination

of data regarding a health-related event for use in public health action to reduce morbidity

and mortality and to improve health

• Monitoring link activities and their resources while evaluation assesses specific causal

contribution of activities to results

• Monitoring is essential part of good day to day management while evaluation is essential in

longer term process

STEP 6: Evaluation (5 minutes)

• What is monitoring?

• What is evaluation?

• What is the difference between monitoring and evaluation?

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

References

Quick, J. D. (1997). Managing drug supply the selection, procurement, distribution and use of

pharmaceuticals. West Hartford, CT: KumarianPress.Bartsch, S. (2007).

The Global Fund to Fight AIDS, Tuberculosis and Malaria. Global Health Governance and the

Fight Against HIV/AIDS,146-171. doi:10.1057/9780230591349

WHO Operational package for assessing, monitoring and evaluating country pharmaceutical

situations. (2015, November 20). Retrieved from

https://www.who.int/medicines/publications/WHO_TCM_2007.2/en/

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

Handout 1.1: Glossary of Monitoring and Evaluation Terms

• Monitoring and Evaluation Terms

This glossary includes terms typically used in the area of monitoring and evaluation (M&E)

and provides the

basis for facilitating a common understanding of M&E. Although most terms in the glossary

can be used generically, they are defined in the context of public health and AIDS programs.

Note: This is not intended to be an exhaustive list of M&E-related terms, but includes the

most commonly used terms.

• Accountability—responsibility for the use of resources and the decisions made, as well as

the obligation

to demonstrate that work has been done in compliance with agreed-upon rules and standards

and to report fairly and accurately on performance results vis-a-vis mandated roles and/or

plans.

• Activity—actions taken or work performed through which inputs such as funds, technical

assistance, and other types of resources are mobilized to produce specific outputs.

• Assumptions-hypotheses about factors or risks which could affect the progress or success

of an intervention. Intervention results depend on whether or not the assumptions made,

prove to be correct.

• Attribution—the ascription of a causal link between observed changes and a specific

intervention.

• Audit—an independent, objective quality assurance activity designed to add value and

improve an organization‘s operations. It helps an organization accomplish its objectives by

bringing a systematic, disciplined approach to assess and improve the effectiveness of risk

management, control and governance processes.

Note: Internal auditing is conducted by a unit reporting to management, while external

auditing is conducted by an independent organization.

• Baseline—the status of services and outcome-related measures such as knowledge,

attitudes, norms, behaviors, and conditions before an intervention, against which progress

can be assessed or comparisons made.

• Benchmark—a reference point or standard against which performance or achievements can

be assessed.

Note: A benchmark refers to the performance that has been achieved in the recent past by

other comparable organizations, or what can be reasonably inferred to have been achieved in

similar circumstances.

• Beneficiaries—the individuals, groups, or organizations, whether targeted or not, that

benefit directly or indirectly, from the intervention.

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

• Case study—a methodological approach that describes a situation, individual, or the

like and that typically incorporates data-gathering activities (e.g., interviews,

observations, questionnaires) at selected

sites or programs/projects. Case studies are characterized by purposive selection of sites

or small

samples; the expectation of generalizability is less than that in many other forms of

research. The findings are used to report to stakeholders, make recommendations for

program/project improvement, and share lessons learned.

• Conclusions—point out the factors of success and failure of the evaluated intervention,

with special attention paid to the intended and unintended results, and more generally to

any other strength or weakness. A conclusion draws on data collection and analysis

undertaken through a transparent chain of arguments.

• Coverage—the extent to which a program/intervention is being implemented in the

right places (geographic coverage) and is reaching its intended target population

(individual coverage).

• Data—specific quantitative and qualitative information or facts that are collected and

analyzed.

• Economic evaluation—use applied analytical techniques to identify, measure, value

and compare the costs and outcomes of alternative interventions. Types of economic

evaluations include cost-benefit, cost-effectiveness, cost-efficiency evaluations.

• Effectiveness—the extent to which a program/intervention has achieved its objectives

under normal conditions in a real-life setting.

• Efficacy— the extent to which an intervention produces the expected results under ideal

conditions in a controlled environment.

• Efficiency—a measure of how economically inputs (resources such as funds, expertise,

time) are converted into results.

• Epidemiology—the study of the magnitude, distribution and determinants of health-

related conditions in specific populations, and the application of the results to control

health problems.

• Evaluability—extent to which an intervention or program/intervention can be evaluated

in a reliable and credible fashion.

• Evaluation—the rigorous, scientifically-based collection of information about

program/intervention activities, characteristics, and outcomes that determine the merit or

worth of the program/intervention. Evaluation studies provide credible information for

use in improving programs/interventions, identifying

lessons learned, and informing decisions about future resource allocation.

• Facility survey—a survey of a representative sample of facilities that generally aims to

assess the readiness of all elements required to provide services and other aspects of

quality of care (e.g., basic infrastructure, drugs, equipment, test kits, client registers,

trained staff). The units of observation are facilities of various types and levels in the

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

same health system. The content of the survey may vary but typically includes a facility

inventory and, sometimes, health worker interviews, client exit interviews, and client-

provider observations.

• Findings—Factual statements based on evidence from one or more evaluations.

• Formative evaluation—a type of evaluation intended to improve the performance of a

program

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

Handout 1.2: Difference between monitoring and evaluation

Differences between monitoring and evaluation

Monitoring Evaluation

It determines Programme efficiency It determines Programme effectiveness

It establishes standard of performance at the It identifies inconsistencies between the

activity level programme objectives and activities

It forms a basis for Programme accountability It alerts the management of discrepancies

between actual and anticipated levels of

programme impact

It alerts the management of discrepancy It suggests changes in programme

procedures, operation and objectives

It identifies strong &weak points of programme It identifies the possible side effects of the

operations programme

• Monitoring and evaluation are essential management tools which help to ensure that health

activities are implemented as planned and to assess whether desired results are being

achieved.

• A process of measuring, recording, collecting and analyzing data on actual implementation

of the programme and communicating it to the programme managers so that any deviation

from the planned operations are detected, diagnosis for causes of deviation is carried out and

suitable corrective actions are taken.

• Monitoring:

o To provide concurrent feedback on the progress of activities

o To identify the problems in their implementation

o To take corrective action

o It helps in setting norms of performance

o It helps in measuring level of performance

o It helps in comparing performance level with standards or norms

o It helps in identifying deviations and explain the reasons for the deviation for taking

necessary corrective action

• Evaluation: To assess whether the desired results of a programme have been achieved if not how it

should be redesigned

PST 06211 Monitoring and Evaluation of Medicines Use NTA Level 6 Semester 2 Facilitator Guide

Next Topic →View all Monitoring and Evaluation of Medicine Use topics Open Complete Full Notes

PDF / OFFLINE NOTES

Unataka kutumiwa notes hizi kupitia WhatsApp?Kwa notes zilizopangiliwa vizuri kwa kusoma offline au PDF, bonyeza kitufe hapa chini. Ujumbe wenye Level, Semester, Module na Topic utaandaliwa moja kwa moja.TUMIWA NOTES WHATSAPP

WhatsApp: 255620339260