Pre-Testing the Research Tools – PST06210 Operational Research
NTA Level 6 • Semester 2 • PST06210 Pre-Testing the Research Tools Operational Research • Source Session/Topic 17 Full source-text version: all educational wording from the extracted learning source is retained; only presenter/tutor metadata and web-layout noise are removed, while formatting is improved for readability. Session 17: Pre-Testing the Research Tools Total Session Time: 60 minutes + 240 minutes assignment Prerequisites None Learning Tasks By the end of this session students are expected to be able to: Define pretest and pilot study Outline reasons for pretest Describe the components of a pre-test Plan and carry out pre-test of research components Resources Needed Flip charts, marker pens, and masking tape Black/white board and chalk/whiteboard markers Computer and LCD Projector Handout 17.1: Summary of points to assess during a pre-test or pilot study SESSION OVERVIEW Activity/ Step Time Content Method 1. 05 minutes Presentation Introduction, Learning Tasks Presentation Definition of Pre-test and pilot study 2. 05 minutes Brainstorming Presentation Reasons for pretesting 3. 10 minutes Lecture discussion Presentation 4. 15 minutes Components of a Pre-Test and Pilot Study Buzzing 10 minutes Presentation 5. Planning and Carrying out Pre-Test of Research Buzzing Components 6. 05 minutes Presentation Key Points 7. 05 minutes Presentation Evaluation 8. 05 minutes Presentation Assignment ___________________________________________________________________________ PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 173 SESSION CONTENTS STEP1: Presentation of Session Title and Learning Tasks (5 minutes) READ or ASK students to read the learning tasks and clarify ASK students if they have any questions before continuing STEP 2: Definition of a Pre-Test or Pilot Study (05 minutes) Activity: Brainstorming (2 minutes) Ask students to brainstorm on the following questions: What are the components of pre-test tools or pilot study? ALLOWS few students to respond WRITE their responses on the flipchart or board CLARIFY and SUMMARIZE by using the content below A pre-test o Refers to a small-scale trial of particular research components A pilot study o is the process of carrying out a preliminary study, going through the entire research procedure with a small sample STEP 3: Reasons for Pre-Testing (10 minutes) Help to identify potential problems in the proposed study. Enables, if necessary, to revise the methods and logistics of data collection before starting the actual field works. As a result, a good deal of time, effort and money can be saved. Pre-testing is simpler and less time-consuming and costly than conducting an entire pilot study. ___________________________________________________________________________ PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 174 STEP 4:Components of Pre-Testing (15 minutes) Activity: Buzzing (5 minutes) Ask students to buzz on the following question: What are the components of pre-test? ALLOWS few students to respond WRITE their responses on the flipchart or board CLARIFY and SUMMARIZE by using the content below The components of research to be pre-test include: o Reactions of the respondents to the research procedures o The data-collection tools o Sampling procedures o Staffing and activities of the research team o Procedures for data processing and analysis o The proposed work plan and budget for research activities Reactions of the respondents to the research procedures o Availability of the study population o Study population daily work schedules o Acceptability of the methods used o Acceptability of the questions asked o willingness of the respondents to answer the question The data-collection tools o Whether the tools can collect the information you need and whether they are reliable o How much time is needed to collect data o Whether there is any need to revise the format or presentation of interview guides/questionnaires e.g. Sequencing Wording Translation Space for answers Sampling procedures o Instructions followed o Time need to locate respondents Staffing and activities of the research team ___________________________________________________________________________ PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 175 o training o Logistics o team work Procedures for data processing and analysis work plan and budget for research activities STEP 4: Planning and Carrying Out Pre-Tests of Research Components (10 minutes) Activity: Buzzing (5 minutes) ASK students to pair up and buzz on the following question for 2 minutes • What are the components of research that should be assessed during the pre-testing? ALLOW few students to respond WRITE their responses on flipchart or board CLARIFY and SUMMARIZE by using the content below Components of research to be assessed during the pre-testing • During training o The reactions o Appropriateness of study type(s) and research tools o Format and wording of questionnaires and interview schedules o Accuracy of the translations o The time o Sampling procedures Data processing and analysis. • Pre-test in the actual research area o What difficulties do you expect in the implementation of your proposal? o Inexperience with a certain data-collection technique o Which parts of your study will be most costly and time-consuming? • It is highly recommended that you analyse the data collected during the pre-test right away STEP 5: Key Points (5 minutes) • A pre-test refers to a small-scale trial of particular research components ___________________________________________________________________________ PST 06210 Operational Research NTA Level 6 Semester 2 Facilitator Guide 176 • A pilot study is the process of carrying out a preliminary study, going through the entire research procedure with a small sample • It is highly recommended that you the pre-test some components of your study STEP 6: Evaluation (5 minutes) • What is a pre-test? • What is pilot study? • What research components are to be pre-tested? STEP 7: Take Home Assignment (5 minutes) Activity: Take Home Assignment (5 minutes) DIVIDE students in groups or individuals ASK the students to work on the following Assignment • Identify what aspects of the study you would like to pre-test in your research area and why, with whom, when and where. • Summarize this information in one or two paragraphs in your research proposal. ALLOCATE