Research Methodologies Workshop on the
Digital Scholarship of teaching and Learning
Smart Learning Objectives
Introduction
This workshop will be on the use of "Plickers", an online hybrid student response system. This is a program that uses a four sided QR code printed on card stock. Each side of the code card is labeled as A, B, C or D. Students are able to rotate the card then give their choice for an answer. Zahner (2016) describes it as a hybrid technology because only the teacher needs a device to scan the student response cards.
|
At Plickers.com (2017) it claims to be an interactive tool with a powerful visual experience. Teachers want to create a hook for learning while getting needed data that will support teaching in a timely manner. This is a free resource where teachers can simply create an account and print off the cards for use. Teachers can quickly upload a class roster into the website and begin using it in class. As a result teachers can quickly see if students need more support or plan additional review, while also having the ability to share reports with administration. Increasing student engagement, low/minimal cost and the fact that teachers can quickly collect formative assessment data to check for understanding make this an interesting resource to study in the K12 classroom.
Measure in Research
When we reflect on these terms for success when addressing the research question. We need to know if the information is reliable or consistent and valid, or does it do what it says it will do (Salkind, 2017)? As responsible researchers we must strive to create tools that have both, reliability and validity, at the highest standard.
Reliability
Inter-rater reliability requires several trained members on a the research team. Salkind (2017) tells us that it is important that all raters consistently interpret data during a study. The goal here is to ensure consistency between raters. Training is a required aspect of this method and then review of collected data to see a percentage of agreement between the raters. A high agreement infers accuracy. If a rater is inconsistent in reporting the data could be wrong. In the qualitative study you will notice that inter-rater reliability is the measure for interpreting data from the teacher focus groups on use of Plickers.
Another type of reliability Salkind (2017) addresses is internal consistency. This is most often a measure that uses the statistical tool Cronbach’s alpha to determine correlations between items on a test or scale. Reflected in the quantitative study is the use of internal consistency on how the assessment tool items correlate to performance.
Validity
Using construct validity Salkind (2017) determines takes time and is the hardest to establish. Construct validity takes into account the results of a test and how they are connected to an underlying set of related variables. It uses a theory with a group of related variables as a measure. The qualitative research focuses on student engagement theory as a part of the research design.
Salkind (2017) tells us that content validity requires an expert review to see if the assessment covers what is being tested. In K12 classrooms teachers are the content experts and draw on the approved curriculum or Common Core Standards when developing the appropriate tests for our students. For the quantitative study on Plickers the researchers needed experts to establish the assessment questions so it measures what it is supposed to measure.
More information on reliability and validity can be found in Neil J. Salkin's book Exploring Research (2017).
More information on reliability and validity can be found in Neil J. Salkin's book Exploring Research (2017).
Qualitative Study
Below is an example of a qualitative research study focused on the use of "PLICKERS" a hybrid audience response system that utilizes QR code cards in the K12 classroom. This is useful in my field as formative assessment but also as a way to bridge the gap of technology in K12 schools. This study will give educators a chance to understand and explore the implications of this tool for student engagement in middle school and high school K12 classrooms. The presentation is divided into the following sections: Introduction, a clear research question, who the participants will be and how they were selected, measure & method on data collection, procedures, data analysis and summary.
quantitative Study
Below is an example of a quantitative research study focused on the use of "PLICKERS" a hybrid audience response system that utilizes QR code cards in the K12 classroom. This is useful in my field as formative assessment but also as a way to bridge the gap of technology in K12 schools. This study will give educators the chance to see if there is any statistical evidence to using this tool with a focus on student learning outcomes. The presentation is divided into the following sections: Introduction, a clear research question, who the participants will be and how they were selected, measure & method on data collection, procedures, data analysis and summary.
Assessment
Please complete the following assessment to check your understanding.
references
Plickers.com (2017). Presentation Guide. Retrieved from
https://plickers.app.box.com/v/presentationkit/1/4069063893 /39829911169/1
Salkind, N. J. (2017). Exploring research. Boston: Pearson.
Zahner, K. (2016, March 20). 10 Reasons to Use Plickers, Not Clickers. Retrieved from
http://learning.zahnerhistory.com/2016/03/10-reasons-to-use-plickers-not-clickers.html
https://plickers.app.box.com/v/presentationkit/1/4069063893 /39829911169/1
Salkind, N. J. (2017). Exploring research. Boston: Pearson.
Zahner, K. (2016, March 20). 10 Reasons to Use Plickers, Not Clickers. Retrieved from
http://learning.zahnerhistory.com/2016/03/10-reasons-to-use-plickers-not-clickers.html