EDT 8230 - Digital Teaching: Research Methods
![Target Learning Objective](/uploads/7/0/1/9/70199053/published/darts-wallpaper-3.jpg?1519266671)
1. Learning Objectives
Upon completion of this workshop, you should be able to complete the following tasks:
1. Describe the role of measurement in research and list the four levels of measurement
2. Explain the goal of reliability in and when it occurs in research
3. Define validity and name the three types
4. List two possible uses of reliability in facility management
Upon completion of this workshop, you should be able to complete the following tasks:
1. Describe the role of measurement in research and list the four levels of measurement
2. Explain the goal of reliability in and when it occurs in research
3. Define validity and name the three types
4. List two possible uses of reliability in facility management
![Presentation Graphic](/uploads/7/0/1/9/70199053/editor/presentation-2-people-at-screen.jpg?1519257208)
2. Introduction - Educational Technology Research Focus: Presentation Software
Hello! Welcome to the EDT 8230 Digital Teaching – Research Methods workshop. This course involves the interpretation and critique of teaching and learning research, the application of research methods to specific research questions, and aspects of qualitative and quantitative research design.
An overarching theme of this course is the application of research methods to an educational technology of choice applicable to the student’s current or future career. I’ve chosen research regarding the use of presentation software as it relates to effectiveness in audience attention and message retention.
Presentation software is a computer-based visual and audio medium used in both educational and organizational settings to share information including images, text, and audio. It is designed to help a presenter convey messages and provide visual references consistent with the presenter’s words. Examples of presentation software include Google Slides, Prezi, and Microsoft PowerPoint.
Hello! Welcome to the EDT 8230 Digital Teaching – Research Methods workshop. This course involves the interpretation and critique of teaching and learning research, the application of research methods to specific research questions, and aspects of qualitative and quantitative research design.
An overarching theme of this course is the application of research methods to an educational technology of choice applicable to the student’s current or future career. I’ve chosen research regarding the use of presentation software as it relates to effectiveness in audience attention and message retention.
Presentation software is a computer-based visual and audio medium used in both educational and organizational settings to share information including images, text, and audio. It is designed to help a presenter convey messages and provide visual references consistent with the presenter’s words. Examples of presentation software include Google Slides, Prezi, and Microsoft PowerPoint.
![Air Force Briefing](/uploads/7/0/1/9/70199053/editor/161021-f-st721-006.jpg?1519257219)
Microsoft PowerPoint (or simply PowerPoint) is important in my career as a federal employee since the Air Force relies 100% on Microsoft operating systems and Office software. PowerPoint is used to support briefings that convey mission information, training, meetings, and current events.
Researching the effectiveness of presentation software serves a personal interest for learning more about strategies to improve the design of my own presentations for maximum message effectiveness.
Researching the effectiveness of presentation software serves a personal interest for learning more about strategies to improve the design of my own presentations for maximum message effectiveness.
![Bell Curve](/uploads/7/0/1/9/70199053/editor/bell-curve-marketing.jpg?1519257230)
3. Measurement and its Importance in Facility Management
3A. Measurement in Research
Measurement in research involves the assignment of values to outcomes, and consists of various levels and a classification system to assess what is measured (Salkind, 2017). Examples of measurement levels include Ratio, Interval, Ordinal, and Nominal (Salkind, 2017). Measurements are obtained through the use of assessment tools and surveys in various formats (Salkind, 2017). These tools must possess the qualities of Reliability and Validity (Salkind, 2017).
3A. Measurement in Research
Measurement in research involves the assignment of values to outcomes, and consists of various levels and a classification system to assess what is measured (Salkind, 2017). Examples of measurement levels include Ratio, Interval, Ordinal, and Nominal (Salkind, 2017). Measurements are obtained through the use of assessment tools and surveys in various formats (Salkind, 2017). These tools must possess the qualities of Reliability and Validity (Salkind, 2017).
![Consistent Scores Graph](/uploads/7/0/1/9/70199053/published/b5201a3712cf4057fa70e2907b7b88a7.jpg?1519257269)
3B. Reliability
Reliability of a test or survey instrument occurs when the test measures something multiple times with the same or similar results (Salkind, 2017). Reliability focuses on the scores of the test, and consist of three main components: An observed score, which is the recorded score; a true score, which is the true value of the variable with no internal external or internal influences; and an error score, which are factors that create a difference between the observed score and true score (Salkind, 2017).
Reliability of a test or survey instrument occurs when the test measures something multiple times with the same or similar results (Salkind, 2017). Reliability focuses on the scores of the test, and consist of three main components: An observed score, which is the recorded score; a true score, which is the true value of the variable with no internal external or internal influences; and an error score, which are factors that create a difference between the observed score and true score (Salkind, 2017).
![York Chiller](/uploads/7/0/1/9/70199053/published/york-chiller-panel-edited-compressor.jpg?1519257277)
3C. Reliability Applied to Facility Management
Reliability applied to the field of facility management could involve equipment inspection checklist based on underlying engineering constructs critical to ensure continued equipment operation and return on organizational investment. A form of reliability applicable to checklist use involves inter-rater reliability. Inter-rater reliability is a measure of agreement between two raters performing separate analysis using the same instrument (Salkind, 2017). Applying inter-rater reliability to two maintenance technicians using a checklist to inspect a piece of equipment, inter-rater reliability could be used to see if the two technicians arrived at the same findings after an inspection.
Another form of reliability that may be useful in facility management and maintenance checklists is parallel-forms reliability. Parallel forms reliability involves providing different forms of the same test to the same group of participants, ensuring they measure the same thing, even though they are constructed differently (Salkind, 2017). In relation to facility management equipment checklists, it would be important to ensure two different forms of maintenance checklist were measuring and recording the same data.
Reliability applied to the field of facility management could involve equipment inspection checklist based on underlying engineering constructs critical to ensure continued equipment operation and return on organizational investment. A form of reliability applicable to checklist use involves inter-rater reliability. Inter-rater reliability is a measure of agreement between two raters performing separate analysis using the same instrument (Salkind, 2017). Applying inter-rater reliability to two maintenance technicians using a checklist to inspect a piece of equipment, inter-rater reliability could be used to see if the two technicians arrived at the same findings after an inspection.
Another form of reliability that may be useful in facility management and maintenance checklists is parallel-forms reliability. Parallel forms reliability involves providing different forms of the same test to the same group of participants, ensuring they measure the same thing, even though they are constructed differently (Salkind, 2017). In relation to facility management equipment checklists, it would be important to ensure two different forms of maintenance checklist were measuring and recording the same data.
![Accurate Measurement](/uploads/7/0/1/9/70199053/published/80mm-plastic-caliper-accurate-measurement-tools-standard-vernier-caliper-jade-measurement-ruler-promotional-gifts-color-random.jpg?1519257287)
3D. Validity
Validity describes whether a test instrument actually measures what it’s designed to measure (Salkind, 2017). The three aspects of validity include the test results (not the test itself), the degree of validity measured from low to high, and that the results of a test are measured within the context of the test itself (Salkind, 2017). The three types of validity are content, criterion (which includes concurrent and predictive), and construct validity (Salkind, 2017).
Validity describes whether a test instrument actually measures what it’s designed to measure (Salkind, 2017). The three aspects of validity include the test results (not the test itself), the degree of validity measured from low to high, and that the results of a test are measured within the context of the test itself (Salkind, 2017). The three types of validity are content, criterion (which includes concurrent and predictive), and construct validity (Salkind, 2017).
![Med Voltage Electrical Switchgear](/uploads/7/0/1/9/70199053/published/medium-voltage.jpg?1519260879)
3E. Validity Applied to Facility Management
The application of content validity to equipment inspection checklists could ensure checklist items represent the most critical inspection tasks, from all possible tasks needed to verify proper equipment operation. For example, it wouldn’t be necessary to inspect every possible equipment function on a monthly checklist when this sort of inspection is better suited for an annual, more detailed inspection. With this in mind, the importance of scrutinizing content validity in inspection checklists could save time and resources by preventing under or over performance of an inspection required at a specific time or interval. This is similar to avoiding consequences of poor inter-rater reliability in terms of cost and labor hours.
Under the guise of equipment inspection, another form of validity that could apply involves construct validity. Construct validity links the components of a test to an underlying theory or model (Salkind, 2017). For inspection checklists, construct validity would apply if the items on the checklist related to a larger theory of equipment maintenance for that type of equipment. For example, checklist maintenance items for a high voltage switch should relate to underlying electrical engineering theory, or a construct of high voltage electrical principles and how these principles apply to switch gear designed to protect a circuit.
The application of content validity to equipment inspection checklists could ensure checklist items represent the most critical inspection tasks, from all possible tasks needed to verify proper equipment operation. For example, it wouldn’t be necessary to inspect every possible equipment function on a monthly checklist when this sort of inspection is better suited for an annual, more detailed inspection. With this in mind, the importance of scrutinizing content validity in inspection checklists could save time and resources by preventing under or over performance of an inspection required at a specific time or interval. This is similar to avoiding consequences of poor inter-rater reliability in terms of cost and labor hours.
Under the guise of equipment inspection, another form of validity that could apply involves construct validity. Construct validity links the components of a test to an underlying theory or model (Salkind, 2017). For inspection checklists, construct validity would apply if the items on the checklist related to a larger theory of equipment maintenance for that type of equipment. For example, checklist maintenance items for a high voltage switch should relate to underlying electrical engineering theory, or a construct of high voltage electrical principles and how these principles apply to switch gear designed to protect a circuit.
4. Sample Qualitative Study Design
A qualitative study involves descriptive research used to describe a phenomenon (Salkind, 2017). This design includes an introduction, a research question, participants in the study, the measurements and methods used to collect data, procedures for how the study will take place, and the tools used to analyze the data. This type of design is important to observe behaviors or capture data regarding thoughts, feelings, or opinions through open-ended questions involving the use of presentation software.
To view the qualitative study design video, select the play button below:
A qualitative study involves descriptive research used to describe a phenomenon (Salkind, 2017). This design includes an introduction, a research question, participants in the study, the measurements and methods used to collect data, procedures for how the study will take place, and the tools used to analyze the data. This type of design is important to observe behaviors or capture data regarding thoughts, feelings, or opinions through open-ended questions involving the use of presentation software.
To view the qualitative study design video, select the play button below:
5. Sample Quantitative Study Design
A quantitative study involves various forms of experimental research methods. The design used for this study is a pretest posttest control group design, chosen because of its ability to show a cause and effect relationships. This design involves random selection of participants, random assignment of a treatment, and random assignment to groups (Salkind, 2017).
Like the qualitative study, it includes an introduction, a research question, participants in the study, the measurements and methods used to collect data, procedures for how the study will take place, and the tools used to analyze the data.
This type of design is important to compare the compare the results of a research participants (control group) who complete a survey of their impressions of a classic 6X6 PowerPoint design versus participants (experimental group) who review a beyond bullet point design.
To view the quantitative study design video, select the play button below:
A quantitative study involves various forms of experimental research methods. The design used for this study is a pretest posttest control group design, chosen because of its ability to show a cause and effect relationships. This design involves random selection of participants, random assignment of a treatment, and random assignment to groups (Salkind, 2017).
Like the qualitative study, it includes an introduction, a research question, participants in the study, the measurements and methods used to collect data, procedures for how the study will take place, and the tools used to analyze the data.
This type of design is important to compare the compare the results of a research participants (control group) who complete a survey of their impressions of a classic 6X6 PowerPoint design versus participants (experimental group) who review a beyond bullet point design.
To view the quantitative study design video, select the play button below:
![Assessment Score Sheet](/uploads/7/0/1/9/70199053/published/o-standardized-test-facebook.jpg?1519226728)
6. Assessment
Now that you've reviewed the content of this workshop, test your knowledge of research methods by taking the quiz below.
Now that you've reviewed the content of this workshop, test your knowledge of research methods by taking the quiz below.
Thank you for visiting this workshop. If you have questions regarding it's content, please email me at: [email protected]
Reference
Salkind, N. J. (2017). Exploring research (9th edition). Boston: Pearson.
Salkind, N. J. (2017). Exploring research (9th edition). Boston: Pearson.