# Notes ## What are data - Just the information researchers get from their research participants. - Ask where, when, how often, and who will collect the data. ## Instrumentation - Everything you do to collect that data - Preferred to select an already available instrument, rather than create your own. - Here are some results from [ERIC](https://eric.ed.gov/?q=leadership+instruments&ff1=subPrincipals&ff2=subAdministrator+Attitudes&ff3=subProfessional+Development) - Better results from [ERIC](https://eric.ed.gov/?q=leadership+instruments&ff1=subPrincipals&ff2=subAdministrator+Attitudes&ff3=subProfessional+Development) - Get instruments here: - http://ericae.net - http://ets.org/testcoll - dead link - https://marketplace.unl.edu/buros/ - ## Validity and Reliability - Valid: “ Extent to which results from it, permit researchers to draw warranted conclusions about the characteristics of the individuals studied” (p. 138) - Can we draw conclusions from it? - Reliable: Does it provide consistent results? ## Objectivity and Usability - Objectivity - make it not subjective. Could someone else come to the same conclusions looking at the data? - Usability - Is it easy enough for someone to use without a lot of training. [[The APLUS Framework for Deciding how to Adopt Artificial Intelligence in your Schools This Fall|APLUS Framework]] - ## Ways to Classify Instruments - Who provides the data, method of collection, who collects it, kind of response from participants. - “ Research data are obtained by directly or indirectly, assessing the subjects of a study” (p. 138). - Self-report - Informant - provided by other people about the subjects (mom answering for her kids) ## Types of Instruments | Researcher-completed | Subject Completed | | ---- | ---- | | rating scales | questionairres | | Interview schedules | self-checklists | | Observation forms | Attitude Scales | | Tally Sheets | Personality inventories | | Flow Chart | Achievement, aptitude and performance tests | | Performance Checklists | projective sociometric devices | | Anecdotal Records | | | Time and Motion Logs | | - Sociogram - related to another idea in [[The Anatomy of Peace]]. - Selection (choose from a choice) or Supply (supply your own short essay) - ERIC Database - Unobtrusive - no intrusion into what's already happening. - "in general qualitative, researchers, believe a researchers, worldview, or theoretical framework, greatly influences, how research studies are designed and the results and interpreted" (p. 117) see more in [[The Nature of Qualitative Research|Chapter 18 Philosophical Assumptions]] - - ## Norm-Referenced vs. Criterion Referenced Instruments - Norm-Referenced: "Instruments that provide scores that compare individual scores to the scores in appropriate reference group" (p. 139) - Criterion-Referenced: "Instruments that are based on a specific target for each learner to achieve" (p. 139). ## Measurement Scales See [[5 Variables, Hypotheses, and Propositions#^996fa5|two basic types of variables]]-quantitative and categorical. Ordered from Least information to Most Information: - Nominal - "numbers to indicate membership" - Ordinal - "numbers to rank scores high to low" - Interval - "numbers to represent equal intervals in different segments on a continuum" - Ratio - "numbers to represent equal distance from a zero point"![[measurement scales.jpeg]] - A question I still have: how will I know which of these is the right scale to use? ## Preparing Data for Analysis - scored accurately and consistently - advice: practice scoring with another person before doing it with the sample group. - tabulating and coding [[Jethro Dissertation Instrumentation]]