Back to Research Design and Analysis HomePage
University of Nebraska-Lincoln |
|---|
Instructor: |
Dr. Lesa Hoffman |
|
|
Email: |
Phone: |
(402) 472-6930 |
|
Rooms: |
77 and 227/234 Burnett Hall |
Office: |
220 Burnett Hall (mailbox in 237 Burnett) |
| Time: | 1:15-2:30 MWF (3 credits) | Office Hours: |
2:30-3:30 MWF, 3:30-4:30 WF, and by appointment |
Links under topics below are .pdf files for the lecture materials.
Versions of the .pdf files including the answers will be available after each class under "answers".
Audio links are .mp3 files taped from the class lecture (right-click, use "save target/link as").
| Week | Date | Topic and Downloads | Readings & Manuals |
|---|---|---|---|
| 1a | 8/24 | Course Introduction (audio) Lecture: Introduction to Latent Trait Measurement Models (audio) |
|
| 1b | 8/26 | Lecture: Concepts in Item and Scale Construction (audio) | McDonald ch. 2-4 |
| 1c | 8/28 | Lecture: Classical Test Theory Approaches to Validity (audio) | John & Benet-Martinez (2000) |
| 2a | 8/31 | Lecture: Classical Test Theory Reliability and Item Analysis Part 1 (audio) | McDonald ch. 5-7 |
| 2b | 9/02 | Lecture: Classical Test Theory Reliability and Item Analysis Part 2 (audio) Example: Reliability Analysis using SPSS and SAS (audio) |
McGraw & Wong (1996) |
| 2c | 9/04 | *Final Project Available* Example (2b) continued Lecture: Exploratory Factor Analysis and Principle Components Analysis (audio1) (audio2) |
Preacher & MacCallum (2003) |
| 3a | 9/07 | NO CLASS |
|
| 3b | 9/09 | Begin Assignment #1: Classical Items Analysis |
Brown ch. 2 |
| 3c | 9/11 | MEET IN 227 LAB Introduction to Mplus (audio) |
|
| 4a | 9/14 | NO CLASS | |
| 4b | 9/16 | Lecture: Confirmatory Factor Models Part 1: Model Identification (audio1) (audio2) |
Brown ch. 3-4 |
| 4c | 9/18 | Assignment #1 due via email by 11:59 PM CFA Models Part 1, continued Example: Confirmatory Factor Models in Mplus (audio1) (audio2) (audio3) Spreadsheet for Predicted Values and Model Comparisons |
|
| 5a | 9/21 | Feedback on Assignment #1 |
Brown ch. 5 |
| 5b | 9/23 | Confirmatory Factor Models in Mplus example (4c), continued |
|
| 5c | 9/25 | Confirmatory Factor Models in Mplus example (4c), continued Lecture: Confirmatory Factor Models Part 3: Higher-Order Factors (audio1) (audio2) |
|
| 6a | 9/28 | Revisions of Assignment 1 due via email by 11:59 PM MEET IN 234 LAB Begin Assignment #2: Confirmatory Factor Models |
|
| 6b | 9/30 | MEET IN 227 LAB Open lab time for Assignment #2 |
|
| 6c | 10/02 | Higher-Order Factors (5c), continued Example: Confirmatory Factor Models with Higher-Order Factors in Mplus (audio1) (audio2) |
Brown ch. 7-8 |
| 7a | 10/05 | Example (6c), continued Lecture: Confirmatory Factor Models Part 4: Measurement Invariance Example: Testing Measurement Invariance across Groups in Mplus Spreadsheet for MG and Longitudinal Invariance Model Comparisons (combined lecture and example for audio: audio1 audio2 review+audio3) |
Vandenberg & Lance (2000) |
| 7b | 10/07 | Assignment #2 due via email by 11:59 PM NO CLASS |
|
| 7c | 10/09 | NO CLASS |
|
| 8a | 10/12 | *Recommended due date for Parts 1 and 2 of Final Project* Measurement Invariance (7a), continued |
Meade & Bauer (2007) |
| 8b | 10/14 | Feedback on Assignment 2 Measurement Invariance (7a), continued |
|
| 8c | 10/16 | Example: Testing Measurement Invariance across Time in Mplus (audio) |
|
| 9a | 10/19 | NO CLASS |
|
| 9b | 10/21 |
Lecture: Logistic and other Generalized Models (audio1) (audio2) |
DeMaris (2003) |
| 9c | 10/23 | Revisions of Assignment 2 due via email by 11:59 PM Logistic and Generalized Models (9b), continued Spreadsheet for MLR Model Comparisons - FIXED 11/19 Lecture: A World View of Models (audio) |
|
| 10a | 10/26 | Lecture: Item Response Models Part 1: Binary Response Models (audio1) (audio2) Example: Binary Response Models in Mplus (audio1) (audio2) Spreadsheet for Conversion from IFA to IRT IFA to IRT Formula Guide |
E & R ch. 1-4 Mungas & Reed (2000) |
| 10b | 10/28 | Binary Response Models (10a), continued |
Kamata & Bauer (2008) |
| 10c | 10/30 | Lecture: Item Response Models Part 2: Polytomous Response Models Example: Graded Response Polytomous Models in Mplus (combined lecture and example audio1, review+audio2) |
E & R ch. 5 |
| 11a | 11/02 | Polytomous Response Models (10c), continued Lecture: Item Response Models Part 3: Estimation and Evaluation (audio1) (audio2) Example: IRT Model Comparisons in Mplus |
E & R ch. 6-8 Wirth & Edwards (2007) |
| 11b | 11/04 | *Final Project Outline due via email by 11:59 PM* Model Estimation and Evaluation (11a), continued |
|
| 11c | 11/06 | Examples (11b), continued Spreadsheet for Generalized Partial Credit Model Plot Spreadsheet for Graded Response Model Plots |
Sheu et al. (2005) |
| 12a | 11/09 | MEET IN 234 LAB Begin Assignment #3: Item Response Models |
|
| 12b | 11/11 | MEET IN 227 LAB Open lab time for Assignment #3 |
|
| 12c | 11/13 | NO CLASS | |
| 13a | 11/16 | NO CLASS |
|
| 13b | 11/18 | Lecture: Item Response Models Part 4: Differential Item Functioning |
E & R ch. 10 |
| 13c | 11/20 | Assignment 3 due via email by 11:59 PM DIF (13b), continued Example: Examples of IRT Models using SAS NLMIXED (audio) |
Millsap & Yun-Tein (2004) Edwards & Wirth (2009) |
| 14a | 11/23 | Feedback on Assignment #3 Lecture: Validity via Explanatory Latent Trait Models |
Embretson (1983) Rijmen et al. (2003) Smith (2001) |
| 14b | 11/25 | NO CLASS |
|
| 14c | 11/27 | NO CLASS |
|
| 15a | 11/30 | MEET IN 234 LAB - Open time to work on assignment 3 or final projects |
|
| 15b | 12/02 | *Recommended due date for Part 3 of Final Project* Example: Other Generalized Measurement Models in Mplus |
Atkins & Gallop (2007) Bauer & Hussong (2009) |
| 15c | 12/04 | Revisions of Assignment 3 due via email by 11:59 PM Lecture: Introduction to Diagnostic Classification Models Example: Diagnostic Classification Models in Mplus |
Rupp, Templin, & Henson (ch. 9) |
| 16a | 12/07 | Student Presentations Course Evaluations |
|
| 16b | 12/09 | *Last day to turn in drafts of any part of the final project* Student Presentations |
|
| 16c | 12/11 | Student Presentations | |
| 17 | 12/16 | Complete Final Project due via email by 11:59 PM |
This course will illustrate contemporary approaches to measurement, expanding from classical test theory into confirmatory factor models and item response models. In addition to the statistical models, however, the course will also focus on the measurement concepts behind these models and how they compare and contrast with each other with respect to scale construction and evaluation. Class time will be devoted primarily to lectures and examples. Lecture materials in .pdf format will be available for download at the website above the day prior to each class, or else paper copies will be provided in class. Audio recordings of the class lectures in .mp3 format will also be posted online, but are not intended to take the place of class attendance. Because the course will be applied, course sessions will also be held in the 227 and 234 Burnett computer labs (see syllabus for dates), in which participants will have opportunities for hands-on practice and to work on course assignments. The primary program utilized will be Mplus, although additional programs may be brought in as needed. Lab time will be used to provide instruction with each program used; no prior experience with any program (other than SPSS or SAS) is assumed.
Participants should be familiar with the general linear model (analysis of variance, regression) prior to enrolling in this course, but no previous familiarity with measurement or structural equation modeling (other than exploratory factor analysis) is assumed. Participants will need access to Mplus software. Mplus is available in rooms 234, 227, and 230 Burnett. Student licenses are expensive ($200 for the base program), but may be worth the cost if these models are something you're likely to need frequently (but they do not expire yearly as do other programs). Course assignments will include both essay questions and application of techniques discussed in class, and will utilize data sets provided by the instructor. Participants are strongly encouraged to use an item-level dataset within their substantive area for the final project, but example data sets can also be made available. Requirements for the final project dataset will be discussed in more detail throughout the semester. Finally, this course is intended to serve as a precursor to a course in Structural Equation Modeling (to be taught spring 2010 in EDPS).
Course performance will be evaluated as follows. Details about each requirement will be presented throughout the semester prior to the due dates.
Course Assignments:
Three assignments (65 points) will be administered in order to give participants the practice applying techniques discussed in class and will be due as listed on the online syllabus. Each assignment must be at least 3/4 complete in order to be accepted and may be revised ONCE to earn the maximum possible points. Assignments should be submitted electronically via email as a Microsoft Word document using this naming convention: 948_FirstLast_HW# (adding an r for a revision). Please use the track changes' function in Microsoft word when revising assignments.
Final Project and Presentation:
Participants will complete an independent project utilizing ideas and techniques discussed through the semester (25 points) and will be due as noted on the online syllabus. The results of the project will also be presented in a 12-minute talk (10 points), to be given at the end of the semester. A project outline (5 points) will be due prior to the end of the semester as noted on the syllabus.
Policy on Assigning Incompletes:
A grade of incomplete will be assignment ONLY in the case of extenuating circumstances that prevent participants from completing course requirements in a timely manner. If an incomplete is assigned, then all course requirements must be completed within ONE MONTH of the end of the course or else the incomplete will turn into whatever grade has been earned at that point.
Policy on Late Assignments:
If other obligations or circumstances will prevent you from completing any course requirements, please contact me so that we can create a solution . Don't wait until you are behind! If you contact me at least two weeks prior to a due date we may be able to extend the deadline to accommodate any extenuating circumstances. Otherwise, late assignments will be docked .5 points per day in order to encourage participants to keep up with the course. Points lost to lateness will not be returned.
Final grades for Psychology 948 will be determined according to the proportion earned of 105 possible points:
=97 = A+ 93-96 = A 9092 = A- 87-89 = B+ 83-86 = B 80-82 = B- < 80 = C
As a reminder, the University has a policy on academic honesty (see the Graduate Studies Bulletin). Although data sets may be shared, all course assignments should be done individually and all final projects should be unique.
Students with disabilities are encouraged to contact the instructor for a confidential discussion of their individual needs for academic accommodation. It is the policy of the University of Nebraska-Lincoln to provide flexible and individualized accommodation to students with documented disabilities that may affect their ability to fully participate in course activities or to meet course requirements. To receive accommodation services, students must be registered with the Services for Students with Disabilities (SSD) office, 132 Canfield Administration, 472-3787 voice or TTY.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford.
Book Chapters:
DeMaris, A. (2003). Logistic regression. In J. A. Schinka & W. F. Velicer (Eds.), Research methods in psychology (Vol. 2, pp. 509-532). New York, NY: Wiley.
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
Rupp, A., Templin, J., & Henson, R. (2010). Diagnostic Measurement: Theory, Methods, and Applications. Forthcoming from Guilford Press.
Journal Articles:
Atkins, D. C., & Gallop, R. J. (2007). Rethinking how family researchers model infrequent outcomes: A tutorial on count regression and zero-inflated models. Journal of Family Psychology, 21 (4), 726-735.
Bauer, D. J., & Hussong, A. M. (2009). Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models. Psychological Methods, 14(2), 101-125.
Edwards, M. C., & Wirth, R. J. (2009). Measurement and the study of change. Research in Human Development, 62(2-3), 74-96.
Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93(1), 179-197.
John, O. P., & Benet-Martinez, V. (2000). Measurement: Reliability, construct validation, and scale construction. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 339-369). New York, NY: Cambridge University Press.
Kamata, A., & Bauer, D. J. (2008). A note on the relation between factor analytic and item response theory models. Structural Equation Modeling, 15, 136-153.McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30-46.
Meade, A. W., & Bauer, D. J. (2007). Power and precision in confirmatory factor analytic tests of measurement invariance. Structural Equation Modeling, 14 (4), 611-635.
Millsap, R. E., & Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39(3), 479-515.
Mungas, D., & Reed, B. R. (2000). Appliction of item response theory for development of a global functioning measure of dementia with linear measurement propoerties. Statistics in Medicine, 19, 1631-1644.
Preacher, K. J., & MacCallum, R. C. (2003). Repairing Tom Swift's electric factor analysis machine. Understanding Statistics, 2(1), 13-43.
Rijmen, F., Tuerlinckx, F., De Boeck, P., & Kuppens, P. (2003). A nonlinear mixed model framework for item response theory. Psychological Methods, 8(2), 185-205.
Sheu, C.-F., Chen, C.-T., Su, Y.-H., & Wang, W.-C. (2005). Using SAS PROC NLMIXED to fit item response theory models. Behavior Research Methods, 37(2), 202-218.
Smith, E. V., Jr. (2001). Evidence for the reliability of measures and validity of measure interpretation: A Rasch measurement perspective. Journal of Applied Measurement, 2(3), 281-311.Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-69.
Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12(1), 58-79.