Importance of Validity in Test Construction

Test and Measures 6 instructions
Write a paper in which you answer the following questions and complete the following assignments:
1. Define validity as it relates to tests. Does the term validity apply to a test or a test score? Defend your answer using sources.
2. What is more important for a test, reliability or validity? Defend your answer using sources.
3. Answer the following questions you are welcome to use Kline, T. (2005) Psychological testing: A practical approach to design and evaluation or any other scholarly resources,
Questions:
1. Why is it important to ask test takers to provide feedback on Test items?
2. Why is it important to ask SMEs to provide feedback on Test items?
3. Suppose I have a Primary Grade Adjustment Test that I am interested you using to predict social adjustment in primary grade school (PGAT). Teacher assessments to social adjustment for a group of 50 students is regressed on age first (obtained R2 value of0.15) and then on test score (obtained R2 value of 0.40). What would the conclusions be?
4. What is the difference between predictive and concurrent criterion-related validity studies?
5. What are convergent and divergent assessment useful for?
9. You are interested in seeing if a new test will help to determine who will be successful in training program. The current rate of success is 70% for 200 students. When the new test is implemented, the rate increases to 85% for the 50 students who pass the test and are allowed into the program. Is this difference significant?
11. Suppose that I want to use a test to help predict who will quit their jobs before the end of the three month probation period. One hundred new applicants are hired and the test is administered to all of them the first day. Half of them quite before the end of the three month probation period. Discrimination function analysis is used to determine if the test is useful. The chi-square is significant and the success rate of predicting the quitters verses sayers is 80%. What would be the conclusion?
12. If the slopes of two regression lines are significantly different for two identifiable subgroups, what would be concluded?
14. What is the reason for wanting to use validity generalization?
15. What is meta-analysis?
16. Why is synthetic validity so dependent on the expertise of SMEs?
Questions:
1. If a test of 20 items is subjected to a principal components analysis and the first eigenvalue is 5.0, what does this mean?
2. What does the component loadings represent in an orthogonal principal components analysis?
5. What does it mean to rotate a solution?
4. Compare and contrast face, content, predictive, concurrent, divergent, and discriminant validity.
5. Compare and contrast assessing validity using content and criterion measures and assessing it by examining the internal structure of a test. What are the advantages and disadvantages of each? When is one more appropriate than the other? Defend your answer using sources.
6. How is Factorial Analysis used in assessing validity?
7. Is Snyders (1974) Self-Monitoring Scale valid? What threats to validity did/did not Snyder address in the validation process? Defend your answer using sources.
8. Is Snyder et al.s (1997) Childrens Hope Scale valid? What threats to validity did/did not Snyder et al. address in the validation process? Defend your answer using sources.
9. Why might a test administered online have a different factor structure than the same test administered as a paper and pencil test? Does the answer have implications for your research?
10. A new scale has concurrent validity with an existing scale of .80. What does this mean? Is this good? Bad? Defend your answer using sources.
11. What have you learned from this assignment that you will apply to evaluating research articles on your topic and selecting a measure to use in answering your research question?

Reference
Buchanan, T., Ali, T., Heffernan, T., Ling, J., Parrot, A., Rodgers, J., & Scholey, A. (2005). Nonequivalence of on-line and paper-and-pencil psychological tests: The case of the prospective memory questionnaire.
Kline, T. (2005) Psychological testing: A practical approach to design and evaluation
Snyder, C., Hoza, B., Pelham, W., Rapoff, M., Ware, L., Danovsky, M., Highberger, L., Rubinstein, H., & Stahl, K. (1997). The development and validation of the children\’s hope scale.
Snyder, M. (1974). Self-monitoring of expressive behavior. Journal Of Personality And Social Psychology, 30(4), 526-537. doi:10.1037/h0037039
Trochim, W. (2006). The research methods knowledge base.