Dear colleagues,
Apologies for cross-postings. My students and I are doing a meta-analysis on the test-retest reliability of policy capturing (i.e., judgment analysis) studies. We have already collected published papers on this topic. We are now looking for unpublished empirical research such as in-press journal articles, working papers, conference papers/posters, dissertations, master's theses, honors theses, technical reports, applied projects in organizations, and even projects that do not yet have writeups but from which information can readily be extracted and sent to us.
Our focus is on policy-capturing (judgment analysis) studies that:
(A) Repeat some or all of the policy-capturing scenarios (profiles), and
(B) Calculate the relationship (e.g., Pearson product-moment correlation) between the first and second administrations of the repeated scenarios
If you have such a study and would be willing to share it with us, could you please send it to the first author, Ms. Ze Zhu, at
zzhu5@masonlive.gmu.edu , by March 1?
Specifically, we would need the following information:
(1) We would need a full reference, in APA or AOM style, so that we can cite your work appropriately.
(2) We would need the correlation coefficient or other measure of relationship/association between the first and second administrations of the repeated scenarios.
(a) If the measure of relationship/association used is not a standard correlation coefficient (i.e., Pearson product-moment correlation), we would need to know what it is (e.g., Spearman rho, phi coefficient, ICC).
(b) We would need to know whether the correlation (or other measure of relationship/association) was calculated between or within persons.
(3) We would need the sample size (number of participants) for the study.
(4) We would appreciate as much additional information about the sample as you can provide: sample demographics, who the participants were (e.g., college students or full-time employees in a particular industry), whether the sample was a targeted sample or a convenience sample, and so forth.
(5) We would appreciate as much information about the policy-capturing design as you can provide: number of cues per scenario (profile), number of repeated scenarios, total number of scenarios, number of outcome variables (e.g., items) per scenario, the survey medium (e.g., online or paper-and-pencil), the scenario presentation format (e.g., text, tables, or graphs), whether or not cue values that changed across scenarios were somehow made salient to participants (e.g., by using bold text), whether the cue selection was orthogonal or not, whether the second iteration of the repeated scenarios was administered in the same session or a subsequent session, and so forth.
If you already have a writeup that contains this information, please feel free to simply send us the writeup.
If you are uncertain as to whether your work is relevant, we would prefer that you send it to us anyway.
We promise to use the information you provide only for our meta-analysis, and we promise not to share this information with anyone else.
One final note: Although we have previously collected published work on this topic, please do feel free to send us a copy of already-published work if you believe that this work would be difficult to locate through conventional keyword searches.
Your work would be very helpful to our meta-analysis. Thank you in advance for your help.
Best regards,
------------------------------
Reeshad Dalal, Ph.D.
Industrial and Organizational Psychology
George Mason University
Fairfax, VA 22030-4444
rdalal@gmu.edu------------------------------