Discussion: View Thread

  • 1.  Measuring the effectiveness of teaching diversity in higher education

    Posted 08-21-2008 10:28
    Greetings:
     
    Is anyone aware of a measure for assessing the effectiveness of diversity education?
     
    Vicki Taylor, Ph.D.
    Associate Professor and SHRM Chapter Advisor
    John L. Grove College of Business
    Shippensburg University
    Shippensburg, PA 17257
    Phone: 717-477-1217
    Best Regards,
     


  • 2.  Measuring the effectiveness of teaching diversity in higher education

    Posted 08-21-2008 10:50
    Vicki,

    That's a good question - and one I'm thinking about as I finalize my plans for the fall semester.

    The appropriate measure, of course, depends on how one defines "effectiveness" and that depends on ones desired goals. Do you want your students to obtain new knowledge? Do you want them to change their attitudes toward diversity or toward specific demographic groups? Do you want them to acquire multicultural competency skills? Do you want them to change their behaviors? And for each of the foregoing questions, which specific knowledge/attitudes/skills/behaviors do you want them to change? Goals come first, which is the reason the first session at the 2008 conference on diversity education (som.gmu.edu/diversity) was a facilitated discussion on goals. [Next year's conference will be July 16-18.]

    Some questions are given at the end of Harvey & Allard (2009). Understanding and managing diversity (4th edition). I don't know about the earlier editions.

    I'd love to see more good research on this question, but that's a challenge, given the need for appropriate comparison groups, IRB approval, etc.

    Many thanks for raising this issue. I'll be interested in seeing the other responses.

    Cheers,
    David

    Taylor, Vicki wrote:
    1D2EEFC98DC1CB4680E48C67D72AB99D183DEA898A@shipmailmb01.ship.lcl" type="cite">
    Greetings:
     
    Is anyone aware of a measure for assessing the effectiveness of diversity education?
     
    Vicki Taylor, Ph.D.
    Associate Professor and SHRM Chapter Advisor
    John L. Grove College of Business
    Shippensburg University
    Shippensburg, PA 17257
    Phone: 717-477-1217
    Best Regards,
     

    --  David A. Kravitz  Professor and Management Area Chair School of Management 219 Enterprise Hall, MSN 5F5 George Mason University 4400 University Drive Fairfax, VA  22030-4444  703-993-1781 (Voice) 703-993-1870 (fax) dkravitz@gmu.edu http://mason.gmu.edu/~dkravitz/


  • 3.  Measuring the effectiveness of teaching diversity in higher education

    Posted 08-21-2008 12:02

    Hi all: In response to Vicki's question regarding a measure for assessing the effectiveness of diversity education and David's thorough response ...

     

    It would be helpful for me to know how the measure will be used.  For example, will the measure be used in conducting research targeted at a specific journal or will it be used to convince your dept chairs, deans, etc (even yourself) of the effectiveness of the course – such as making an argument that courses on diversity should be mandatory for management majors (which I believe they should!).

     

    Regarding a "measure" of effectiveness that can be used for the latter purpose (i.e. convincing chairs, deans, etc of the necessity for diversity courses), I believe that qualitative measures are best.  For example, I use the written comments from my end of course teaching evaluations for this purpose. Here is an example of a student comment that indicates to me that the course was effective: "The course truly illustrated how diversity affects us in and outside of the organization. I have used the course material on the job and have achieved success in situations. I was able to improve my working relationship with a subordinate by applying some of the tools I learned in this class."

     

    Essentially, I am suggesting that the effectiveness of the class may be different for each student depending on their expectations and goals (rather than, or perhaps in addition to our expectations and goals for them) as well as their current work situation.  The student I quoted above was motivated to apply the course content to his work situation and did so successfully.  However, another student commented that "I didn't learn any skills on how to effectively manager (sic) people with a diverse background or how to deal with issues around diversity as a manager."

     

    Another good source for qualitative comments for me has been student journals.  I have them write about a situation at work or from their personal lives and how the material from class has helped them view situations differently, improve relationships, or manage more effectively.

     

    I hope you read thoughts from others on this list regarding this interesting and important topic.

     

    Take care, <st1:city w:st="on"><st1:place w:st="on">Lynn</st1:place></st1:city>

     

    Lynn Bowes-Sperry, Ph.D.

    Associate Professor of Management

    <st1:place w:st="on"><st1:placename w:st="on">Western</st1:placename> <st1:placename w:st="on">New England</st1:placename> <st1:placetype w:st="on">College</st1:placetype></st1:place>

    <st1:place w:st="on"><st1:city w:st="on">Springfield</st1:city> <st1:state w:st="on">MA</st1:state> <st1:postalcode w:st="on">01119</st1:postalcode></st1:place>

     

    Past Chair, Gender & Diversity in Organizations

    <st1:place w:st="on"><st1:placetype w:st="on">Academy</st1:placetype> of <st1:placename w:st="on">Management</st1:placename></st1:place>

     

    email -  lbowessp@wnec.edu

    phone - (860) 444-9239

    fax -      (860) 444-9239

     


    From: Gender & Diversity in Organizations Division Listserv [mailto:GDO-L@AOMLISTS.PACE.EDU] On Behalf Of David Kravitz
    Sent: Thursday, August 21, 2008 10:50 AM
    To: GDO-L@AOMLISTS.PACE.EDU
    Subject: Re: Measuring the effectiveness of teaching diversity in higher education

     

    Vicki,

    That's a good question - and one I'm thinking about as I finalize my plans for the fall semester.

    The appropriate measure, of course, depends on how one defines "effectiveness" and that depends on ones desired goals. Do you want your students to obtain new knowledge? Do you want them to change their attitudes toward diversity or toward specific demographic groups? Do you want them to acquire multicultural competency skills? Do you want them to change their behaviors? And for each of the foregoing questions, which specific knowledge/attitudes/skills/behaviors do you want them to change? Goals come first, which is the reason the first session at the 2008 conference on diversity education (som.gmu.edu/diversity) was a facilitated discussion on goals. [Next year's conference will be July 16-18.]

    Some questions are given at the end of Harvey & Allard (2009). Understanding and managing diversity (4th edition). I don't know about the earlier editions.

    I'd love to see more good research on this question, but that's a challenge, given the need for appropriate comparison groups, IRB approval, etc.

    Many thanks for raising this issue. I'll be interested in seeing the other responses.

    Cheers,
    David

    <st1:city w:st="on"><st1:place w:st="on">Taylor</st1:place></st1:city>, Vicki wrote:

    Greetings:

     

    Is anyone aware of a measure for assessing the effectiveness of diversity education?

     

    Vicki Taylor, Ph.D.

    Associate Professor and SHRM Chapter Advisor

    <st1:place w:st="on"><st1:placename w:st="on">John</st1:placename> <st1:placename w:st="on">L.</st1:placename> <st1:placetype w:st="on">Grove</st1:placetype> <st1:placetype w:st="on">College</st1:placetype></st1:place> of Business

    <st1:place w:st="on"><st1:placename w:st="on">Shippensburg</st1:placename> <st1:placetype w:st="on">University</st1:placetype></st1:place>

    <st1:place w:st="on"><st1:city w:st="on">Shippensburg</st1:city>, <st1:state w:st="on">PA</st1:state> <st1:postalcode w:st="on">17257</st1:postalcode></st1:place>

    Phone: 717-477-1217

    Best Regards,

     



    -- 
    David A. Kravitz
     
    Professor and Management Area Chair
    <st1:place w:st="on"><st1:placetype w:st="on">School</st1:placetype> of <st1:placename w:st="on">Management</st1:placename></st1:place>
    219 <st1:city w:st="on"><st1:place w:st="on">Enterprise</st1:place></st1:city> Hall, MSN 5F5
    <st1:place w:st="on"><st1:placename w:st="on">George</st1:placename> <st1:placename w:st="on">Mason</st1:placename> <st1:placename w:st="on">University</st1:placename></st1:place>
    <st1:street w:st="on"><st1:address w:st="on">4400 University Drive</st1:address></st1:street>
    <st1:place w:st="on"><st1:city w:st="on">Fairfax</st1:city>, <st1:state w:st="on">VA</st1:state>  <st1:postalcode w:st="on">22030-4444</st1:postalcode></st1:place>
     
    703-993-1781 (Voice)
    703-993-1870 (fax)
    dkravitz@gmu.edu
    http://mason.gmu.edu/~dkravitz/


  • 4.  Measuring the effectiveness of teaching diversity in higher education

    Posted 08-21-2008 15:02
    Thank you David and Lynn for your thoughtful comments.  In regard to how the measure will be used...
     
    My research interest is in exploring the "effectiveness" of the diversity curriculum in colleges of business.  Initially exploring the effectiveness of a "diversity courses" and eventually comparing the "results" of diversity courses vs. course-embedded diversity objectives over time.  (I too am predisposed to a diversity course as you are Lynn.)  My college of business addresses diversity as an "imbedded" topic.  Over the course of 4 years, students are suppose to develop an "appreciation" for diversity and be able to "function effectively" in a diverse and global environment - with such broad goals it's difficult to assess learning or measure "effectiveness".  However, that being said, the qualitative comments you've collected, Lynn, would be supportive.
     
    I have the opportunity to teach a diversity course and I would like to use it as the basis for a program of research on the topic of diversity education in colleges of business.  I was hoping that there were some established measures that I could use (knowledge, behavioral, and/or affectively based)-  thinking that to be better than developing my own measures.
     
    Thoughts?
     
    Vicki Taylor, Ph.D.
    Associate Professor and SHRM Chapter Advisor
    John L. Grove College of Business
    Shippensburg University
    Shippensburg, PA 17257
    Phone: 717-477-1217

     


  • 5.  Measuring the effectiveness of teaching diversity in higher education

    Posted 08-23-2008 19:19

    Vicki and all,

    As David Kravitz mentioned, being able to measure effectiveness requires knowing the criteria, which in turn depend on one's goals. The slides I used to guide the facilitated discussion that we had at the GMU conference in July to which David referred are available here: http://somweb.gmu.edu/diveduc08/files/Ferdman%20Facilitated%20Discussion%202008%20TTWD.pdf. Included in the slides is my summary of the themes that came up when I posted the following question on LinkedIn: What do you believe are and/or should be the key goals of diversity training (e.g., in organizational settings) and of diversity education (e.g., in university courses)? You can also see the detailed answers provided by 28 folks here: http://www.linkedin.com/answers/management/organizational-development/MGM_ODV/265828-122187. We are also working on transcribing the detailed results of the facilitated discussion at GMU, and will post those when ready.

    Regards,

    Bernardo Ferdman

     


    Bernardo M. Ferdman, Ph.D. <bferdman@alliant.edu>

    Professor, Marshall Goldsmith School of Management

    Alliant International University (http://www.alliant.edu)

    10455 Pomerado Rd., San Diego, CA 92131-1799, USA

    Tel. +1 858 635-4408; Fax +1 858 635-4455

    Webpages: <http://bernardoferdman.org>, <http://faculty.alliant.edu> (click on "Bernardo Ferdman")


     

     

    From: Gender & Diversity in Organizations Division Listserv [mailto:GDO-L@AOMLISTS.PACE.EDU] On Behalf Of Lynn Bowes-Sperry
    Sent: Thursday, August 21, 2008 9:02 AM
    To: GDO-L@AOMLISTS.PACE.EDU
    Subject: Re: Measuring the effectiveness of teaching diversity in higher education

     

    Hi all: In response to Vicki's question regarding a measure for assessing the effectiveness of diversity education and David's thorough response ...

     

    It would be helpful for me to know how the measure will be used.  For example, will the measure be used in conducting research targeted at a specific journal or will it be used to convince your dept chairs, deans, etc (even yourself) of the effectiveness of the course – such as making an argument that courses on diversity should be mandatory for management majors (which I believe they should!).

     

    Regarding a "measure" of effectiveness that can be used for the latter purpose (i.e. convincing chairs, deans, etc of the necessity for diversity courses), I believe that qualitative measures are best.  For example, I use the written comments from my end of course teaching evaluations for this purpose. Here is an example of a student comment that indicates to me that the course was effective: "The course truly illustrated how diversity affects us in and outside of the organization. I have used the course material on the job and have achieved success in situations. I was able to improve my working relationship with a subordinate by applying some of the tools I learned in this class."

     

    Essentially, I am suggesting that the effectiveness of the class may be different for each student depending on their expectations and goals (rather than, or perhaps in addition to our expectations and goals for them) as well as their current work situation.  The student I quoted above was motivated to apply the course content to his work situation and did so successfully.  However, another student commented that "I didn't learn any skills on how to effectively manager (sic) people with a diverse background or how to deal with issues around diversity as a manager."

     

    Another good source for qualitative comments for me has been student journals.  I have them write about a situation at work or from their personal lives and how the material from class has helped them view situations differently, improve relationships, or manage more effectively.

     

    I hope you read thoughts from others on this list regarding this interesting and important topic.

     

    Take care, Lynn

     

    Lynn Bowes-Sperry, Ph.D.

    Associate Professor of Management

    Western New England College

    Springfield MA 01119

     


    From: Gender & Diversity in Organizations Division Listserv [mailto:GDO-L@AOMLISTS.PACE.EDU] On Behalf Of David Kravitz
    Sent: Thursday, August 21, 2008 10:50 AM
    To: GDO-L@AOMLISTS.PACE.EDU
    Subject: Re: Measuring the effectiveness of teaching diversity in higher education

     

    Vicki,

    That's a good question - and one I'm thinking about as I finalize my plans for the fall semester.

    The appropriate measure, of course, depends on how one defines "effectiveness" and that depends on ones desired goals. Do you want your students to obtain new knowledge? Do you want them to change their attitudes toward diversity or toward specific demographic groups? Do you want them to acquire multicultural competency skills? Do you want them to change their behaviors? And for each of the foregoing questions, which specific knowledge/attitudes/skills/behaviors do you want them to change? Goals come first, which is the reason the first session at the 2008 conference on diversity education (som.gmu.edu/diversity) was a facilitated discussion on goals. [Next year's conference will be July 16-18.]

    Some questions are given at the end of Harvey & Allard (2009). Understanding and managing diversity (4th edition). I don't know about the earlier editions.

    I'd love to see more good research on this question, but that's a challenge, given the need for appropriate comparison groups, IRB approval, etc.

    Many thanks for raising this issue. I'll be interested in seeing the other responses.

    Cheers,
    David

    Taylor, Vicki wrote:

    Greetings:

     

    Is anyone aware of a measure for assessing the effectiveness of diversity education?

     

    Vicki Taylor, Ph.D.

    Associate Professor and SHRM Chapter Advisor

    John L. Grove College of Business

    Shippensburg University

    Shippensburg, PA 17257

    Phone: 717-477-1217

    Best Regards,

     

     


  • 6.  Measuring the effectiveness of teaching diversity in higher education

    Posted 08-23-2008 19:20

    Vicki,

    Re measures, a great place to start would be the chapter by Donna Chrobot-Mason, Alison Konrad, and Frank Linnehan, "Measures for Quantitative Diversity Scholarship" in the book, Handbook of Workplace Diversity, edited by Konrad, Prasad, and Pringle (Sage, 2006). Also, look at measures such as the Intercultural Development Inventory  (http://idiinventory.com)  (see http://idiinventory.com/pdf/idi_bibliography.pdf for a bibliography).

    -Bernardo

     


    Bernardo M. Ferdman, Ph.D. <bferdman@alliant.edu>

    Professor, Marshall Goldsmith School of Management

    Alliant International University (http://www.alliant.edu)

    10455 Pomerado Rd., San Diego, CA 92131-1799, USA

    Tel. +1 858 635-4408; Fax +1 858 635-4455

    Webpages: <http://bernardoferdman.org>, <http://faculty.alliant.edu> (click on "Bernardo Ferdman")


     

     

     

    From: Gender & Diversity in Organizations Division Listserv [mailto:GDO-L@AOMLISTS.PACE.EDU] On Behalf Of Taylor, Vicki
    Sent: Thursday, August 21, 2008 12:02 PM
    To: GDO-L@AOMLISTS.PACE.EDU
    Subject: Re: Measuring the effectiveness of teaching diversity in higher education

     

    Thank you David and Lynn for your thoughtful comments.  In regard to how the measure will be used...

     

    My research interest is in exploring the "effectiveness" of the diversity curriculum in colleges of business.  Initially exploring the effectiveness of a "diversity courses" and eventually comparing the "results" of diversity courses vs. course-embedded diversity objectives over time.  (I too am predisposed to a diversity course as you are Lynn.)  My college of business addresses diversity as an "imbedded" topic.  Over the course of 4 years, students are suppose to develop an "appreciation" for diversity and be able to "function effectively" in a diverse and global environment - with such broad goals it's difficult to assess learning or measure "effectiveness".  However, that being said, the qualitative comments you've collected, Lynn, would be supportive.

     

    I have the opportunity to teach a diversity course and I would like to use it as the basis for a program of research on the topic of diversity education in colleges of business.  I was hoping that there were some established measures that I could use (knowledge, behavioral, and/or affectively based)-  thinking that to be better than developing my own measures.

     

    Thoughts?

     

    Vicki Taylor, Ph.D.

    Associate Professor and SHRM Chapter Advisor

    John L. Grove College of Business

    Shippensburg University

    Shippensburg, PA 17257

    Phone: 717-477-1217