Evaluating Community Leadership Development ...

3 downloads 0 Views 1MB Size Report
Janice Garfield, Ph.D. Kurt Schoch, Ed.D. Walden ... (Indiana). Leadership Northwest Indiana. (Leadership Bartholomew County –. Columbus, Indiana) ...
Evaluating Community Leadership Development Programs Janice Garfield, Ph.D. Kurt Schoch, Ed.D. Walden University Faculty

Introductions 

Presenters ◦ ◦ ◦ ◦



Janice Garfield, Ph.D. Kurt Schoch, Ed.D. Keith Kirkpatrick Juliann Jankowski

Participants

Project Overview Grant Funded Research  Walden University 

◦ www.waldenu.edu

Purpose  Methodology 

Evaluation Model 

Context



Input



Process



Product

Context 

Intent



Sample Questions ◦ Electronic ◦ Interview

Input 

Intent



Sample Questions ◦ Electronic ◦ Interview

Process 

Intent



Sample Questions ◦ Electronic ◦ Interview

Product 

Intent



Sample Questions ◦ Electronic ◦ Interview

Systems Framework

The Programs Leadership Lynchburg (Virginia)  Leadership South Bend/Mishawaka (Indiana)  Leadership Northwest Indiana 



(Leadership Bartholomew County – Columbus, Indiana)

Leadership Lynchburg Organizational Model  Years in Existence - Classes  Number of Participants  Community Size 

◦ Population ◦ Square Miles ◦ Distinct communities 

Curriculum Overview

Leadership South Bend/Mishawaka Organizational Model  Years in Existence - Classes  Number of Participants  Community Size 

◦ Population ◦ Square Miles ◦ Distinct communities 

Curriculum Overview

Leadership South Bend/Mishawaka

Leadership Northwest Indiana Organizational Model  Years in Existence - Classes  Number of Participants  Community Size 

◦ Population ◦ Square Miles ◦ Distinct communities 

Curriculum Overview

Alumni Survey 1. Leadership program 2.Year of program graduation 3. Gender 4. Age 5. Leadership Development Impacts/Outcomes 6. Collaboration and Networking Impacts/Outcomes 7. Regional Impacts and Outcomes

Alumni Survey 8. Level of connection to the program 9. – 12. – Open ended 13. Occupation 14. Title 15. Industry

Responses 

Per program ◦ Leadership Lynchburg: 137 ◦ Leadership South Bend/Mishawaka: 175 ◦ Leadership Northwest Indiana: 139



Gender ◦ Male: 218 ◦ Female: 220



Age ◦ ◦ ◦ ◦ ◦

20 – 29: 22 30 – 39: 95 40 – 49: 155 50 – 59: 126 60 and over: 47

Responses 

Class ◦ ◦ ◦ ◦ ◦



1970: 4 1980: 24 1990: 82 2000 – 2004: 77 2005 – 2009: 260

Education ◦ ◦ ◦ ◦ ◦

High School: 21 Bachelor’s: 199 Associate: 29 Master’s: 158 Doctorate: 36

Occupation  Industry 

Quantitative Analysis All Questions

4.000

3.500 3.15 3.000

2.982 2.982

3.02 3.04 2.869

2.76 2.81

2.873 2.85

2.78 2.56

2.500

2.24 2.19 2.22

2.36

2.74 2.71

2.52 2.57

2.35 2.40

2.30

2.26 2.21

2.000

1.500

1.000

0.500

0.000 5a

5B

5C

5D

5e

5f

5g

5h

5i

6a

6b

6c

6d

6e

6f

6g

6h

7a

7b

7c

7d

7e

7f

7g

7h

Quantitative Analysis 1–8

9 – 16

17 – 25

Leadership Development

#1-5c; #4-5a; #5-5b; (2) #7-5d

(3)

Collaboration and Networking

#2-6d; #3-6c

(3)

(3)

Regional Impacts

#6-7a; #8-7b

(2)

(4)

Quantitative Analysis 5. Leadership Development Leadership Lynchburg

Leadership Northwest Indiana

Leadership South Bend/Mishawaka

4.000

3.500 3.18

3.10 3.000

2.98

2.500

2.97

2.92

2.94

2.31

2.41

2.35

2.000

1.500

1.000

0.500

0.000 5a. 5b. Promoting Understanding of Leadership Leadership Style Development

5c. Recognize 5d. New 5e. Contributed 5f. Community 5g. Created 5h. Community 5i. Brought New Opportunities to Leadership Role to Increasing Leadership Opportunities for Development and Greater Improve Responsiveness Emerging Initiaties and Resources to Leadership of Management Leaders Opportunities Community Abilities Team

Quantitative Analysis 6. Collaboration and Networking Impacts & Outcomes Leadership Lynchburg

Leadership Northwest Indiana

Leadership South Bend/Mishawaka

4.00

3.50 3.15 3.00

3.12 2.86

2.85 2.66 2.58

2.50

2.47

2.47

2.00

1.50 6a. Creating Collaborations Across Diversity Boundaries

6b. Expanded and 6c. Better Equipped 6d. Able to Build 6e. Participates in 6f. Participates in Improved to Participate in Relationships building Building Community Professional Collaborative Across Professional Cooperation Coalitions and Networks Projects Disciplines Between Collaborations Organization Leaders

6g. Promotes sharing of Community Resources

6h. Remain Connected to Alumni

Quantitative Analysis 7. Regional Impacts Leadership Lynchburg

Leadership Northwest Indiana

Leadership South Bend/Mishawaka

4.000

3.500 3.14

3.04

3.05

3.01

3.000 2.64

2.53

2.500

2.35

2.37

7g. Increase Trust Among Members of Region

7h. Participates in Building Cooperation Across Community Boundaries

2.000

1.500

1.000

0.500

0.000 7a. Shared Mission & Vision for Region

7b. Educating Others about Region's Challenges & Needs

7c. Mindful of Regional Perspectives

7d. Broader Perspective on Issues Facing Region and World

7e. Participates 7f. Serves as an in Increasing Agent for Visibility Positive Social Change

Qualitative Analysis Regional impact  Networking  Awareness of community/regional resources  Alumni involvement (various across programs) 

Cross Analysis 

How do the quantitative and qualitative analyses relate: ◦ Similarities

◦ Differences  More leadership development focus in electronic survey than in interviews

Participant Activity 

Relationship of CIPP to your leadership development ◦ What questions would you ask at each stage?

References