NSSE 2016 Topical Module Report Development of IPEDS: 179566
2 NSSE 2016 TOPICAL MODULE REPORT This page intentionally left blank.
NSSE 2016 Development of Administration Summary About This Topical Module Adapted from a pilot survey that was developed by the American Association of State Colleges and Universities, this module examines activities that develop useful and transferable skills for the workplace (such as verbal and written fluency and analytic inquiry). The module complements questions on the core survey about higher-order learning, reflective and integrative learning, and students perceptions of their development in a variety of areas. Complementary FSSE set available. Comparison Group This section summarizes how this module's comparison group was identified, including selection criteria and whether the default option was taken. This is followed by the resulting list of institutions represented in the '' column of this report. Group label Date submitted 5/20/16 How was this comparison group constructed? Your institution retained the default comparison group (all module participants). Group description All other current- and prior-year NSSE institutions who administered module "Development of " (N=75) Agnes Scott College (Decatur, GA) Alberta College of Art + Design (Calgary, AB) Albertus Magnus College (New Haven, CT) Averett University (Danville, VA) Baker University (Baldwin City, KS) Bellevue University (Bellevue, NE)* Boise State University (Boise, ID)* Boston University (Boston, MA) Brigham Young University-Hawaii (Laie, HI) Caldwell University (Caldwell, NJ)* California State University-Channel Islands (Camarillo, CA) California State University, San Bernardino (San Bernardino, CA)* Campbell University Inc. (Buies Creek, NC)* Carthage College (Kenosha, WI)* Case Western Reserve University (Cleveland, OH)* Catawba College (Salisbury, NC) Chaminade University of Honolulu (Honolulu, HI) Clemson University (Clemson, SC) Colorado Mesa University (Grand Junction, CO) Concordia College at Moorhead (Moorhead, MN)* Culinary Institute of America (Hyde Park, NY)* DeSales University (Center Valley, PA)* Emporia State University (Emporia, KS) Felician College (Lodi, NJ)* Ferrum College (Ferrum, VA)* Franklin College (Franklin, IN)* Greensboro College (Greensboro, NC) Indiana University Southeast (New Albany, IN)* Indiana University-Purdue University Indianapolis (Indianapolis, IN)* Jacksonville University (Jacksonville, FL) Kaplan University (Davenport, IA)* Lancaster Bible College (Lancaster, PA)* Lane College (Jackson, TN) Lee University (Cleveland, TN)* Lees-McRae College (Banner Elk, NC) Lincoln Memorial University (Harrogate, TN) Louisiana State University and Agricultural & Mechanical College (Baton Rouge, LA)* McDaniel College (Westminster, MD)* Mercy College (Dobbs Ferry, NY) Metropolitan State University (Saint Paul, MN)* Mississippi University for Women (Columbus, MS) Mount St. Mary's University (Emmitsburg, MD) Murray State University (Murray, KY) New Jersey City University (Jersey City, NJ)* Northwest University (Kirkland, WA) Philadelphia University (Philadelphia, PA)* Quest University Canada (Squamish, BC) Reinhardt University (Waleska, GA) Rosemont College (Rosemont, PA) Saint Francis Medical Center College of Nursing (Peoria, IL) Savannah College of Art and Design (Savannah, GA)* Sheridan College Institute of Technology and Advanced Learning (Oakville, ON) St. Gregory's University (Shawnee, OK) Tennessee Technological University (Cookeville, TN) Tennessee Wesleyan College (Athens, TN) Trent University (Peterborough, ON) Trevecca Nazarene University (Nashville, TN) Union College (Barbourville, KY)* University of Arkansas at Little Rock (Little Rock, AR) University of Central Oklahoma (Edmond, OK)* *2015 participant NSSE 2016 TOPICAL MODULE REPORT 3
(N=75), continued University of Denver (Denver, CO) University of Louisiana Monroe (Monroe, LA) University of Mississippi (University, MS) University of Montana-Western, The (Dillon, MT)* University of Nebraska at Kearney (Kearney, NE) University of North Carolina at Charlotte (Charlotte, NC) University of North Carolina Wilmington (Wilmington, NC)* University of Pikeville (Pikeville, KY) University of Puerto Rico-Carolina (Carolina, PR) University of Scranton (Scranton, PA)* University of the Cumberlands (Williamsburg, KY) Utica College (Utica, NY)* Vancouver Island University (Nanaimo, BC) Western State Colorado University (Gunnison, CO) Young Harris College (Young Harris, GA) *2015 participant 4 NSSE 2016 TOPICAL MODULE REPORT
First-Year Students NSSE 2016 Development of Frequencies and Statistical Comparisons Frequency Distributions a Transferable Skills Item wording or description name Values c Response options Count % Count % Mean 1. During the current school year, whether course related or not, about how often have you done the following? a. Discussed or debated an issue of TRN01a 1 Never 61 8 1,846 13 social, political, or philosophical 2 Sometimes 259 37 5,017 36 importance 3 Often 231 34 4,340 30 2.7 2.6 **.11 4 Very often 148 21 2,935 20 Total 699 100 14,138 100 b. Made a speech to a group TRN01b 1 Never 82 12 3,604 26 2 Sometimes 285 41 5,598 39 3 Often 224 32 3,246 23 2.5 2.2 ***.31 4 Very often 104 14 1,649 12 Total 695 100 14,097 100 c. Worked in a group with people TRN01c 1 Never 29 4 1,048 8 who differed from you in terms of 2 Sometimes 271 40 4,747 34 background, political orientation, points of view, etc. 3 Often 268 38 5,222 37 2.7 2.7 -.01 4 Very often 131 18 3,096 21 Total 699 100 14,113 100 d. Discussed the ethical consequences TRN01d 1 Never 64 9 2,097 15 of a course of action 2 Sometimes 294 42 5,481 39 3 Often 252 36 4,464 32 2.5 2.5 *.07 4 Very often 89 12 2,044 14 Total 699 100 14,086 100 e. Creatively thought about new ideas TRN01e 1 Never 36 5 792 6 or about ways to improve things 2 Sometimes 234 34 4,369 31 3 Often 298 43 5,536 39 2.7 2.8 * -.08 4 Very often 127 18 3,368 24 Total 695 100 14,065 100 f. Critically evaluated multiple TRN01f 1 Never 36 5 867 6 solutions to a problem 2 Sometimes 278 40 4,623 33 3 Often 268 38 5,513 39 2.7 2.8 ** -.12 4 Very often 118 17 3,054 22 Total 700 100 14,057 100 g. Discussed complex problems with TRN01g 1 Never 54 8 1,183 9 others to develop a better solution 2 Sometimes 292 42 4,934 35 Statistical Comparisons b 3 Often 247 37 5,078 36 2.6 2.7 ** -.12 4 Very often 100 14 2,829 21 Total 693 100 14,024 100 Mean size d *p<.05, **p<.01, ***p<.001 (2-tailed); Refer to the endnotes page for the key to triangle symbols. NSSE 2016 TOPICAL MODULE REPORT 5
First-Year Students NSSE 2016 Development of Frequencies and Statistical Comparisons Frequency Distributions a Transferable Skills Item wording or description name Values c Response options Count % Count % Mean Statistical Comparisons b 2. During the current school year, whether course related or not, about how often have you written something (paper, report, article, blog, etc.) that: a. Used information from a variety of TRN02a 1 Never 19 3 419 3 sources (books, journals, Internet, 2 Sometimes 149 22 3,168 23 databases, etc.) 3 Often 297 43 5,229 37 3.0 3.1 -.05 4 Very often 233 32 5,310 37 Total 698 100 14,126 100 b. Assessed the conclusions of a TRN02b 1 Never 85 12 1,737 13 published work 2 Sometimes 276 40 4,742 34 3 Often 244 36 4,637 32 2.5 2.6 *** -.12 4 Very often 94 13 2,975 21 Total 699 100 14,091 100 c. Included ideas from more than one TRN02c 1 Never 64 9 1,379 11 academic discipline 2 Sometimes 241 34 4,618 33 3 Often 275 41 4,890 34 2.6 2.7 -.05 4 Very often 119 16 3,188 22 Total 699 100 14,075 100 d. Presented multiple viewpoints or TRN02d 1 Never 45 6 995 8 perspectives 2 Sometimes 258 37 4,652 33 3 Often 281 41 5,156 36 2.7 2.7 * -.08 4 Very often 113 16 3,259 23 Total 697 100 14,062 100 Mean size d *p<.05, **p<.01, ***p<.001 (2-tailed); Refer to the endnotes page for the key to triangle symbols. 6 NSSE 2016 TOPICAL MODULE REPORT
Seniors NSSE 2016 Development of Frequencies and Statistical Comparisons Frequency Distributions a Transferable Skills Item wording or description name Values c Response options Count % Count % Mean 1. During the current school year, whether course related or not, about how often have you done the following? a. Discussed or debated an issue of TRN01a 1 Never 77 14 2,214 13 social, political, or philosophical 2 Sometimes 186 33 6,158 34 importance 3 Often 162 28 5,309 29 2.6 2.7 -.01 4 Very often 135 25 4,585 25 Total 560 100 18,266 100 b. Made a speech to a group TRN01b 1 Never 86 16 3,339 20 2 Sometimes 258 45 6,624 36 3 Often 134 23 4,907 26 2.4 2.4 -.05 4 Very often 82 15 3,325 18 Total 560 100 18,195 100 c. Worked in a group with people TRN01c 1 Never 22 4 1,124 7 who differed from you in terms of 2 Sometimes 178 31 5,155 28 background, political orientation, points of view, etc. 3 Often 223 40 6,590 36 2.9 2.9 -.03 4 Very often 138 25 5,369 29 Total 561 100 18,238 100 d. Discussed the ethical consequences TRN01d 1 Never 50 9 1,942 11 of a course of action 2 Sometimes 216 39 6,167 34 3 Often 193 34 6,123 33 2.6 2.7 -.04 4 Very often 102 18 3,979 22 Total 561 100 18,211 100 e. Creatively thought about new ideas TRN01e 1 Never 14 3 701 4 or about ways to improve things 2 Sometimes 156 29 4,175 23 3 Often 211 36 7,001 38 3.0 3.0 -.07 4 Very often 180 32 6,325 35 Total 561 100 18,202 100 f. Critically evaluated multiple TRN01f 1 Never 22 4 710 4 solutions to a problem 2 Sometimes 148 25 4,243 23 3 Often 219 40 7,083 38 3.0 3.0 -.06 4 Very often 173 31 6,173 34 Total 562 100 18,209 100 g. Discussed complex problems with TRN01g 1 Never 32 6 961 6 others to develop a better solution 2 Sometimes 160 29 4,671 26 Statistical Comparisons b 3 Often 228 39 6,779 37 2.8 2.9 ** -.11 4 Very often 140 25 5,683 32 Total 560 100 18,094 100 Mean size d *p<.05, **p<.01, ***p<.001 (2-tailed); Refer to the endnotes page for the key to triangle symbols. NSSE 2016 TOPICAL MODULE REPORT 7
Seniors NSSE 2016 Development of Frequencies and Statistical Comparisons Frequency Distributions a Transferable Skills Item wording or description name Values c Response options Count % Count % Mean a. Used information from a variety of TRN02a 1 Never 30 5 638 4 sources (books, journals, Internet, 2 Sometimes 113 22 3,245 18 databases, etc.) Statistical Comparisons b 2. During the current school year, whether course related or not, about how often have you written something (paper, report, article, blog, etc.) that: 3 Often 184 32 5,477 29 3.1 3.2 *** -.17 4 Very often 233 41 8,926 49 Total 560 100 18,286 100 b. Assessed the conclusions of a TRN02b 1 Never 71 13 2,040 12 published work 2 Sometimes 191 34 5,065 28 3 Often 158 28 5,421 29 2.6 2.8 *** -.15 4 Very often 141 25 5,713 31 Total 561 100 18,239 100 c. Included ideas from more than one TRN02c 1 Never 56 10 1,453 8 academic discipline 2 Sometimes 188 34 5,096 28 3 Often 175 31 5,723 31 2.7 2.9 *** -.17 4 Very often 139 25 5,969 33 Total 558 100 18,241 100 d. Presented multiple viewpoints or TRN02d 1 Never 69 12 1,305 7 perspectives 2 Sometimes 186 34 5,275 29 3 Often 190 33 6,075 33 2.6 2.9 *** -.25 4 Very often 116 21 5,565 31 Total 561 100 18,220 100 Mean size d *p<.05, **p<.01, ***p<.001 (2-tailed); Refer to the endnotes page for the key to triangle symbols. 8 NSSE 2016 TOPICAL MODULE REPORT
NSSE 2016 Development of Detailed Statistics e First-Year Students N Mean Standard error f deviation g DF h Sig. i size d Standard Comparisons with: name TRN01a 701 2.68 2.57.03.01 0.90 0.96 766.003.11 TRN01b 696 2.49 2.20.03.01 0.88 0.96 18,002.000.31 TRN01c 701 2.70 2.71.03.01 0.81 0.89 770.679 -.01 TRN01d 700 2.52 2.45.03.01 0.82 0.91 771.035.07 TRN01e 696 2.74 2.81.03.01 0.81 0.87 761.020 -.08 TRN01f 702 2.67 2.77.03.01 0.81 0.87 17,980.002 -.12 TRN01g 696 2.57 2.68.03.01 0.83 0.90 763.001 -.12 TRN02a 700 3.03 3.07.03.01 0.81 0.85 762.195 -.05 TRN02b 701 2.49 2.60.03.01 0.87 0.96 771.001 -.12 TRN02c 701 2.63 2.68.03.01 0.86 0.94 770.142 -.05 TRN02d 700 2.67 2.74.03.01 0.81 0.90 770.019 -.08 See the endnotes on the last page of this report. NSSE 2016 TOPICAL MODULE REPORT 9
NSSE 2016 Development of Detailed Statistics e Seniors N Mean Standard error f deviation g DF h Sig. i size d Standard Comparisons with: name TRN01a 560 2.65 2.66.04.01 1.00 0.99 13,688.811 -.01 TRN01b 561 2.37 2.42.04.01 0.93 1.00 617.223 -.05 TRN01c 560 2.86 2.88.04.01 0.84 0.91 617.487 -.03 TRN01d 560 2.62 2.66.04.01 0.88 0.94 614.367 -.04 TRN01e 561 2.97 3.03.04.01 0.85 0.86 13,641.096 -.07 TRN01f 562 2.98 3.03.04.01 0.86 0.86 13,641.166 -.06 TRN01g 560 2.84 2.94.04.01 0.88 0.90 13,562.008 -.11 TRN02a 560 3.09 3.23.04.01 0.92 0.87 13,702.000 -.17 TRN02b 561 2.64 2.80.04.01 1.00 1.01 13,667.000 -.15 TRN02c 558 2.71 2.88.04.01 0.96 0.96 13,666.000 -.17 TRN02d 561 2.62 2.86.04.01 0.95 0.94 13,650.000 -.25 See the endnotes on the last page of this report. 10 NSSE 2016 TOPICAL MODULE REPORT
NSSE 2016 Development of Endnotes Endnotes a. b. c. d. e. Column percentages are weighted by institution-reported sex and enrollment status (and institution size for comparison groups). Percentages may not sum to 100 due to rounding. Counts are unweighted; column percentages cannot be replicated from counts. All statistics are weighted by institution-reported sex and enrollment status (and institution size for comparison groups). Unless otherwise noted, statistical comparisons are two-tailed independent t -tests. Items with categorical response sets are left blank. These are the values used to calculate means. For the majority of items, these values match the codes in the data file and codebook. size for independent t- tests uses Cohen's d ; z- tests use Cohen's h. Statistics are weighted by institution-reported sex and enrollment status (and institution size for comparison groups). Categorical items are not listed. f. The 95% confidence interval for the population mean is equal to the sample mean plus or minus 1.96 times the standard error of the mean. g. A measure of the amount individual scores deviate from the mean of all the scores in the distribution. h. Degrees of freedom used to compute the t -tests. Values differ from Ns due to weighting and whether equal variances were assumed. i. j. k. l. Statistical comparisons are two-tailed independent t -tests or z -tests. Statistical significance represents the probability that the difference between your students' mean and that of the students in the comparison group is due to chance. Statistical comparison uses z- test to compare the proportion who responded (depending on the item) "Done or in progress" or "Yes" with all who responded otherwise. Mean represents the proportion who responded (depending on the item) Done or in progress or "Yes." This was a new item in 2016, comparison group results do not include 2015 institutions. May not apply to all modules. Key to symbols: Your students average was significantly higher (p <.05) with an effect size at least.3 in magnitude. Your students average was significantly higher (p <.05) with an effect size less than.3 in magnitude. Your students average was significantly lower (p <.05) with an effect size less than.3 in magnitude. Your students average was significantly lower (p <.05) with an effect size at least.3 in magnitude. Note: It is important to interpret the direction of differences relative to item wording and your institutional context. NSSE 2016 TOPICAL MODULE REPORT 11