<?xml version="1.0" encoding="utf-8"?>
<article xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="JATS-journalpublishing1-mathml3.xsd" dtd-version="1.2" article-type="Research">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">tia</journal-id>
<journal-title-group>
<journal-title>To Improve the Academy (TIA)</journal-title>
</journal-title-group>
<issn pub-type="epub"></issn>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">3447</article-id>
<article-id pub-id-type="manuscript">3447_final-submission-manuscript_cleanedup.docx,3447_tia_author_information_cleanedup.docx</article-id>
<article-id pub-id-type="doi">10.3998/tia.3447</article-id>
<title-group>
<article-title>A thematic analysis of interviews reveals how a STEM faculty development program supported the complexity of implementing evidence-based teaching</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">0000-0003-3558-7502</contrib-id>
<name>
<surname>Jackson</surname>
<given-names>Mallory A.</given-names>
</name>
<email>malloryjackson12@gmail.com</email>
<aff><institution>University of Washington, Seattle</institution></aff>
<xref rid="bio1" ref-type="bio"/>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">0000-0003-1036-5460</contrib-id>
<name>
<surname>Wenderoth</surname>
<given-names>Mary Pat</given-names>
</name>
<email>mpw@uw.edu</email>
<aff><institution>University of Washington, Seattle</institution></aff>
<xref rid="bio2" ref-type="bio"/>
</contrib>
</contrib-group>
<pub-date><day>12</day><month>5</month><year>2024</year></pub-date>
<volume>43</volume><issue>1</issue>
<issue-title>Spring</issue-title>
<history>
<date date-type="received"><day></day><month></month><year></year></date>
<date date-type="rev-recd"><day>18</day><month>7</month><year></year></date>
<date date-type="accepted"><day>7</day><month>18</month><year>2023</year></date>
</history>
<permissions>
<license><license-p>CC BY-NC-ND 4.0</license-p></license>
</permissions>
<abstract id="ABS1">
<p id="P1">We sought to identify which aspects of our professional development program, the Consortium for the Advancement of Undergraduate STEM Education (CAUSE), were most useful for the participants. CAUSE was designed to support STEM faculty as they implement evidence-based teaching practices. We interviewed six faculty participants (Fellows) to address two questions: (1) Which aspects of CAUSE were useful for participants? and (2) What factors influenced implementation of evidence-based teaching? We conducted a qualitative thematic analysis of the interviews by iteratively coding the transcripts and organizing final codes into themes. We found five themes. Two themes addressed the social and educational value CAUSE offered. Fellows valued curated references with empirical evidence of the impact of teaching practices on student learning and valued the strong social support from interacting with a consistent cohort of faculty over time. Three themes identified factors that influenced faculty to implement evidence-based teaching. Fellows explained that class context and their teaching experience or motivation influenced how they implemented teaching practices. A final theme showed Fellows&#x2019; strong concern and respect for students as partners in the learning process during their journey of change. Our qualitative analysis of faculty interviews found that change is a complex process that is as varied as the individuals engaging in change.</p>
</abstract>
<kwd-group>
<kwd>STEM faculty development</kwd>
<kwd>evidence-based teaching</kwd>
<kwd>faculty interviews</kwd>
<kwd>thematic analysis</kwd>
</kwd-group>
<funding-group/>
<counts>
<fig-count count="1"/>
<table-count count="0"/>
</counts>
<custom-meta-group>
<custom-meta id="competing-interest">
<meta-name></meta-name>
<meta-value></meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
</front>
<body>
<p>Undergraduate students in STEM who are actively engaged in the learning process in the classroom have improved academic performance as compared with students who sit passively through a lecture (<xref ref-type="bibr" rid="R28">Freeman et al., 2014</xref>; <xref ref-type="bibr" rid="R51">Prince, 2004</xref>; <xref ref-type="bibr" rid="R52">Ruiz-Primo et al., 2011</xref>; <xref ref-type="bibr" rid="R58">Theobald et al., 2020</xref>). In response, there continue to be a series of high-profile calls for faculty to transform their courses by replacing lecture with innovative and evidence-based teaching practices (<xref ref-type="bibr" rid="R1">Alberts, 2022</xref>; <xref ref-type="bibr" rid="R2">American Association for the Advancement of Science, 2011</xref>; <xref ref-type="bibr" rid="R3">Anderson et al., 2011</xref>; <xref ref-type="bibr" rid="R19">M. M. Cooper et al., 2015</xref>; <xref ref-type="bibr" rid="R31">Harvey et al., 2016</xref>). However, few faculty have been trained as to what these teaching methods are or how to effectively implement them in their courses (<xref ref-type="bibr" rid="R30">Handelsman et al., 2004</xref>; <xref ref-type="bibr" rid="R50">Pfund et al., 2009</xref>). In response, numerous faculty development efforts have been created to train and assist faculty as they transform their courses to evidence-based teaching (<xref ref-type="bibr" rid="R10">Borda et al., 2020</xref>; <xref ref-type="bibr" rid="R15">Callens et al., 2019</xref>; <xref ref-type="bibr" rid="R23">Derting et al., 2016</xref>; <xref ref-type="bibr" rid="R34">Herman et al., 2018</xref>; <xref ref-type="bibr" rid="R47">McConnell et al., 2020</xref>; <xref ref-type="bibr" rid="R60">Viskupic et al., 2019</xref>).</p>
<p>Research has succeeded in identifying requirements for inspiring and supporting successful faculty development in STEM and across disciplines at the postsecondary level (<xref ref-type="bibr" rid="R8">Austin, 2011</xref>; <xref ref-type="bibr" rid="R32">Henderson et al., 2011</xref>; <xref ref-type="bibr" rid="R37">Jacobson &amp; Cole, 2020</xref>; <xref ref-type="bibr" rid="R46">Marbach-Ad &amp; Rietschel, 2016</xref>). Additionally, <xref ref-type="bibr" rid="R53">Rutz et al. (2012)</xref> found that students in courses taught by faculty considered &#x201C;high-participators&#x201D; in faculty development had higher academic performance compared with students taught by &#x201C;low-participators.&#x201D; Unfortunately, even given these findings, lecture remains the predominant mode of teaching in STEM courses (<xref ref-type="bibr" rid="R28">Freeman et al., 2014</xref>; <xref ref-type="bibr" rid="R54">Schuster &amp; Finkelstein, 2006</xref>; <xref ref-type="bibr" rid="R56">Stains et al., 2018</xref>). Therefore, there is still much to learn about how faculty development efforts can better support faculty&#x2019;s use of evidence-based teaching (<xref ref-type="bibr" rid="R44">Macaluso et al., 2021</xref>). We have taken both a quantitative and qualitative approach to assess the faculty development program we created and implemented, the Consortium for the Advancement of Undergraduate STEM Education (CAUSE). Our previous quantitative analysis of classroom observation data found that many of the 45 faculty in CAUSE were using some evidence-based teaching practices at the beginning of the program. There was a significant increase in the use of practices, both through adoption and more frequent use (<xref ref-type="bibr" rid="R36">Jackson et al., 2022</xref>). To gain a deeper understanding of how the CAUSE program best supported this process of change, we will take a qualitative approach through a thematic analysis of interviews with faculty in the program. We now briefly introduce the theoretical and logistical foundations of the CAUSE program, which are more fully described in our previous work (<xref ref-type="bibr" rid="R36">Jackson et al., 2022</xref>).</p>
<sec id="S1">
<title>Theoretical Foundation of CAUSE</title>
<p>Instructors are nodes in a complex, interacting network, and faculty development efforts need to maintain a simultaneous focus on three interacting levels: (1) the individual, (2) the department, and (3) the institution. Sustainable change requires that we focus on building support networks in the larger academic ecosystem to foster institutional changes in teaching practices.</p>
<p>Previous research on the effectiveness of different faculty development efforts found two early approaches to be clearly inadequate: top-down demands from administrators and disseminating &#x201C;best curriculums&#x201D; (<xref ref-type="bibr" rid="R26">Ebert-May et al., 2011</xref>; <xref ref-type="bibr" rid="R32">Henderson et al., 2011</xref>; <xref ref-type="bibr" rid="R59">Turpen et al., 2016</xref>). Specific barriers faculty face when embracing effective teaching methods include the lack of familiarity with and opportunity to learn new methods, lack of support when changing courses, and lack of recognition for making successful changes (<xref ref-type="bibr" rid="R20">Dancy &amp; Henderson, 2008</xref>). To address these issues, <xref ref-type="bibr" rid="R32">Henderson et al. (2011)</xref> recommended that professional development programs focus on changing faculty teaching beliefs and providing long-term support and recognize the university as a complex system in which faculty operate.</p>
<p>CAUSE operationalized the theoretical foundation of faculty change. <bold></bold>CAUSE both implemented the EPIC model of adoption of new teaching practices&#x2014;as CAUSE involves exposure, persuasion, identification, commitment, and implementation (<xref ref-type="bibr" rid="R7">Arag&#x00F3;n et al., 2018</xref>)&#x2014;and specifically addressed the three major conclusions of <xref ref-type="bibr" rid="R32">Henderson et al.&#x2019;s (2011)</xref> work. The CAUSE program involved a two-year commitment consisting of two phases. The <italic>exploration</italic> phase increased awareness of evidence-based teaching practices, while the <italic>implementation</italic> phase provided practice and feedback on changes to teaching. To address the complexity of the university system in which each faculty member is situated, we incorporated a systems approach (<xref ref-type="bibr" rid="R8">Austin, 2011</xref>), which recognizes structural differences within an organization, the need for human resources, and political actions. We addressed the structural features of the university by acknowledging the cultural differences between departments and recruiting faculty leads from each department who could navigate those differences. To leverage human resources, we purposely created a community of support and provided objective assessment of teaching practices for each participant to counter possible departmental politics.</p>
</sec>
<sec id="S2">
<title>The CAUSE Program</title>
<p>The program was conducted at a large R1 institution and was funded by the National Science Foundation (NSF) for three years. Each year <bold></bold>we recruited teams of two to three faculty from each of seven STEM departments (biology, chemistry, computer science, mathematics, physics, psychology, and public health) to become CAUSE Fellows. Over the course of the three years, we recruited a total of 45 faculty. Faculty were recruited by the CAUSE Fellow acting as the departmental lead in that department. The departmental lead selected faculty based on their openness to try new teaching methods. The CAUSE program recruited primarily teaching-track faculty, as they teach large introductory STEM courses and have the opportunity to impact the learning of the greatest number of undergraduates. Faculty who chose to participate made a two-year commitment to the program.</p>
<p>The <italic>exploration</italic> phase consisted of biweekly meetings facilitated by a faculty member who was engaged in biology education research and was experienced in using evidence-based teaching practices. Though there are a plethora of terms associated with active learning teaching methods (<xref ref-type="bibr" rid="R24">Driessen et al., 2020</xref>; <xref ref-type="bibr" rid="R43">Lombardi et al., 2021</xref>), we defined evidence-based teaching practices as those identified and reported in our earlier work that created the classroom observation tool, the Practical Observation Rubric To Assess Active Learning (PORTAAL; <xref ref-type="bibr" rid="R27">Eddy et al., 2015</xref>). The PORTAAL tool was the result of an extensive literature review of papers in the cognitive sciences, learning sciences, and discipline-based education research fields that presented empirical evidence of a defined set of in-class teaching practices that significantly improved student learning. This definition is almost identical to that presented by <xref ref-type="bibr" rid="R37">Jacobson and Cole (2020)</xref>. Though evidence-based teaching practices may encompass both in- and out-of-classroom activities, PORTAAL practices are confined to in-class activities. CAUSE Fellows read and discussed many of these papers, and each practice was described. Subsequently, Fellows were encouraged to select a few practices they felt comfortable using and were appropriate for their courses. Meetings during the <italic>implementation</italic> phase focused on group discussions of successes and how to deal with barriers as CAUSE Fellows incorporated the new practices. To provide objective feedback for Fellows on their teaching practices, class recordings were coded each term using PORTAAL (<xref ref-type="bibr" rid="R27">Eddy et al., 2015</xref>). An aggregate PORTAAL report for all Fellows and individual PORTAAL reports were generated and distributed at the end of each quarter.</p>
<p>In previous research, we analyzed the change in implementation of 14 PORTAAL practices between the first time a Fellow taught a course while in CAUSE and the last time they taught that same course. We found that the Fellows increased the implementation of three practices while decreasing the implementation of two practices (<xref ref-type="bibr" rid="R36">Jackson et al., 2022</xref>). Given these quantitative results, we sought to gain a deeper understanding of Fellows&#x2019; experiences in the CAUSE program and their use of evidence-based teaching practices. Therefore, we conducted a series of interviews with a subset of CAUSE Fellows. A qualitative thematic analysis of these interviews allowed us to address the following research questions:
<list list-type="order">
<list-item><p>Which aspects of CAUSE made it a useful program for participants?</p></list-item>
<list-item><p>What factors do Fellows report influenced their implementation of evidence-based teaching practices?</p></list-item>
</list></p>
</sec>
<sec id="S3">
<title>Methods</title>
<sec id="S4">
<title>Faculty Interview Data</title>
<p>To understand which aspects of the CAUSE program may have helped faculty begin the process of changing how they teach, we selected a subset of faculty (<italic>n</italic> = 6) from the 45 Fellows in the program to interview. Only one faculty member per department was interviewed, but not all departments were represented. Human subjects research was conducted with the approval of the Institutional Review Board at the University of Washington (STUDY00002830).</p>
<p>Interviewees were selected based on four criteria: (1) they had completed at least one quarter of their <italic>implementation</italic> year, (2) they had PORTAAL data for at least two instances of teaching the same course, (3) they consistently attended CAUSE meetings and showed engagement in the program, and (4) they showed increasing trends in multiple PORTAAL practices over time. Pseudonyms, years of teaching experience, and approximate class size for each faculty member can be found in <xref ref-type="table" rid="T1">Table 1</xref>. All Fellows interviewed were in the non-tenure teaching track, as these faculty made up the majority of faculty in CAUSE. Four of the Fellows we interviewed identified as women, and two identified as men. We have chosen to use gender neutral names and pronouns throughout to preserve anonymity. The pseudonyms do not reflect the race or ethnicity of the Fellow.</p>
<table-wrap id="T1" position="float" orientation="portrait">
<caption><label>Table 1. </label><p><italic>Information About Interviewed Faculty</italic></p></caption>
<table frame="hsides" rules="groups">
<col align="left" valign="middle" />
<col align="left" valign="middle" />
<col align="left" valign="middle" />
<thead>
<tr>
<th align="left" valign="top"><p>Pseudonym</p></th>
<th align="center" valign="top"><p>Years teaching</p></th>
<th align="center" valign="top"><p>Approximate class size (students)</p></th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top"><p>Amari</p></td>
<td char="." align="char" valign="top"><p>10+</p></td>
<td align="left" valign="top"><p>500</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Cory</p></td>
<td char="." align="char" valign="top"><p>5</p></td>
<td align="left" valign="top"><p>300</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Elliot</p></td>
<td char="." align="char" valign="top"><p>1</p></td>
<td align="left" valign="top"><p>200</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Micah</p></td>
<td char="." align="char" valign="top"><p>10+</p></td>
<td align="left" valign="top"><p>300</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Peyton</p></td>
<td char="." align="char" valign="top"><p>10+</p></td>
<td align="left" valign="top"><p>200</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Sasha</p></td>
<td char="." align="char" valign="top"><p>7</p></td>
<td align="left" valign="top"><p>400</p></td>
</tr>
</tbody>
</table>
<attrib><italic>Note</italic>. Years teaching is the total number of years in a faculty position at this R1 or another college or university, based on the time at which the interview was conducted.</attrib>
</table-wrap>
<p>The interviews were voluntary for faculty. Interview questions were written and revised based on discussions among the research team. Interviews were conducted by the same researcher and took 30 to 55 minutes to complete. Audio recordings were collected with verbal consent of the participants, and recordings were transcribed.</p>
<p>In the interviews, faculty discussed their teaching background, motivation for enrolling in CAUSE, and experience in the program. As prior work has shown that providing faculty with data about the topic of the interview can stimulate more productive reflections (<xref ref-type="bibr" rid="R41">Kwasnicka et al., 2015</xref>; <xref ref-type="bibr" rid="R64">Wood et al., 2022</xref>), we provided each faculty member with a figure showing their PORTAAL data across the quarters (see <xref ref-type="fig" rid="F_1">Figure 1</xref>). The data for these figures had been collected and reported in our previous work (<xref ref-type="bibr" rid="R36">Jackson et al., 2022</xref>). Briefly, two researchers viewed video recordings of four different class sessions during each academic term and coded the presence and duration of each PORTAAL practice observed. Data for each PORTAAL practice were averaged, standardized to a 50-minute class session, and summarized in an end-of-term report for each Fellow. For the figures we presented during the interviews, we compiled the quarterly data to show values across the multiple academic terms in which the Fellow taught the courses. The general questions asked to each interviewee are found in <xref ref-type="app" rid="app1">Appendix A</xref>. Though these questions scaffolded the discussion, faculty were asked various follow-up questions depending on their answers.</p>
<fig id="F_1" position="float"><caption><label>Figure 1. </label><title>Example PORTAAL Report for One CAUSE Fellow</title></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="tia.3447-f0001.jpg" /><attrib><italic>Note</italic>. Average values for 23 PORTAAL practices collected across four different class sessions for each of three different courses taught during CAUSE. Long names for each PORTAAL practice code may be found in <xref ref-type="app" rid="app2">Appendix B</xref>. More elaborate descriptions of each code can be found in <xref ref-type="bibr" rid="R36">Jackson et al. (2022)</xref>. Dotted lines represent average values for each practice for each quarter based on all CAUSE Fellows. X-axis labels are quarters during CAUSE: &#x201C;S&#x201D; referring to spring, &#x201C;A&#x201D; to autumn, and &#x201C;W&#x201D; to winter.</attrib></fig>
</sec>
<sec id="S5">
<title>Thematic Analysis</title>
<p>After transcription, we conducted a thematic analysis of the interviews using the protocol described by <xref ref-type="bibr" rid="R12">Braun and Clarke (2006)</xref>. We used a primarily deductive approach to thematic analysis, as our interview questions and subsequent themes were intended to answer the research questions we formulated prior to analysis. We did not generate possible codes prior to conducting the interviews or reading the transcripts, but our coding was influenced by the research questions. Two researchers began by reading each transcript and individually creating a list of codes in Dedoose (version 9.0.46). After initial coding, the researchers met to reconcile their codes, revise the use and wording of codes, and discuss how the codes could be organized into themes that would answer the research questions. Each theme was intended to capture a distinct idea about at least one of the research questions. Each code was then organized under one theme. One researcher then revised the coding based on the new list of codes and themes. Together, the researchers revised the themes and codes a final time after the second round of coding, and code presence and application tables were exported from Dedoose.</p>
<p>When reporting results of this thematic analysis, we will at times present figures that indicate the variation in implementation of a specific PORTAAL practice among the six Fellows interviewed for this study. The data used to generate these figures were collected and analyzed in the aggregate for the 45 CAUSE Fellows in the program. We have extracted the data for all the courses taught by the six Fellows interviewed for the current study and generated bar graphs.</p>
</sec>
</sec>
<sec id="S6">
<title>Results</title>
<p>We identified multiple codes to characterize interview data and organized the codes into five themes (<xref ref-type="table" rid="T2">Table 2</xref>). For all but one theme (respect for students underlies implementation), all six interviewees discussed at least one of the codes under each theme. To answer our research questions, we will describe overall themes from the interviews and present excerpts to support the themes. Excerpts from faculty may be lightly edited for clarity and to preserve anonymity.</p>
<table-wrap id="T2" position="float" orientation="portrait">
<caption><label>Table 2. </label><p><italic>Themes and Codes From Faculty Interviews</italic></p></caption>
<table frame="hsides" rules="groups">
<col align="left" valign="middle" />
<col align="left" valign="middle" />
<col align="left" valign="middle" />
<thead>
<tr>
<th align="left" valign="top"><p>Theme</p></th>
<th align="center" valign="top"><p>Code</p></th>
<th align="center" valign="top"><p>Number of Fellows who discussed code</p></th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="4" align="left" valign="top"><p>CAUSE</p> <p>social value</p></td>
<td align="left" valign="top"><p>Enrolled because of colleague</p></td>
<td align="center" valign="top"><p>3</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Learned about teaching in other departments</p></td>
<td align="center" valign="top"><p>6</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Support to know that others were changing teaching</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Valued meeting other faculty across departments</p></td>
<td align="center" valign="top"><p>4</p></td>
</tr>
<tr>
<td rowspan="4" align="left" valign="top"><p>CAUSE educational value</p></td>
<td align="left" valign="top"><p>Feedback was valuable</p></td>
<td align="center" valign="top"><p>3</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Learned about specific practice from colleague</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Provided literature or evidence for teaching practices</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Provided structured time for improving teaching</p></td>
<td align="center" valign="top"><p>1</p></td>
</tr>
<tr>
<td rowspan="7" align="left" valign="top"><p>Context influences implementation</p></td>
<td align="left" valign="top"><p>Adapted a strategy for their course</p></td>
<td align="center" valign="top"><p>4</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Classroom layout</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Classroom technology allowed for more active practices</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Curriculum is fixed or inherited</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Random call</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Students are used to active learning</p></td>
<td align="center" valign="top"><p>1</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Variation in implementation among courses</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td rowspan="11" align="left" valign="top"><p>Implementation is related to experience or motivation</p></td>
<td align="left" valign="top"><p>Active learning is fun for instructor</p></td>
<td align="center" valign="top"><p>3</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Active learning led to insights in student thinking</p></td>
<td align="center" valign="top"><p>3</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Being unsatisfied with teaching led to change</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Challenge implementing a teaching practice</p></td>
<td align="center" valign="top"><p>6</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Changing teaching incrementally</p></td>
<td align="center" valign="top"><p>4</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Instructor is reflective about teaching</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Practices used before CAUSE</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Previous participation in faculty development</p></td>
<td align="center" valign="top"><p>6</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Random call can be challenging for the instructor</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Solution to implementation challenge</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Time to revise teaching materials is a barrier</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td rowspan="5" align="left" valign="top"><p>Respect for students underlies implementation</p></td>
<td align="left" valign="top"><p>Balancing using new strategies with the benefit it would provide</p></td>
<td align="center" valign="top"><p>2</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Building student community</p></td>
<td align="center" valign="top"><p>1</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Instructor implies respect for students</p></td>
<td align="center" valign="top"><p>5</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Student hesitancy to active learning</p></td>
<td align="center" valign="top"><p>3</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Students hearing the answer from their peers may improve confidence</p></td>
<td align="center" valign="top"><p>4</p></td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="S7">
<label>RQ1</label><title>Which aspects of CAUSE made it a useful program for participants?</title>
<p>Two themes identified from the interviews addressed aspects of CAUSE that made it useful for the Fellows: the social value and the educational value (see <xref ref-type="table" rid="T2">Table 2</xref>).</p>
<sec id="S8">
<title>CAUSE Social Value</title>
<p>Faculty explained that CAUSE fostered cross-disciplinary conversations about teaching. Multiple interviewees noted they likely would not have met and discussed teaching with faculty from other STEM departments if they had not participated in the CAUSE program. Some Fellows also explained they were encouraged to enroll in CAUSE because of a colleague.</p>
<p>Elliot said it was helpful to be in a cohort of instructors that met regularly, because it allowed the Fellows to build a community across departments and learn about the varied approaches to using active learning. <italic></italic>This idea was echoed by other instructors. For example, Cory said,<disp-quote>
<p><italic>I&#x2019;ve really appreciated having the time to sit down and say, the next hour is devoted to thinking about how we can use clicker questions in class, or thinking about how we approach random call in class, or thinking about how we might achieve this, that, or the other</italic>&#x0009;<italic>in a classroom when you have 300 students versus when you have 50 students. What</italic> <italic>challenges are there? Or not? Those discussions make you a better teacher. In the same</italic> <italic>way [as] going to a conference&#x2014;maybe you&#x2019;ll learn something useful and maybe you won&#x2019;t, but it kinda gets you re-fired up to be a good teacher. It&#x2019;s motivating</italic>.</p>
</disp-quote></p>
</sec>
<sec id="S9">
<title>CAUSE Educational Value</title>
<p>When we interviewed the Fellows, they each were implementing evidence-based teaching practices at varied levels. However, the majority explained that CAUSE provided resources to support them as they adopted new teaching practices. For example, five out of the six Fellows interviewed expressed that CAUSE provided them with evidence for the impact of these teaching strategies on student learning and with guidance on how to implement them. Fellows indicated this reduced the amount of time needed to search the literature and educate themselves. Elliot, who was newer to teaching, said,<disp-quote>
<p><italic>I think the things that have helped me the most are the things about . . . the practice of how do you run active learning exercises in a classroom effectively . . . . You need to prompt them for logic. Or you need to like, give them time to think about it by themselves first. I think those mechanics, like to understand why those mechanics are helpful. Like reading the research papers about that has been super helpful</italic>.</p>
</disp-quote>Peyton and Sasha were using some evidence-based teaching practices prior to CAUSE but noted that the program reminded them why it was important to implement evidence-based practices and how to coach other instructors on using these methods effectively.</p>
<p>Additionally, some interviewees explained that the most helpful part of being in CAUSE was receiving objective and timely feedback on their teaching. For example, Sasha said,<disp-quote>
<p><italic>What ends up being most valuable to me I think is like the reports of my own data, particularly as I see where I stand with faculty colleagues. And also brainstorming around ways to maybe improve some of the [practices] we talk about</italic>.</p>
</disp-quote>This quarterly teaching feedback, similar to what is shown in <xref ref-type="fig" rid="F_1">Figure 1</xref>, was a hallmark of the CAUSE program.</p>
</sec>
</sec>
<sec id="S10">
<label>RQ2</label><title>Which factors influenced Fellows&#x2019; implementation of evidence-based teaching practices?</title>
<p>We found three themes related to factors that influenced Fellows&#x2019; implementation of evidence-based teaching practices (see <xref ref-type="table" rid="T2">Table 2</xref>). One was how the extrinsic factor of class context influenced implementation, while two related to how the intrinsic factors of Fellows&#x2019; motivation, prior experience with these teaching practices, and their respect for students as learners impacted implementation.</p>
<sec id="S11">
<title>Context Influences Implementation</title>
<p>Fellows explained that their implementation of evidence-based teaching practices depended on the context of their classrooms. For example, some of the most common codes applied in this theme included the variation in the practices they used depending on the course they were teaching, how they adapted practices to better meet the unique needs of their course or students, and the benefits of classroom technology as they shifted to more active learning practices. Two instructors, Elliot and Micah, talked specifically about the balance they were attempting to achieve between using more active learning practices during class while meeting the strict schedule of a fixed curriculum. These instructors felt there was little time to spare for implementing more clicker questions or small-group discussions because there was so much material to cover.</p>
<p>A noteworthy example of the variation in implementation of evidence-based teaching practices that coincided with course context can be seen in two courses taught by the same instructor. Amari taught three different courses while in CAUSE, and the amount of total student time as measured by the total minutes students were thinking alone, working in groups, or answering questions varied greatly across these three courses (<xref ref-type="fig" rid="F_2">Figure 2</xref>). When prompted in the interview about these observed differences, Amari said,<disp-quote>
<p><italic>There&#x2019;s a reason for that. I inherited a lot of the [teaching materials] that I use in [the majors lower division course] from . . . other folks who teach the course. The ones in [majors upper division course] I made up all myself . . . . It was always from the perspective that the students learn more by doing than by hearing me yack, and yet . . . I don&#x2019;t carry out my own philosophy as effectively in that class. I do more standing up there yakking than I do in [the majors lower division course] where I started with materials from the people who developed the whole active learning approach to that class</italic>.</p>
</disp-quote></p>
<fig id="F_2" position="float"><caption><label>Figure 2. </label><title>Average Values for Total Student Time for the Six Interviewees</title></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="tia.3447-f0002.jpg" /><attrib><italic>Note</italic>. X-axis labels are quarters during CAUSE: &#x201C;S&#x201D; referring to spring, &#x201C;A&#x201D; to autumn, and &#x201C;W&#x201D; to winter. Data displayed in this figure were collected as part of the quantitative study reported in our previous publication and was reported in the aggregate for all CAUSE Fellows (<xref ref-type="bibr" rid="R36">Jackson et al., 2022</xref>). Data for the six interviewed Fellows were extracted from that data set to generate bar graphs for each specific Fellow.</attrib></fig>
<p>Another factor influencing Fellows&#x2019; implementation of evidence-based teaching practices was trying to meet the unique aspects of their course by adapting practices. Elliot explained they were trying to adapt the use of volunteer answers to hear from more women in their class. By doing this, they were able to have more students and more women answering questions, which likely increased the total amount of student engagement in their classes. Elliot said,
<disp-quote>
<p><italic>I&#x2019;ve also been trying to [call on] someone who hasn&#x2019;t shared in class before . . . . I think there&#x2019;s a middle ground, before doing the full random list of students . . . I actually try to bias towards women, if they&#x2019;re raising their hand. Because most of the class is men. And I don&#x2019;t want it to be the case that only men are answering these questions. So when I ask for volunteers in the back, I try to pay particular attention if there&#x2019;s a woman in the back that raises her hand, so that she can say something and then it sounds like there are more women in the class</italic>.</p>
</disp-quote>Though they did not feel comfortable using random calling, Elliot was finding ways to hear from more students in their classroom, especially those underrepresented in their department.</p>
<p>Micah was newer to using evidence-based teaching practices and wanted to adapt them for their classes but had not yet balanced the level of student engagement with the constraints of the course curriculum. Micah said,<disp-quote>
<p><italic>Oftentimes, I&#x2019;ll have a period when I have figured out which questions to ask, and they&#x2019;re much more interactive. Then either because I fall behind and we need to catch up, I mean, we&#x2019;re on a common final exam so I can&#x2019;t afford to skip topics. If I feel like the students are struggling with something or we&#x2019;re running out of time, [the questions] will usually be interactive and then never mind . . . we&#x2019;re going to do it the old-fashioned way</italic>.</p>
</disp-quote></p>
</sec>
<sec id="S12">
<title>Implementation Is Related to Experience or Motivation</title>
<p>All of the Fellows interviewed had previously participated in some professional development related to teaching and were using evidence-based practices in varying amounts. However, Fellows also noted they encountered hesitancy or logistical issues while implementing some practices. The most prominent practice that fell into this category was using random calling. Five out of the six interviewees alluded to their discomfort or logistical issues associated with using random calling.</p>
<p>Sasha also elaborated on how their teaching experience and philosophy influenced the use of evidence-based teaching practices in their classes. Sasha said,<disp-quote>
<p><italic>I think I was doing a bunch of [evidence-based teaching prior to CAUSE]. My approach to teaching in general is very kind of centered on this idea of students as active participants in the class, and our class is kind of this collaborative learning community. So very naturally without realizing, it was evidence-based when I first started teaching. I kind of slipped into thinking of classes like a dialogue between the students and me, and between the students with each other. I think that people tend to care more about learning if they feel like they have some degree of ability to self-direct. So I think in all my classes, I tried to make it, you know, even if students aren&#x2019;t directing the curriculum, which they are [doing] sometimes. But they definitely get to direct where the conversation goes that day, and I&#x2019;m just kind of like the facilitator for that</italic>.</p>
</disp-quote>Cory taught the same course each quarter during CAUSE and therefore had many opportunities to change their course. They were reflective and motivated about how their teaching could change and improve over time. They expressed that it may take multiple iterations of teaching the same course to devise an effective plan for using active learning. Cory explained,<disp-quote>
<p><italic>You&#x2019;re always like, &#x201C;Next time I&#x2019;m gonna [teach] it this other way.&#x201D; And then you do it a little bit differently and you&#x2019;re like, &#x201C;I liked part of that better. But part of that was worse.&#x201D; I get to the end of class and I&#x2019;m like, &#x201C;I wanna do this different next time, or next time, I&#x2019;m gonna add this, or I need to make sure that I drive this point home on this slide so that they&#x2019;re already there when we get two slides later.&#x201D; That&#x2019;s sort of that future plan, too, of someday I&#x2019;m gonna have a real plan figured out on how to do that really well. But I&#x2019;m not there yet</italic>.</p>
</disp-quote>Some Fellows explained that evidence-based teaching was also a more enjoyable way of teaching as it provided more opportunities to interact with their students. This can result in both students and instructors being more motivated to engage in the learning process. For example, Sasha said,<disp-quote>
<p><italic>Yeah, the vast majority of [my students] are really into [active learning]. There&#x2019;s some who just want, like, the very structured lecture only. And I tell them at the very beginning of the class, &#x201C;If that&#x2019;s what you want, pick a different class.&#x201D; [Active learning is] more fun for me. It&#x2019;s more fun for the majority of students</italic>.</p>
</disp-quote></p>
</sec>
<sec id="S13">
<title>Respect for Students Underlies Implementation</title>
<p>Based on their answers to interview questions, five of the six Fellows exemplified respect for their students. An excerpt from Micah shows how instructors felt that students should be acknowledged as active participants and contributors to the class. Micah said,<disp-quote>
<p><italic>Most of the time when I ask for volunteer answers, it&#x2019;s so that the students get that extra bit of time to think about what just happened and to hear it more in their own words rather than mine. I think that that&#x2019;s a useful exercise for them. I think there&#x2019;s maybe an aspect sometimes in [this subject] where some students think that it&#x2019;s something that&#x2019;s being passed onto them from heaven. I try to emphasize that [this subject] is something that we all can do . . . . So, when they speak up and tell me the answer, I think it makes it more obvious that it&#x2019;s something that, I&#x2019;m hoping at least, they can do and not something that their teachers tell them [how to do]</italic>.</p>
</disp-quote>Another way faculty expressed respect for their students was their concern that evidence-based teaching may induce anxiety in some students or lead to cognitive overload. A few of the Fellows talked specifically about weighing the addition of more activities or assignments with the benefits they could provide for the students. For example, Cory said,<disp-quote>
<p><italic>I think that there&#x2019;s something to be said for cognitive load on the students or just overall load on the students. Some of them are working so many jobs and they have siblings to take care of and they&#x2019;ve got commutes that are awful . . . and so, adding one more [homework assignment] . . . I wanna make sure that it&#x2019;s really going to be a benefit to them as opposed to just my hair brained idea</italic>.</p>
</disp-quote></p>
</sec>
</sec>
</sec>
<sec id="S14">
<title>Case Study: Random Call</title>
<p>In the preceding sections we have used excerpts from multiple Fellows as examples for each theme. We will now show how all five themes were found in one Fellow&#x2019;s remarks about the most commonly discussed and controversial evidence-based teaching practice: randomly calling on students to give answers during class. The data in the figure below (<xref ref-type="fig" rid="F_3">Figure 3</xref>) illustrate the implementation differences for this practice across the Fellows.</p>
<fig id="F_3" position="float"><caption><label>Figure 3. </label><title>Average Values for Random Call for the Six Interviewees</title></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="tia.3447-f0003.jpg" /><attrib><italic>Note</italic>. X-axis labels are quarters during CAUSE: &#x201C;S&#x201D; referring to spring, &#x201C;A&#x201D; to autumn, and &#x201C;W&#x201D; to winter.</attrib></fig>
<p></p>
<p>Interviewees noted that CAUSE provided ample evidence to support the claim that using random call could create a more equitable classroom. As many of the Fellows in the program had been using this practice for a considerable period of time, they not only encouraged others to adopt this practice but also provided anecdotal information about how best to implement it (CAUSE educational value). These Fellows acted as mentors to instructors who were newer to using this and other practices (CAUSE social value). Three interviewees specifically noted they do not use random call in their classrooms. Two of these instructors explained that it was because they felt it might create anxiety for students (respect for students). In an effort to find a way to use random call that minimizes students&#x2019; and instructors&#x2019; anxiety, CAUSE Fellows suggested using a variation of the practice: group random call. Group random call relies on students discussing in groups prior to the report-out phase of the activity and allows students to be called by group name rather than by an individual student&#x2019;s name (<xref ref-type="bibr" rid="R40">Knight et al., 2016</xref>). More recently, a new method of random call, termed &#x201C;warm calling&#x201D;&#x2014;in which students are given an opportunity to discuss the answer with students they are sitting near prior to being called on by the instructor&#x2014;has been introduced as yet another option for instructors (<xref ref-type="bibr" rid="R49">Metzger &amp; Via, 2022</xref>).</p>
<p>We have detailed an account below from a Fellow who first struggled to use random call, adapted it to serve their students better, and became an avid supporter of the practice within CAUSE and within their department.</p>
<p>At the start of their first quarter in CAUSE, Peyton was implementing evidence-based teaching practices, but they seldom used random call. When asked about this, Peyton said,<disp-quote>
<p><italic>I can tell you when I first did random calling, it was a bit of a disaster . . . . The general fear [of the subject], I think, made it difficult to do random calling because they were nervous, to begin with . . . . So, when I first tried, I random called by their names, but I had plenty of students. I couldn&#x2019;t remember who&#x2019;s who. When I random called by name, they would just pretend that they [were] not there. I had a lot of ignored calls and it wasn&#x2019;t working. So, I had to stop that quarter . . . . But then I tried to do different things [with] random calls. This time I had a list of seat numbers and I would just walk up to that seat number and then personally ask, &#x201C;So, what did you discuss?&#x201D; Then, in that case, they can&#x2019;t pretend that they are not there. Since then, I&#x2019;ve been using that method and it works beautifully. It&#x2019;s great</italic>.</p>
</disp-quote>
By adapting the random call method to meet the comfort level of their students, Peyton was able to preserve the random selection of student respondents while potentially reducing the anxiety of being called by name. Peyton also explained,<disp-quote>
<p><italic>The random call has been eye-opening for me really. So, when I used to ask for volunteers more often, often people who volunteer will have the right answer and the right logic. They&#x2019;re confident enough to do that. But when I random call, often they say, &#x201C;Well, I wasn&#x2019;t sure,&#x201D; and I say, &#x201C;That&#x2019;s okay. We&#x2019;re here to discuss.&#x201D; Then they&#x2019;ll give me sometimes very interesting logic which is still correct and I never thought about it [that way]. I was like, &#x201C;Wow, that&#x2019;s the first time I&#x2019;ve heard this logic and it&#x2019;s great.&#x201D; I love that aspect . . . . And I think the students enjoy that because not all students get the right logic</italic>.</p>
</disp-quote>
Using random call also allowed Peyton to better understand the types of reasoning their students were using and why they were making mistakes. Peyton had such a positive experience using random call that they have been encouraging other instructors in their department to use it. Peyton said,<disp-quote>
<p><italic>Maybe [CAUSE] was not so much of a learning experience for me, but moral support for me. Because I think I am one of only two people in [my] department who are consistently doing random calling, maybe three. Some instructors are trying to implement it. Try it, and then it didn&#x2019;t work, and then they stopped doing it. With the backing of CAUSE, I&#x2019;m giving them stronger advice. [I&#x2019;m telling them,] &#x201C;It&#x2019;s not just from me . . . [Random calling] is a really good thing.&#x201D; And then I can talk about other people in the other departments doing it</italic>.</p>
</disp-quote></p>
</sec>
<sec id="S15">
<title>Discussion</title>
<p>Numerous articles have documented the many barriers faculty face when attempting to transform their teaching from traditional lecture to teaching methods that create greater student engagement (<xref ref-type="bibr" rid="R6">Apkarian et al., 2021</xref>; <xref ref-type="bibr" rid="R8">Austin, 2011</xref>; <xref ref-type="bibr" rid="R14">Brownell &amp; Tanner, 2012</xref>; <xref ref-type="bibr" rid="R17">Carbone et al., 2019</xref>; <xref ref-type="bibr" rid="R22">Denaro et al., 2022</xref>; <xref ref-type="bibr" rid="R33">Henderson &amp; Dancy, 2007</xref>; <xref ref-type="bibr" rid="R39">Kim et al., 2019</xref>; <xref ref-type="bibr" rid="R55">Shadle et al., 2017</xref>). Our thematic analysis of interviews further supports the existence of these barriers for today&#x2019;s instructors. The six CAUSE Fellows indicated that the context and constraints of the course they taught, as well as their prior experience with certain teaching practices, were influential in their decisions to adopt and implement new teaching practices. Though multiple barriers to change existed for the Fellows, previous research indicates instructors&#x2019; perceived support in the change process is more impactful than the perceived barriers (<xref ref-type="bibr" rid="R9">Bathgate et al., 2019</xref>; <xref ref-type="bibr" rid="R47">McConnell et al., 2020</xref>). In fact, our thematic analysis reinforces this conclusion, as the Fellows identified the social support and educational resources the program provided as key to the program being useful for them. We also found that the Fellows expressed a personal motivation to change and a high degree of respect for their students as capable and valued partners in the learning process. We therefore frame our discussion as an asset rather than a deficit model of faculty change. We will organize our discussion to align with our research questions.</p>
</sec>
<sec id="S16">
<title>Useful Aspects of CAUSE</title>
<p>Our thematic analysis revealed that these six CAUSE Fellows greatly valued the strong and broad social support offered by the program. As a systems approach for change (<xref ref-type="bibr" rid="R8">Austin, 2011</xref>; <xref ref-type="bibr" rid="R21">DeMarais et al., 2022</xref>) was a key component of our program, CAUSE annually recruited cohorts of two to three faculty from seven different STEM departments over the three years of the program. This larger community afforded Fellows the opportunity to meet faculty outside their department and hear how other instructors had successfully implemented evidence-based teaching practices in their STEM classrooms. Multiple instructors explained they appreciated not having to &#x201C;reinvent the wheel&#x201D; of how to use these new teaching practices and could instead learn from more experienced CAUSE Fellows. <xref ref-type="bibr" rid="R61">Vygotsky&#x2019;s (1978)</xref> sociocultural theory of learning states learning stems from social interaction, as knowledge is constructed by interactions with others, which in turn leads to internalization of that knowledge. The sociocultural theory of learning applies to any learner whether they are students in a class or faculty in professional development programs.</p>
<p>The Fellows appreciated the educational support the program offered in providing a curated and concise presentation of the primary literature on the impact of evidence-based teaching on student academic performance. As all CAUSE Fellows held doctorate degrees in STEM fields, they had been trained to make decisions based on empirical evidence and knew the value of results in peer-reviewed literature. Interestingly, <xref ref-type="bibr" rid="R11">Bouwma-Gearhart (2012)</xref> found that many faculty took part in faculty development efforts because they wanted to bring their teaching identities in better alignment with their research background. Therefore, it is possible that providing a rich list of citations for the value of evidence-based teaching may have supported these Fellows&#x2019; implementation of teaching practices.</p>
<p>However, our finding is in contrast to <xref ref-type="bibr" rid="R5">Andrews and Lemons&#x2019;s (2015)</xref> results from their qualitative analysis of interviews of faculty engaged in adoption of a case study approach to teaching. Andrews and Lemons found that faculty&#x2019;s personal experience with active learning was more influential than the provided empirical evidence for motivating change, which has been echoed in the literature (<xref ref-type="bibr" rid="R37">Jacobson &amp; Cole, 2020</xref>). We interviewed a small sample of faculty specifically about the support that the CAUSE program provided. One of the hallmarks of the program was providing primary literature about evidence-based teaching. Therefore, it is possible that when Fellows were interviewed, they were likely to report that the evidence from the literature was helpful. It is also possible that these faculty were motivated by both empirical evidence and their own experiences with evidence-based teaching.</p>
<p>One of the Fellows, Peyton, explained that they were able to use evidence from the CAUSE meetings to support their argument for other instructors in their department to use random call. Peyton&#x2019;s story supports the premise and findings from others, which suggest participants in faculty development programs can themselves become change agents within their departments and can even provide the impetus, support, and guidance for other departments on campus that are slower to implement evidence-based teaching practices (<xref ref-type="bibr" rid="R4">Andrews et al., 2016</xref>; <xref ref-type="bibr" rid="R38">Kezar, 2014</xref>; <xref ref-type="bibr" rid="R42">Lane et al., 2019</xref>; <xref ref-type="bibr" rid="R47">McConnell et al., 2020</xref>).</p>
<p>Providing objective feedback on classroom practices rather than instructor self-report has been noted to be key to many professional development programs in STEM departments (<xref ref-type="bibr" rid="R13">Brickman et al., 2016</xref>; <xref ref-type="bibr" rid="R29">Gormally et al., 2014</xref>; <xref ref-type="bibr" rid="R35">Hjelmstad et al., 2018</xref>; <xref ref-type="bibr" rid="R45">Manduca et al., 2017</xref>). CAUSE provided quantitative feedback on PORTAAL practices Fellows were using in their classrooms at the end of each term. The quarterly PORTAAL reports allowed faculty to monitor how their values for each PORTAAL practice compared with the range of values of their colleagues and provided opportunities for self-reflection and motivation for change. Two of the instructors interviewed stated this was one of the most beneficial parts of CAUSE.</p>
<sec id="S17">
<title>Factors That Influenced Implementation of Teaching Practices</title>
<p>In agreement with results from professional development efforts of others, we found extrinsic context influences the level of implementation of new teaching methods (<xref ref-type="bibr" rid="R6">Apkarian et al., 2021</xref>; <xref ref-type="bibr" rid="R55">Shadle et al., 2017</xref>; <xref ref-type="bibr" rid="R57">Sturtevant &amp; Wheeler, 2019</xref>). Fellows noted that classroom technologies such as Poll Everywhere facilitated greater student engagement with course material. However, they also identified many contextual barriers that lead to greater variation in the level and types of evidence-based teaching they implemented across the different courses they taught (<xref ref-type="bibr" rid="R65">Yik et al., 2022</xref>). These contexts ranged from the physical layout of the room (<xref ref-type="bibr" rid="R48">Metzger &amp; Langley, 2020</xref>), to course subject matter, to the students&#x2019; previous experience and comfort with various evidence-based teaching methods.</p>
<p>Intrinsic factors related to prior experience with these teaching methods or their motivation also influenced Fellows&#x2019; decisions to change their teaching. All the Fellows we interviewed had previously participated in some type of teaching professional development. This finding is in agreement with results of <xref ref-type="bibr" rid="R65">Yik et al. (2022)</xref>, who surveyed over 2,000 instructors from 749 institutions and found instructors who had participated in teaching-related faculty programs spent considerably less time lecturing and more time in active learning teaching methods. The majority of the Fellows also brought up that they were reflecting on their teaching practices and changing the way they used evidence-based practices incrementally over time. We were encouraged to find Fellows were reflecting on their teaching, as previous research has found reflection can be linked to changed beliefs and practices in the classroom (<xref ref-type="bibr" rid="R63">Wlodarsky, 2005</xref>). In agreement with other findings (<xref ref-type="bibr" rid="R9">Bathgate et al., 2019</xref>), some Fellows also discussed how they found active learning to be a more enjoyable way to teach. These findings suggest personal factors may have had a major impact on Fellows&#x2019; decisions to adopt and implement new teaching practices during CAUSE.</p>
<p>Another theme evident from the interviews was interviewees&#x2019; obvious respect for students as valued partners in the learning process. We interpret these views as the Fellows holding a growth mindset toward their students&#x2019; ability to learn. Growth mindset indicates all students can learn if given the proper support and practice (<xref ref-type="bibr" rid="R25">Dweck, 1999</xref>). Work by <xref ref-type="bibr" rid="R16">Canning et al. (2019)</xref> found faculty who held a growth mindset about their students&#x2019; academic abilities had academic achievement gaps half the size of faculty who held a fixed mindset. Many suggest achievement gaps indicate some students are not as capable as others, but Canning et al.&#x2019;s work indicates that how students are viewed as learners may be equally influential. It was encouraging to see that Fellows were attentive to how the new teaching methods impacted their students&#x2019; learning behaviors in and out of the classroom and adjusted their teaching methods accordingly. This was particularly obvious in how Fellows implemented their use of random call. Although this method may be stressful for some students (<xref ref-type="bibr" rid="R18">K. M. Cooper et al., 2018</xref>), hearing all voices is an equity issue, so Fellows found alternative ways to use random call (<xref ref-type="bibr" rid="R49">Metzger &amp; Via, 2022</xref>; <xref ref-type="bibr" rid="R62">Waugh &amp; Andrews, 2020</xref>). We came to realize that these CAUSE Fellows had switched from seeing themselves as the &#x201C;sage on the stage&#x201D; to becoming the &#x201C;the guide on the side&#x201D; to facilitate rather than dictate student learning.</p>
</sec>
<sec id="S18">
<title>Limitations</title>
<p>Findings from faculty interviews are subject to a selection bias. The individuals who participated in interviews were selected by researchers based on their engagement in CAUSE and their comfort with discussing their teaching. Our sample of interviewees could have had a more positive experience in the CAUSE program and this could have influenced their responses to our interview questions. Therefore, the themes reflected in these interviews may not be representative of all the faculty in CAUSE. We also found that the interviewees all reported using some level of evidence-based teaching prior to CAUSE and had some previous experience with faculty development.</p>
</sec>
</sec>
<sec id="S19">
<title>Implications for STEM Professional Development Programs</title>
<p>In response to the numerous national calls to transform STEM teaching from traditional lecture to evidence-based practices, many groups have created and assessed faculty development programs to support this change. We designed CAUSE to operationalize current best practices resulting from these efforts. Below we summarize our results so that future professional development programs may take into consideration the value of providing the positive aspects of CAUSE and acknowledge the barriers that continue to exist for faculty as they begin the process of change.</p>
<p>Our thematic analysis of the interviews of six CAUSE Fellows contributes to the growing body of research designed to identify the factors that support faculty&#x2019;s decisions to transform their teaching. Our analysis indicated that both extrinsic and intrinsic factors influenced their implementation of evidence-based teaching practices. The Fellows noted the social interaction with Fellows from their department and across STEM departments built a large and strong support network that provided encouragement for their sustained efforts and acknowledgment of their successes. Fellows valued that CAUSE promoted teaching methods that had empirical support for enhancing students&#x2019; academic performance and that CAUSE provided quantitative and objective feedback on their teaching methods over time. Many factors influenced Fellows&#x2019; implementation of evidence-based practices, including the course level and content, students&#x2019; comfort with the disciplinary material, Fellows&#x2019; experience using teaching methods, and Fellows&#x2019; personal motivation to change.</p>
<p>Underlying the discussions during the interviews, Fellows expressed a consistent and a strong sense of respect for their students. These Fellows were aware some students may be unfamiliar and therefore uncomfortable with evidence-based teaching, so implementation would have to be tempered. Fellows were also aware they needed to balance the demands the new teaching strategies would place on the students&#x2019; time with the benefits they would provide but respected their students as willing and able learners. Given the increased awareness of the impact faculty&#x2019;s mindset has on student learning (<xref ref-type="bibr" rid="R16">Canning et al., 2019</xref>) and recent evidence that inclusive teaching practices that emphasize treating students with dignity and respect may also close achievement gaps in STEM for students from marginalized backgrounds (<xref ref-type="bibr" rid="R58">Theobald et al., 2020</xref>), we were encouraged to find &#x201C;respect for students&#x201D; as a persistent theme in the interviews.</p>
<p>We found that change is a process that is complex and as varied as the individuals engaging in change. To be successful, faculty development programs need to provide the necessary social and educational support for change and recognize each individual brings their own teaching experience, course context, and personal motivations to the process of change.</p>
</sec>
</body>
<back>
<bio id="bio1"><title>Biographies</title><p><bold>Mallory A. Jackson</bold> is a graduate of the Department of Psychology and the Department of Biology at the University of Washington, Seattle. She is a former Research Scientist in the Biology Education Research Group at the University of Washington, Seattle.</p></bio>
<bio id="bio2"><p><bold>Mary Pat Wenderoth</bold> is a Teaching Professor Emerita in the Department of Biology at the University of Washington, Seattle. She is a member of the Biology Education Research Group. She conducts research in the areas of student reasoning in physiology and creating effective faculty development efforts to implement evidence-based teaching practices in STEM classrooms. She is also a co-founder of the Society for the Advancement of Biology Education Research (SABER).</p></bio>
<ack id="S20">
<title>Acknowledgments</title>
<p>We would like to thank Jennifer H. Doherty for her guidance on our interview protocol and analysis. We also thank the CAUSE faculty participants who graciously shared their time to be interviewed.</p>
</ack>
<sec id="S21">
<title>Conflict of Interest Statement</title>
<p>The authors have no conflict of interest.</p>
</sec>
<ref-list><title>References</title>
<ref id="R1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Alberts</surname>, <given-names>B.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Why science education is more important than most scientists think</article-title>. <source>FEBS Letters</source>, <volume>596</volume>(<issue>2</issue>), <fpage>149</fpage>&#x2013;<lpage>159</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1002/1873-3468.14272">https://doi.org/10.1002/1873-3468.14272</ext-link></mixed-citation></ref>
<ref id="R2"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>American Association for the Advancement of Science.</surname></string-name></person-group> (<year>2011</year>). <source>Vision and change in undergraduate biology education: A call to action</source>. <publisher-name>AAAS</publisher-name>.</mixed-citation></ref>
<ref id="R3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Anderson</surname>, <given-names>W. A.</given-names></string-name>, <string-name><surname>Banerjee</surname>, <given-names>U.</given-names></string-name>, <string-name><surname>Drennan</surname>, <given-names>C. L.</given-names></string-name>, <string-name><surname>Elgin</surname>, <given-names>S. C. R.</given-names></string-name>, <string-name><surname>Epstein</surname>, <given-names>I. R.</given-names></string-name>, <string-name><surname>Handelsman</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Hatfull</surname>, <given-names>G. F.</given-names></string-name>, <string-name><surname>Losick</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>O&#x2019;Dowd</surname>, <given-names>D. K.</given-names></string-name>, <string-name><surname>Olivera</surname>, <given-names>B. M.</given-names></string-name>, <string-name><surname>Strobel</surname>, <given-names>S. A.</given-names></string-name>, <string-name><surname>Walker</surname>, <given-names>G. C.</given-names></string-name>, &amp; <string-name><surname>Warner</surname>, <given-names>I. M.</given-names></string-name></person-group> (<year>2011</year>). <article-title>Changing the culture of science education at research universities</article-title>. <source>Science</source>, <volume>331</volume>(<issue>6014</issue>), <fpage>152</fpage>&#x2013;<lpage>153</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/science.1198280">https://doi.org/10.1126/science.1198280</ext-link></mixed-citation></ref>
<ref id="R4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andrews</surname>, <given-names>T. C.</given-names></string-name>, <string-name><surname>Conaway</surname>, <given-names>E. P.</given-names></string-name>, <string-name><surname>Zhao</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Dolan</surname>, <given-names>E. L.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Colleagues as change agents: How department networks and opinion leaders influence teaching at a single research university</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>15</volume>(<issue>2</issue>), Article 15. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.15-08-0170">https://doi.org/10.1187/cbe.15-08-0170</ext-link></mixed-citation></ref>
<ref id="R5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andrews</surname>, <given-names>T. C.</given-names></string-name>, &amp; <string-name><surname>Lemons</surname>, <given-names>P. P.</given-names></string-name></person-group> (<year>2015</year>). <article-title>It&#x2019;s personal: Biology instructors prioritize personal evidence over empirical evidence in teaching decisions</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>14</volume>(<issue>1</issue>), Article 7. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.14-05-0084">https://doi.org/10.1187/cbe.14-05-0084</ext-link></mixed-citation></ref>
<ref id="R6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Apkarian</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Henderson</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Stains</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Raker</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Johnson</surname>, <given-names>E.</given-names></string-name>, &amp; <string-name><surname>Dancy</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2021</year>). <article-title>What really impacts the use of active learning in undergraduate STEM education? Results from a national survey of chemistry, mathematics, and physics instructors</article-title>. <source>PLoS ONE</source>, <volume>16</volume>(<issue>2</issue>), <fpage>e0247544</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1371/journal.pone.0247544">https://doi.org/10.1371/journal.pone.0247544</ext-link></mixed-citation></ref>
<ref id="R7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Arag&#x00F3;n</surname>, <given-names>O. R.</given-names></string-name>, <string-name><surname>Eddy</surname>, <given-names>S. L.</given-names></string-name>, &amp; <string-name><surname>Graham</surname>, <given-names>M. J.</given-names></string-name></person-group> (<year>2018</year>). <article-title>Faculty beliefs about intelligence are related to the adoption of active-learning practices</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>17</volume>(<issue>3</issue>), Article 47. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.17-05-0084">https://doi.org/10.1187/cbe.17-05-0084</ext-link></mixed-citation></ref>
<ref id="R8"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Austin</surname>, <given-names>A. E.</given-names></string-name></person-group> (<year>2011</year>, <month>March</month> <day>1</day>). <source>Promoting evidence-based change in undergraduate science education</source>. <publisher-name>National Academies National Research Council Board on Science Education</publisher-name>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:type="simple" xlink:href="https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_072578.pdf">https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_072578.pdf</ext-link></mixed-citation></ref>
<ref id="R9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bathgate</surname>, <given-names>M. E.</given-names></string-name>, <string-name><surname>Arag&#x00F3;n</surname>, <given-names>O. R.</given-names></string-name>, <string-name><surname>Cavanagh</surname>, <given-names>A. J.</given-names></string-name>, <string-name><surname>Waterhouse</surname>, <given-names>J. K.</given-names></string-name>, <string-name><surname>Frederick</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Graham</surname>, <given-names>M. J.</given-names></string-name></person-group> (<year>2019</year>). <article-title>Perceived supports and evidence-based teaching in college STEM</article-title>. <source>International Journal of STEM Education</source>, <volume>6</volume>(<issue>1</issue>), Article 11. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-019-0166-3">https://doi.org/10.1186/s40594-019-0166-3</ext-link></mixed-citation></ref>
<ref id="R10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Borda</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Schumacher</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Hanley</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Geary</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Warren</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Ipsen</surname>, <given-names>C.</given-names></string-name>, &amp; <string-name><surname>Stredicke</surname>, <given-names>L.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Initial implementation of active learning strategies in large, lecture STEM courses: Lessons learned from a multi-institutional, interdisciplinary STEM faculty development program</article-title>. <source>International Journal of STEM Education</source>, <volume>7</volume>(<issue>1</issue>), Article 4. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-020-0203-2">https://doi.org/10.1186/s40594-020-0203-2</ext-link></mixed-citation></ref>
<ref id="R11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bouwma-Gearhart</surname>, <given-names>J.</given-names></string-name></person-group> (<year>2012</year>). <article-title>Research university STEM faculty members&#x2019; motivation to engage in teaching professional development: Building the choir through an appeal to extrinsic motivation and ego</article-title>. <source>Journal of Science Education and Technology</source>, <volume>21</volume>(<issue>5</issue>), <fpage>558</fpage>&#x2013;<lpage>570</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1007/s10956-011-9346-8">https://doi.org/10.1007/s10956-011-9346-8</ext-link></mixed-citation></ref>
<ref id="R12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Braun</surname>, <given-names>V.</given-names></string-name>, &amp; <string-name><surname>Clarke</surname>, <given-names>V.</given-names></string-name></person-group> (<year>2006</year>). <article-title>Using thematic analysis in psychology</article-title>. <source>Qualitative Research in Psychology</source>, <volume>3</volume>(<issue>2</issue>), <fpage>77</fpage>&#x2013;<lpage>101</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1191/1478088706qp063oa">https://doi.org/10.1191/1478088706qp063oa</ext-link></mixed-citation></ref>
<ref id="R13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Brickman</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Gormally</surname>, <given-names>C.</given-names></string-name>, &amp; <string-name><surname>Martella</surname>, <given-names>A. M.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Making the grade: Using instructional feedback and evaluation to inspire evidence-based teaching</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>15</volume>(<issue>4</issue>), Article 75. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.15-12-0249">https://doi.org/10.1187/cbe.15-12-0249</ext-link></mixed-citation></ref>
<ref id="R14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Brownell</surname>, <given-names>S. E.</given-names></string-name>, &amp; <string-name><surname>Tanner</surname>, <given-names>K. D.</given-names></string-name></person-group> (<year>2012</year>). <article-title>Barriers to faculty pedagogical change: Lack of training, time, incentives, and . . . tensions with professional identity?</article-title> <source>CBE&#x2014;Life Sciences Education</source>, <volume>11</volume>(<issue>4</issue>), <fpage>339</fpage>&#x2013;<lpage>346</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.12-09-0163">https://doi.org/10.1187/cbe.12-09-0163</ext-link></mixed-citation></ref>
<ref id="R15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Callens</surname>, <given-names>M. V.</given-names></string-name>, <string-name><surname>Kelter</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Motschenbacher</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Nyachwaya</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Ladbury</surname>, <given-names>J. L.</given-names></string-name>, &amp; <string-name><surname>Semanko</surname>, <given-names>A. M.</given-names></string-name></person-group> (<year>2019</year>). <article-title>Developing and implementing a campus-wide professional development program: Successes and challenges</article-title>. <source>Journal of College Science Teaching</source>, <volume>49</volume>(<issue>2</issue>), <fpage>68</fpage>&#x2013;<lpage>75</lpage>.</mixed-citation></ref>
<ref id="R16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Canning</surname>, <given-names>E. A.</given-names></string-name>, <string-name><surname>Muenks</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Green</surname>, <given-names>D. J.</given-names></string-name>, &amp; <string-name><surname>Murphy</surname>, <given-names>M. C.</given-names></string-name></person-group> (<year>2019</year>). <article-title>STEM faculty who believe ability is fixed have larger racial achievement gaps and inspire less student motivation in their classes</article-title>. <source>Science Advances</source>, <volume>5</volume>(<issue>2</issue>), <fpage>eaau4734</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/sciadv.aau4734">https://doi.org/10.1126/sciadv.aau4734</ext-link></mixed-citation></ref>
<ref id="R17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Carbone</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Drew</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Ross</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Ye</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Phelan</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Lindsay</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>Cottman</surname>, <given-names>C.</given-names></string-name></person-group> (<year>2019</year>). <article-title>A collegial quality development process for identifying and addressing barriers to improving teaching</article-title>. <source>Higher Education Research &amp; Development</source>, <volume>38</volume>(<issue>7</issue>), <fpage>1356</fpage>&#x2013;<lpage>1370</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1080/07294360.2019.1645644">https://doi.org/10.1080/07294360.2019.1645644</ext-link></mixed-citation></ref>
<ref id="R18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cooper</surname>, <given-names>K. M.</given-names></string-name>, <string-name><surname>Downing</surname>, <given-names>V. R.</given-names></string-name>, &amp; <string-name><surname>Brownell</surname>, <given-names>S. E.</given-names></string-name></person-group> (<year>2018</year>). <article-title>The influence of active learning practices on student anxiety in large-enrollment college science classrooms</article-title>. <source>International Journal of STEM Education</source>, <volume>5</volume>(<issue>1</issue>), Article 23. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-018-0123-6">https://doi.org/10.1186/s40594-018-0123-6</ext-link></mixed-citation></ref>
<ref id="R19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cooper</surname>, <given-names>M. M.</given-names></string-name>, <string-name><surname>Caballero</surname>, <given-names>M. D.</given-names></string-name>, <string-name><surname>Ebert-May</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Fata-Hartley</surname>, <given-names>C. L.</given-names></string-name>, <string-name><surname>Jardeleza</surname>, <given-names>S. E.</given-names></string-name>, <string-name><surname>Krajcik</surname>, <given-names>J. S.</given-names></string-name>, <string-name><surname>Laverty</surname>, <given-names>J. T.</given-names></string-name>, <string-name><surname>Matz</surname>, <given-names>R. L.</given-names></string-name>, <string-name><surname>Posey</surname>, <given-names>L. A.</given-names></string-name>, &amp; <string-name><surname>Underwood</surname>, <given-names>S. M.</given-names></string-name></person-group> (<year>2015</year>). <article-title>Challenge faculty to transform STEM learning</article-title>. <source>Science</source>, <volume>350</volume>(<issue>6258</issue>), <fpage>281</fpage>&#x2013;<lpage>282</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/science.aab0933">https://doi.org/10.1126/science.aab0933</ext-link></mixed-citation></ref>
<ref id="R20"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Dancy</surname>, <given-names>M. H.</given-names></string-name>, &amp; <string-name><surname>Henderson</surname>, <given-names>C.</given-names></string-name></person-group> (<year>2008</year>). <source>Barriers and promises in STEM reform</source>. <publisher-name>National Academies National Research Council Board on Science Education</publisher-name>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:type="simple" xlink:href="https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_072636.pdf">https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_072636.pdf</ext-link></mixed-citation></ref>
<ref id="R21"><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>DeMarais</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Bangera</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Bronson</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Byers</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Davis</surname>, <given-names>W.</given-names></string-name>, <string-name><surname>Linder</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>McFarland</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Offerdahl</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Otto</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Pape-Lindstrom</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Pollock</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Reiness</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Stavrianeas</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Wenderoth</surname>, <given-names>M. P.</given-names></string-name></person-group> (<year>2022</year>). <article-title>What lies beneath? A systems thinking approach to catalyzing department-level curricular and pedagogical reform through the Northwest PULSE workshops</article-title>. <source>Transformative Dialogues: Teaching and Learning Journal</source>, <volume>14</volume>(<issue>3</issue>), Article 3. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:type="simple" xlink:href="https://td.journals.psu.edu/td/article/view/1597">https://td.journals.psu.edu/td/article/view/1597</ext-link></mixed-citation></ref>
<ref id="R22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Denaro</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Kranzfelder</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Owens</surname>, <given-names>M. T.</given-names></string-name>, <string-name><surname>Sato</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Zuckerman</surname>, <given-names>A. L.</given-names></string-name>, <string-name><surname>Hardesty</surname>, <given-names>R. A.</given-names></string-name>, <string-name><surname>Signorini</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Aebersold</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Verma</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Lo</surname>, <given-names>S. M.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Predicting implementation of active learning by tenure-track teaching faculty using robust cluster analysis</article-title>. <source>International Journal of STEM Education</source>, <volume>9</volume>(<issue>1</issue>), Article 49. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-022-00365-9">https://doi.org/10.1186/s40594-022-00365-9</ext-link></mixed-citation></ref>
<ref id="R23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Derting</surname>, <given-names>T. L.</given-names></string-name>, <string-name><surname>Ebert-May</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Henkel</surname>, <given-names>T. P.</given-names></string-name>, <string-name><surname>Maher</surname>, <given-names>J. M.</given-names></string-name>, <string-name><surname>Arnold</surname>, <given-names>B.</given-names></string-name>, &amp; <string-name><surname>Passmore</surname>, <given-names>H. A.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Assessing faculty professional development in STEM higher education: Sustainability of outcomes</article-title>. <source>Science Advances</source>, <volume>2</volume>(<issue>3</issue>), <fpage>e1501422</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/sciadv.1501422">https://doi.org/10.1126/sciadv.1501422</ext-link></mixed-citation></ref>
<ref id="R24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Driessen</surname>, <given-names>E. P.</given-names></string-name>, <string-name><surname>Knight</surname>, <given-names>J. K.</given-names></string-name>, <string-name><surname>Smith</surname>, <given-names>M. K.</given-names></string-name>, &amp; <string-name><surname>Ballen</surname>, <given-names>C. J.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Demystifying the meaning of active learning in postsecondary biology education</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>19</volume>(<issue>4</issue>), Article 52. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.20-04-0068">https://doi.org/10.1187/cbe.20-04-0068</ext-link></mixed-citation></ref>
<ref id="R25"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Dweck</surname>, <given-names>C. S.</given-names></string-name></person-group> (<year>1999</year>). <source>Self-theories: Their role in motivation, personality, and development</source>. <publisher-name>Psychology Press</publisher-name>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.4324/9781315783048">https://doi.org/10.4324/9781315783048</ext-link></mixed-citation></ref>
<ref id="R26"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ebert-May</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Derting</surname>, <given-names>T. L.</given-names></string-name>, <string-name><surname>Hodder</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Momsen</surname>, <given-names>J. L.</given-names></string-name>, <string-name><surname>Long</surname>, <given-names>T. M.</given-names></string-name>, &amp; <string-name><surname>Jardeleza</surname>, <given-names>S. E.</given-names></string-name></person-group> (<year>2011</year>). <article-title>What we say is not what we do: Effective evaluation of faculty professional development programs</article-title>. <source>BioScience</source>, <volume>61</volume>(<issue>7</issue>), <fpage>550</fpage>&#x2013;<lpage>558</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1525/bio.2011.61.7.9">https://doi.org/10.1525/bio.2011.61.7.9</ext-link></mixed-citation></ref>
<ref id="R27"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Eddy</surname>, <given-names>S. L.</given-names></string-name>, <string-name><surname>Converse</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Wenderoth</surname>, <given-names>M. P.</given-names></string-name></person-group> (<year>2015</year>). <article-title>PORTAAL: A classroom observation tool assessing evidence-based teaching practices for active learning in large science, technology, engineering, and mathematics classes</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>14</volume>(<issue>2</issue>), Article 23. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.14-06-0095">https://doi.org/10.1187/cbe.14-06-0095</ext-link></mixed-citation></ref>
<ref id="R28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Freeman</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Eddy</surname>, <given-names>S. L.</given-names></string-name>, <string-name><surname>McDonough</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Smith</surname>, <given-names>M. K.</given-names></string-name>, <string-name><surname>Okoroafor</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Jordt</surname>, <given-names>H.</given-names></string-name>, &amp; <string-name><surname>Wenderoth</surname>, <given-names>M. P.</given-names></string-name></person-group> (<year>2014</year>). <article-title>Active learning increases student performance in science, engineering, and mathematics</article-title>. <source>Proceedings of the National Academy of Sciences</source>, <volume>111</volume>(<issue>23</issue>), <fpage>8410</fpage>&#x2013;<lpage>8415</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1073/pnas.1319030111">https://doi.org/10.1073/pnas.1319030111</ext-link></mixed-citation></ref>
<ref id="R29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gormally</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Evans</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Brickman</surname>, <given-names>P.</given-names></string-name></person-group> (<year>2014</year>). <article-title>Feedback about teaching in higher ed: Neglected opportunities to promote change</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>13</volume>(<issue>2</issue>), <fpage>187</fpage>&#x2013;<lpage>199</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.13-12-0235">https://doi.org/10.1187/cbe.13-12-0235</ext-link></mixed-citation></ref>
<ref id="R30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Handelsman</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Ebert-May</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Beichner</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Bruns</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Chang</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>DeHaan</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Gentile</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Lauffer</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Stewart</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Tilghman</surname>, <given-names>S. M.</given-names></string-name>, &amp; <string-name><surname>Wood</surname>, <given-names>W. B.</given-names></string-name></person-group> (<year>2004</year>). <article-title>Scientific teaching</article-title>. <source>Science</source>, <volume>304</volume>(<issue>5670</issue>), <fpage>521</fpage>&#x2013;<lpage>522</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/science.1096022">https://doi.org/10.1126/science.1096022</ext-link></mixed-citation></ref>
<ref id="R31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Harvey</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Eshleman</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Koo</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Smith</surname>, <given-names>K. G.</given-names></string-name>, <string-name><surname>Paradise</surname>, <given-names>C. J.</given-names></string-name>, &amp; <string-name><surname>Campbell</surname>, <given-names>A. M.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Encouragement for faculty to implement <italic>Vision and Change</italic></article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>15</volume>(<issue>4</issue>), <fpage>es7</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.16-03-0127">https://doi.org/10.1187/cbe.16-03-0127</ext-link></mixed-citation></ref>
<ref id="R32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Henderson</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Beach</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Finkelstein</surname>, <given-names>N.</given-names></string-name></person-group> (<year>2011</year>). <article-title>Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature</article-title>. <source>Journal of Research in Science Teaching</source>, <volume>48</volume>(<issue>8</issue>), <fpage>952</fpage>&#x2013;<lpage>984</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1002/tea.20439">https://doi.org/10.1002/tea.20439</ext-link></mixed-citation></ref>
<ref id="R33"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Henderson</surname>, <given-names>C.</given-names></string-name>, &amp; <string-name><surname>Dancy</surname>, <given-names>M. H.</given-names></string-name></person-group> (<year>2007</year>). <article-title>Barriers to the use of research-based instructional strategies: The influence of both individual and situational characteristics</article-title>. <source>Physical Review Special Topics&#x2014;Physics Education Research</source>, <volume>3</volume>(<issue>2</issue>), <fpage>020102</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1103/PhysRevSTPER.3.020102">https://doi.org/10.1103/PhysRevSTPER.3.020102</ext-link></mixed-citation></ref>
<ref id="R34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Herman</surname>, <given-names>G. L.</given-names></string-name>, <string-name><surname>Greene</surname>, <given-names>J. C.</given-names></string-name>, <string-name><surname>Hahn</surname>, <given-names>L. D.</given-names></string-name>, <string-name><surname>Mestre</surname>, <given-names>J. P.</given-names></string-name>, <string-name><surname>Tomkin</surname>, <given-names>J. H.</given-names></string-name>, &amp; <string-name><surname>West</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2018</year>). <article-title>Changing the teaching culture in introductory STEM courses at a large research university</article-title>. <source>Journal of College Science Teaching</source>, <volume>47</volume>(<issue>6</issue>), <fpage>32</fpage>&#x2013;<lpage>38</lpage>.</mixed-citation></ref>
<ref id="R35"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Hjelmstad</surname>, <given-names>K. L.</given-names></string-name>, <string-name><surname>Hjelmstad</surname>, <given-names>K. D.</given-names></string-name>, <string-name><surname>Krause</surname>, <given-names>S. J.</given-names></string-name>, <string-name><surname>Mayled</surname>, <given-names>L. H.</given-names></string-name>, <string-name><surname>Judson</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Ross</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Culbertson</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Middleton</surname>, <given-names>J. A.</given-names></string-name>, <string-name><surname>Ankeny</surname>, <given-names>C. J.</given-names></string-name>, &amp; <string-name><surname>Chen</surname>, <given-names>Y.-C.</given-names></string-name></person-group> (<year>2018</year>, <month>June</month> <day>24</day>&#x2013;<day>27</day>). <source>Facilitating change in instructional practice in a faculty development program through classroom observations and formative feedback coaching [Paper presentation]</source>. <publisher-name>ASEE Annual Conference and Exposition</publisher-name>, <publisher-loc>Salt Lake City, Utah, United States</publisher-loc>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.18260/1-2--30505">https://doi.org/10.18260/1-2--30505</ext-link></mixed-citation></ref>
<ref id="R36"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jackson</surname>, <given-names>M. A.</given-names></string-name>, <string-name><surname>Moon</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Doherty</surname>, <given-names>J. H.</given-names></string-name>, &amp; <string-name><surname>Wenderoth</surname>, <given-names>M. P.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Which evidence-based teaching practices change over time? Results from a university-wide STEM faculty development program</article-title>. <source>International Journal of STEM Education</source>, <volume>9</volume>(<issue>1</issue>), Article 22. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-022-00340-4">https://doi.org/10.1186/s40594-022-00340-4</ext-link></mixed-citation></ref>
<ref id="R37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jacobson</surname>, <given-names>W.</given-names></string-name>, &amp; <string-name><surname>Cole</surname>, <given-names>R.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Motivations and obstacles influencing faculty engagement in adopting teaching innovations</article-title>. <source>To Improve the Academy: A Journal of Educational Development</source>, <volume>39</volume>(<issue>1</issue>). <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.3998/tia.17063888.0039.106">https://doi.org/10.3998/tia.17063888.0039.106</ext-link></mixed-citation></ref>
<ref id="R38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kezar</surname>, <given-names>A.</given-names></string-name></person-group> (<year>2014</year>). <article-title>Higher education change and social networks: A review of research</article-title>. <source>The Journal of Higher Education</source>, <volume>85</volume>(<issue>1</issue>), <fpage>91</fpage>&#x2013;<lpage>125</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1353/jhe.2014.0003">https://doi.org/10.1353/jhe.2014.0003</ext-link></mixed-citation></ref>
<ref id="R39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kim</surname>, <given-names>A. M.</given-names></string-name>, <string-name><surname>Speed</surname>, <given-names>C. J.</given-names></string-name>, &amp; <string-name><surname>Macaulay</surname>, <given-names>J. O.</given-names></string-name></person-group> (<year>2019</year>). <article-title>Barriers and strategies: Implementing active learning in biomedical science lectures</article-title>. <source>Biochemistry and Molecular Biology Education</source>, <volume>47</volume>(<issue>1</issue>), <fpage>29</fpage>&#x2013;<lpage>40</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1002/bmb.21190">https://doi.org/10.1002/bmb.21190</ext-link></mixed-citation></ref>
<ref id="R40"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Knight</surname>, <given-names>J. K.</given-names></string-name>, <string-name><surname>Wise</surname>, <given-names>S. B.</given-names></string-name>, &amp; <string-name><surname>Sieke</surname>, <given-names>S.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Group random call can positively affect student in-class clicker discussions</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>15</volume>(<issue>4</issue>), Article 56. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.16-02-0109">https://doi.org/10.1187/cbe.16-02-0109</ext-link></mixed-citation></ref>
<ref id="R41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kwasnicka</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Dombrowski</surname>, <given-names>S. U.</given-names></string-name>, <string-name><surname>White</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Sniehotta</surname>, <given-names>F. F.</given-names></string-name></person-group> (<year>2015</year>). <article-title>Data-prompted interviews: Using individual ecological data to stimulate narratives and explore meanings</article-title>. <source>Health Psychology</source>, <volume>34</volume>(<issue>12</issue>), <fpage>1191</fpage>&#x2013;<lpage>1194</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1037/hea0000234">https://doi.org/10.1037/hea0000234</ext-link></mixed-citation></ref>
<ref id="R42"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lane</surname>, <given-names>A. K.</given-names></string-name>, <string-name><surname>Skvoretz</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Ziker</surname>, <given-names>J. P.</given-names></string-name>, <string-name><surname>Couch</surname>, <given-names>B. A.</given-names></string-name>, <string-name><surname>Earl</surname>, <given-names>B.</given-names></string-name>, <string-name><surname>Lewis</surname>, <given-names>J. E.</given-names></string-name>, <string-name><surname>McAlpin</surname>, <given-names>J. D.</given-names></string-name>, <string-name><surname>Prevost</surname>, <given-names>L. B.</given-names></string-name>, <string-name><surname>Shadle</surname>, <given-names>S. E.</given-names></string-name>, &amp; <string-name><surname>Stains</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2019</year>). <article-title>Investigating how faculty social networks and peer influence relate to knowledge and use of evidence-based teaching practices</article-title>. <source>International Journal of STEM Education</source>, <volume>6</volume>(<issue>1</issue>), Article 28. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-019-0182-3">https://doi.org/10.1186/s40594-019-0182-3</ext-link></mixed-citation></ref>
<ref id="R43"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lombardi</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Shipley</surname>, <given-names>T. F.</given-names></string-name></person-group>, <person-group person-group-type="author"><collab>Astronomy Team, Biology Team</collab></person-group>, <person-group person-group-type="author"><collab>Chemistry Team, Engineering Team, Geography Team, Geoscience Team, &amp; Physics Team</collab></person-group>. (<year>2021</year>). <article-title>The curious construct of active learning</article-title>. <source>Psychological Science in the Public Interest</source>, <volume>22</volume>(<issue>1</issue>), <fpage>8</fpage>&#x2013;<lpage>43</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1177/1529100620973974">https://doi.org/10.1177/1529100620973974</ext-link></mixed-citation></ref>
<ref id="R44"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Macaluso</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Amaro-Jim&#x00E9;nez</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Patterson</surname>, <given-names>O. K.</given-names></string-name>, <string-name><surname>Martinez-Cosio</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Veerabathina</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Clark</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>Luken-Sutton</surname>, <given-names>J.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Engaging faculty in student success: The promise of active learning in STEM faculty in professional development</article-title>. <source>College Teaching</source>, <volume>69</volume>(<issue>2</issue>), <fpage>113</fpage>&#x2013;<lpage>119</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1080/87567555.2020.1837063">https://doi.org/10.1080/87567555.2020.1837063</ext-link></mixed-citation></ref>
<ref id="R45"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Manduca</surname>, <given-names>C. A.</given-names></string-name>, <string-name><surname>Iverson</surname>, <given-names>E. R.</given-names></string-name>, <string-name><surname>Luxenberg</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Macdonald</surname>, <given-names>R. H.</given-names></string-name>, <string-name><surname>McConnell</surname>, <given-names>D. A.</given-names></string-name>, <string-name><surname>Mogk</surname>, <given-names>D. W.</given-names></string-name>, &amp; <string-name><surname>Tewksbury</surname>, <given-names>B. J.</given-names></string-name></person-group> (<year>2017</year>). <article-title>Improving undergraduate STEM education: The efficacy of discipline-based professional development</article-title>. <source>Science Advances</source>, <volume>3</volume>(<issue>2</issue>), <fpage>e1600193</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/sciadv.1600193">https://doi.org/10.1126/sciadv.1600193</ext-link></mixed-citation></ref>
<ref id="R46"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Marbach-Ad</surname>, <given-names>G.</given-names></string-name>, &amp; <string-name><surname>Rietschel</surname>, <given-names>C. H.</given-names></string-name></person-group> (<year>2016</year>). <article-title>A case study documenting the process by which biology instructors transition from teacher-centered to learner-centered teaching</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>15</volume>(<issue>4</issue>), Article 62. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.16-06-0196">https://doi.org/10.1187/cbe.16-06-0196</ext-link></mixed-citation></ref>
<ref id="R47"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>McConnell</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Montplaisir</surname>, <given-names>L.</given-names></string-name>, &amp; <string-name><surname>Offerdahl</surname>, <given-names>E.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Meeting the conditions for diffusion of teaching innovations in a university STEM department</article-title>. <source>Journal for STEM Education Research</source>, <volume>3</volume>(<issue>1</issue>), <fpage>43</fpage>&#x2013;<lpage>68</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1007/s41979-019-00023-w">https://doi.org/10.1007/s41979-019-00023-w</ext-link></mixed-citation></ref>
<ref id="R48"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Metzger</surname>, <given-names>K. J.</given-names></string-name>, &amp; <string-name><surname>Langley</surname>, <given-names>D.</given-names></string-name></person-group> (<year>2020</year>). <article-title>The room itself is not enough: Student engagement in active learning classrooms</article-title>. <source>College Teaching</source>, <volume>68</volume>(<issue>3</issue>), <fpage>150</fpage>&#x2013;<lpage>160</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1080/87567555.2020.1768357">https://doi.org/10.1080/87567555.2020.1768357</ext-link></mixed-citation></ref>
<ref id="R49"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Metzger</surname>, <given-names>K. J.</given-names></string-name>, &amp; <string-name><surname>Via</surname>, <given-names>Z.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Warming up the cold call: Encouraging classroom inclusion by considering warm- &amp; cold-calling techniques</article-title>. <source>The American Biology Teacher</source>, <volume>84</volume>(<issue>6</issue>), <fpage>342</fpage>&#x2013;<lpage>346</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1525/abt.2022.84.6.342">https://doi.org/10.1525/abt.2022.84.6.342</ext-link></mixed-citation></ref>
<ref id="R50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pfund</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Miller</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Brenner</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Bruns</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Chang</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Ebert-May</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Fagen</surname>, <given-names>A. P.</given-names></string-name>, <string-name><surname>Gentile</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Gossens</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Khan</surname>, <given-names>I. M.</given-names></string-name>, <string-name><surname>Labov</surname>, <given-names>J. B.</given-names></string-name>, <string-name><surname>Pribbenow</surname>, <given-names>C. M.</given-names></string-name>, <string-name><surname>Susman</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Tong</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Wright</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Yuan</surname>, <given-names>R. T.</given-names></string-name>, <string-name><surname>Wood</surname>, <given-names>W. B.</given-names></string-name>, &amp; <string-name><surname>Handelsman</surname>, <given-names>J.</given-names></string-name></person-group> (<year>2009</year>). <article-title>Summer institute to improve university science teaching</article-title>. <source>Science</source>, <volume>324</volume>(<issue>5926</issue>), <fpage>470</fpage>&#x2013;<lpage>471</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/science.1170015">https://doi.org/10.1126/science.1170015</ext-link></mixed-citation></ref>
<ref id="R51"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Prince</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2004</year>). <article-title>Does active learning work? A review of the research</article-title>. <source>Journal of Engineering Education</source>, <volume>93</volume>(<issue>3</issue>), <fpage>223</fpage>&#x2013;<lpage>231</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1002/j.2168-9830.2004.tb00809.x">https://doi.org/10.1002/j.2168-9830.2004.tb00809.x</ext-link></mixed-citation></ref>
<ref id="R52"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ruiz-Primo</surname>, <given-names>M. A.</given-names></string-name>, <string-name><surname>Briggs</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Iverson</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Talbot</surname>, <given-names>R.</given-names></string-name>, &amp; <string-name><surname>Shepard</surname>, <given-names>L. A.</given-names></string-name></person-group> (<year>2011</year>). <article-title>Impact of undergraduate science course innovations on learning</article-title>. <source>Science</source>, <volume>331</volume>(<issue>6022</issue>), <fpage>1269</fpage>&#x2013;<lpage>1270</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/science.1198976">https://doi.org/10.1126/science.1198976</ext-link></mixed-citation></ref>
<ref id="R53"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rutz</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Condon</surname>, <given-names>W.</given-names></string-name>, <string-name><surname>Iverson</surname>, <given-names>E. R.</given-names></string-name>, <string-name><surname>Manduca</surname>, <given-names>C. A.</given-names></string-name>, &amp; <string-name><surname>Willett</surname>, <given-names>G.</given-names></string-name></person-group> (<year>2012</year>). <article-title>Faculty professional development and student learning: What is the relationship?</article-title> <source>Change: The Magazine of Higher Learning</source>, <volume>44</volume>(<issue>3</issue>), <fpage>40</fpage>&#x2013;<lpage>47</lpage>.</mixed-citation></ref>
<ref id="R54"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Schuster</surname>, <given-names>J. H.</given-names></string-name>, &amp; <string-name><surname>Finkelstein</surname>, <given-names>M. J.</given-names></string-name></person-group> (<year>2006</year>). <source>The American faculty: The restructuring of academic work and careers</source>. <publisher-name>Johns Hopkins University Press</publisher-name>.</mixed-citation></ref>
<ref id="R55"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Shadle</surname>, <given-names>S. E.</given-names></string-name>, <string-name><surname>Marker</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Earl</surname>, <given-names>B.</given-names></string-name></person-group> (<year>2017</year>). <article-title>Faculty drivers and barriers: Laying the groundwork for undergraduate STEM education reform in academic departments</article-title>. <source>International Journal of STEM Education</source>, <volume>4</volume>(<issue>1</issue>), Article 8. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-017-0062-7">https://doi.org/10.1186/s40594-017-0062-7</ext-link></mixed-citation></ref>
<ref id="R56"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stains</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Harshman</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Barker</surname>, <given-names>M. K.</given-names></string-name>, <string-name><surname>Chasteen</surname>, <given-names>S. V.</given-names></string-name>, <string-name><surname>Cole</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>DeChenne-Peters</surname>, <given-names>S. E.</given-names></string-name>, <string-name><surname>Eagan</surname>, <given-names>M. K.</given-names></string-name>, <string-name><prefix>Jr.</prefix>, <surname>Esson</surname>, <given-names>J. M.</given-names></string-name>, <string-name><surname>Knight</surname>, <given-names>J. K.</given-names></string-name>, <string-name><surname>Laski</surname>, <given-names>F. A.</given-names></string-name>, <string-name><surname>Levis-Fitzgerald</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Lee</surname>, <given-names>C. J.</given-names></string-name>, <string-name><surname>Lo</surname>, <given-names>S. M.</given-names></string-name>, <string-name><surname>McDonnell</surname>, <given-names>L. M.</given-names></string-name>, <string-name><surname>McKay</surname>, <given-names>T. A.</given-names></string-name>, <string-name><surname>Michelotti</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Musgrove</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Palmer</surname>, <given-names>M. S.</given-names></string-name>, <string-name><surname>Plank</surname>, <given-names>K. M.</given-names></string-name>, . . . <string-name><surname>Young</surname>, <given-names>A. M.</given-names></string-name></person-group> (<year>2018</year>). <article-title>Anatomy of STEM teaching in North American universities</article-title>. <source>Science</source>, <volume>359</volume>(<issue>6383</issue>), <fpage>1468</fpage>&#x2013;<lpage>1470</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1126/science.aap8892">https://doi.org/10.1126/science.aap8892</ext-link></mixed-citation></ref>
<ref id="R57"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sturtevant</surname>, <given-names>H.</given-names></string-name>, &amp; <string-name><surname>Wheeler</surname>, <given-names>L.</given-names></string-name></person-group> (<year>2019</year>). <article-title>The STEM Faculty Instructional Barriers and Identity Survey (FIBIS): Development and exploratory results</article-title>. <source>International Journal of STEM Education</source>, <volume>6</volume>(<issue>1</issue>), Article 35. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-019-0185-0">https://doi.org/10.1186/s40594-019-0185-0</ext-link></mixed-citation></ref>
<ref id="R58"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Theobald</surname>, <given-names>E. J.</given-names></string-name>, <string-name><surname>Hill</surname>, <given-names>M. J.</given-names></string-name>, <string-name><surname>Tran</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Agrawal</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Arroyo</surname>, <given-names>E. N.</given-names></string-name>, <string-name><surname>Behling</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Chambwe</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Cintr&#x00F3;n</surname>, <given-names>D. L.</given-names></string-name>, <string-name><surname>Cooper</surname>, <given-names>J. D.</given-names></string-name>, <string-name><surname>Dunster</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Grummer</surname>, <given-names>J. A.</given-names></string-name>, <string-name><surname>Hennessey</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Hsiao</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Iranon</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Jones</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Jordt</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Keller</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Lacey</surname>, <given-names>M. E.</given-names></string-name>, <string-name><surname>Littlefield</surname>, <given-names>C. E.</given-names></string-name>, <string-name><surname>&#x2026; Freeman</surname>, <given-names>S.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math</article-title>. <source>Proceedings of the National Academy of Sciences</source>, <volume>117</volume>(<issue>12</issue>), <fpage>6476</fpage>&#x2013;<lpage>6483</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1073/pnas.1916903117">https://doi.org/10.1073/pnas.1916903117</ext-link></mixed-citation></ref>
<ref id="R59"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Turpen</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Dancy</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Henderson</surname>, <given-names>C.</given-names></string-name></person-group> (<year>2016</year>). <article-title>Perceived affordances and constraints regarding instructors&#x2019; use of Peer Instruction: Implications for promoting instructional change</article-title>. <source>Physical Review Physics Education Research</source>, <volume>12</volume>(<issue>1</issue>), <fpage>010116</fpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1103/physrevphyseducres.12.010116">https://doi.org/10.1103/physrevphyseducres.12.010116</ext-link></mixed-citation></ref>
<ref id="R60"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Viskupic</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Ryker</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Teasdale</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Manduca</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Iverson</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Farthing</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Bruckner</surname>, <given-names>M. Z.</given-names></string-name>, &amp; <string-name><surname>McFadden</surname>, <given-names>R.</given-names></string-name></person-group> (<year>2019</year>). <article-title>Classroom observations indicate the positive impacts of discipline-based professional development</article-title>. <source>Journal for STEM Education Research</source>, <volume>2</volume>(<issue>2</issue>), <fpage>201</fpage>&#x2013;<lpage>228</lpage>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1007/s41979-019-00015-w">https://doi.org/10.1007/s41979-019-00015-w</ext-link></mixed-citation></ref>
<ref id="R61"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Vygotsky</surname>, <given-names>L. S.</given-names></string-name></person-group> (<year>1978</year>). <source>The development of higher psychological processes</source> (<person-group person-group-type="editor"><string-name><given-names>M.</given-names> <surname>Cole</surname></string-name>, <string-name><given-names>V.</given-names> <surname>John-Steiner</surname></string-name>, <string-name><given-names>S.</given-names> <surname>Scribner</surname></string-name>, &amp; <string-name><given-names>E.</given-names> <surname>Souberman</surname></string-name></person-group>, Eds.). <publisher-name>Harvard University Press</publisher-name>.</mixed-citation></ref>
<ref id="R62"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Waugh</surname>, <given-names>A. H.</given-names></string-name>, &amp; <string-name><surname>Andrews</surname>, <given-names>T. C.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Diving into the details: Constructing a framework of random call components</article-title>. <source>CBE&#x2014;Life Sciences Education</source>, <volume>19</volume>(<issue>2</issue>), Article 14. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1187/cbe.19-07-0130">https://doi.org/10.1187/cbe.19-07-0130</ext-link></mixed-citation></ref>
<ref id="R63"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wlodarsky</surname>, <given-names>R.</given-names></string-name></person-group> (<year>2005</year>). <article-title>The professoriate: Transforming teaching practices through critical reflection and dialogue</article-title>. <source>Teaching and Learning: The Journal of Natural Inquiry &amp; Reflective Practice</source>, <volume>19</volume>(<issue>3</issue>), <fpage>156</fpage>&#x2013;<lpage>172</lpage>.</mixed-citation></ref>
<ref id="R64"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Wood</surname>, <given-names>A. K.</given-names></string-name>, <string-name><surname>Christie</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>MacKay</surname>, <given-names>J. R. D.</given-names></string-name>, &amp; <string-name><surname>Kinnear</surname>, <given-names>G.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Using data about classroom practices to stimulate significant conversations and aid reflection</article-title>. <source>International Journal for Academic Development</source>. <publisher-name>Advance online publication</publisher-name>. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1080/1360144X.2022.2103817">https://doi.org/10.1080/1360144X.2022.2103817</ext-link></mixed-citation></ref>
<ref id="R65"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Yik</surname>, <given-names>B. J.</given-names></string-name>, <string-name><surname>Raker</surname>, <given-names>J. R.</given-names></string-name>, <string-name><surname>Apkarian</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Stains</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Henderson</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Dancy</surname>, <given-names>M. H.</given-names></string-name>, &amp; <string-name><surname>Johnson</surname>, <given-names>E.</given-names></string-name></person-group> (<year>2022</year>). <article-title>Evaluating the impact of malleable factors on percent time lecturing in gateway chemistry, mathematics, and physics courses</article-title>. <source>International Journal of STEM Education</source>, <volume>9</volume>(<issue>1</issue>), Article 15. <ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="doi" xlink:type="simple" xlink:href="https://doi.org/10.1186/s40594-022-00333-3">https://doi.org/10.1186/s40594-022-00333-3</ext-link></mixed-citation></ref></ref-list>
<app-group>
<app id="app1">
<label>Appendix A.</label><title>Interview Questions</title>
<list list-type="bullet">
<title>Background information:</title>
<list-item><p>How many years have you been teaching at this institution or elsewhere?</p></list-item>
<list-item><p>Have you done any professional development for teaching prior to CAUSE?</p></list-item>
</list>
<list list-type="bullet">
<title>General impressions:</title>
<list-item><p>What was your primary motivation for enrolling in CAUSE?</p></list-item>
<list-item><p>What was the most valuable thing you learned from CAUSE meetings?</p></list-item>
<list-item><p>How would you describe the community aspect of the meetings?</p></list-item>
<list-item><p>Did you talk to faculty in your department about CAUSE outside of meetings (either members of CAUSE or not)?
<list list-type="bullet">
<list-item><p>What kind of conversations did this elicit?</p></list-item>
</list></p></list-item>
</list>
<list list-type="bullet">
<title>Teaching reflection:</title>
<list-item><p>Were you using any evidence-based teaching practices prior to enrolling in CAUSE?
<list list-type="bullet">
<list-item><p>What kind of strategies were you using?</p></list-item>
<list-item><p>Were there other teaching strategies that you had heard of or were familiar with?</p></list-item>
</list></p></list-item>
<list-item><p>When you thought about implementing evidence-based teaching, what were your barriers and benefits?</p></list-item>
<list-item><p>Show bar and line graphs
<list list-type="bullet">
<list-item><p>Talk about meaningful patterns over time</p></list-item>
<list-item><p>Why did you change your teaching in this way?</p></list-item>
</list></p></list-item>
<list-item><p>How did the students react to evidence-based teaching?
<list list-type="bullet">
<list-item><p>Did you have any pushback?</p></list-item>
</list></p></list-item>
</list>
<list list-type="bullet">
<title>Feedback:</title>
<list-item><p>What are the most important things for your students to get out of your course? Is this varied among your courses?</p></list-item>
<list-item><p>What was the thing that most supported your implementation of active learning?</p></list-item>
<list-item><p>What additional things could CAUSE have offered to support your implementation of active learning?</p></list-item>
<list-item><p>Do you have specific suggestions for the CAUSE program?</p></list-item>
<list-item><p>What support would you have liked to receive in addition to the meetings, feedback on teaching practices, and student exam performance?</p></list-item>
</list>
</app>
<app id="app2">
<label>Appendix B</label>
<title>PORTAAL Practices</title>
<table-wrap id="A1" position="float" orientation="portrait">
<table frame="hsides" rules="groups">
<col align="left" valign="middle" />
<col align="left" valign="middle" />
<col align="left" valign="middle" />
<thead>
<tr>
<th align="left" valign="top"><p>PORTAAL code name</p></th>
<th align="center" valign="top"><p>PORTAAL practice</p></th>
<th align="center" valign="top"><p>Instance (I) / duration (D)</p></th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top"><p>Act_Q</p></td>
<td align="left" valign="top"><p>Student asks a question during an activity</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Activities</p></td>
<td align="left" valign="top"><p>Individual or group activities in class</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Alone</p></td>
<td align="left" valign="top"><p>Students work alone</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Alt_Ans</p></td>
<td align="left" valign="top"><p>Providing alternative answers to a question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>DB</p></td>
<td align="left" valign="top"><p>Debrief of a question</p></td>
<td align="center" valign="top"><p>D</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>HB</p></td>
<td align="left" valign="top"><p>High Bloom&#x2019;s in-class activities</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Ins_Ans</p></td>
<td align="left" valign="top"><p>Instructor provides answer to a question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Ins_Exp</p></td>
<td align="left" valign="top"><p>Instructor explains the answer to a question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>MCQ</p></td>
<td align="left" valign="top"><p>Students work on a multiple choice question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Pos_FB</p></td>
<td align="left" valign="top"><p>Instructor use of positive feedback to students</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Prom_Log</p></td>
<td align="left" valign="top"><p>Instructors prompting logic from students</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>RC_Ans</p></td>
<td align="left" valign="top"><p>Instructors randomly call on students for answers</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>RC_Exp</p></td>
<td align="left" valign="top"><p>Randomly called students explain answers</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>SA</p></td>
<td align="left" valign="top"><p>Students work on short answer question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>SG</p></td>
<td align="left" valign="top"><p>Students work in small groups</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Spon_Q</p></td>
<td align="left" valign="top"><p>Student questions outside of activity (spontaneous)</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>ST_DB</p></td>
<td align="left" valign="top"><p>Student time in debrief of a question</p></td>
<td align="center" valign="top"><p>D</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Total_Q</p></td>
<td align="left" valign="top"><p>Total student questions in class</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>TST</p></td>
<td align="left" valign="top"><p>Total student time during class</p></td>
<td align="center" valign="top"><p>D</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Vol_Ans</p></td>
<td align="left" valign="top"><p>Student volunteer answers a question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Vol_Exp</p></td>
<td align="left" valign="top"><p>Student volunteer explains answer to a question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>Voting</p></td>
<td align="left" valign="top"><p>Students use a voting system to share answers</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
<tr>
<td align="left" valign="top"><p>WC_Ans</p></td>
<td align="left" valign="top"><p>Whole class answers a question</p></td>
<td align="center" valign="top"><p>I</p></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib>Unit of instance: <italic>n</italic> times. Unit of duration: minutes.</attrib>
</table-wrap-foot>
</table-wrap>
</app>
</app-group>
</back>
</article>
