Beyond the basics: a detailed conceptual framework of integrated STEM

Abstract

Given the large variation in conceptualizations and enactment of K^− 12 integrated STEM, this paper puts forth a detailed conceptual framework for K^− 12 integrated STEM education that can be used by researchers, educators, and curriculum developers as a common vision. Our framework builds upon the extant integrated STEM literature to describe seven central characteristics of integrated STEM: (a) centrality of engineering design, (b) driven by authentic problems, (c) context integration, (d) content integration, (e) STEM practices, (f) twenty-first century skills, and (g) informing students about STEM careers. Our integrated STEM framework is intended to provide more specific guidance to educators and support integrated STEM research, which has been impeded by the lack of a deep conceptualization of the characteristics of integrated STEM. The lack of a detailed integrated STEM framework thus far has prevented the field from systematically collecting data in classrooms to understand the nature and quality of integrated STEM instruction; this delays research related to the impact on student outcomes, including academic achievement and affect. With the framework presented here, we lay the groundwork for researchers to explore the impact of specific aspects of integrated STEM or the overall quality of integrated STEM instruction on student outcomes.

Beyond the basics: a detailed conceptual framework of integrated STEM

Since the term “STEM” (Science-Technology-Engineering-Mathematics) was coined in 2001, there have been numerous efforts to improve K^− 12 STEM teaching and learning around the world (Freeman et al., 2014). With the release of STEM policy documents across the globe (e.g., Australian Curriculum, Assessment, and Reporting Authority, 2016; European Commission, 2015; Hong, 2017; National Research Council (NRC), 2012), the implementation of STEM in K^− 12 education has focused on interdisciplinary or integrated instruction, commonly referred to as “integrated STEM education”, rather than separate disciplinary approaches to the teaching of science, technology, engineering, and mathematics. While integrated STEM education is well established through national and international policy documents, disagreement on models and effective approaches for integrated STEM instruction continues to be pervasive and problematic (Moore et al., 2020). Sgro et al. (2020) argue that, in essence, integrated STEM is “whatever someone decides it means” and that the large variation across integrated STEM curricula suggests a need for “greater clarity about not only what constitutes STEM education, but how educators as a whole conceptualize STEM and the process of integration” (p. 185). In response, this paper puts forth a detailed conceptual framework for K^− 12 integrated STEM education that can be used by researchers, educators, and curriculum developers as a common vision.

Various broad definitions of integrated STEM education exist in the literature and policy documents. For example, Moore, Stohlmann, and colleagues (2014) defined integrated STEM education as “an effort to combine some or all of the four disciplines of science, technology, engineering, and mathematics into one class, unit, or lesson that is based on connections between the subjects and real-world problems” (p. 38). Similarly, Kelley and Knowles (2016) defined integrated STEM as “the approach to teaching the STEM content of two or more STEM domains, bound by STEM practices within an authentic context for the purpose of connecting these subjects to enhance student learning” (p. 3). Common across almost all definitions is the use of real-world contexts to both contextualize learning and motivate student engagement (e.g., Kelley & Knowles, 2016; Kloser et al., 2018; National Academy of Engineering (NAE) and NRC, 2014). While some researchers argue for integration across all four of the STEM disciplines (e.g., Burrows et al., 2018; Chandan et al., 2019), others call for the integration of at least two of the STEM disciplines (e.g., Moore et al., 2020). Given the prominence of engineering within STEM policy documents (e.g., NRC, 2012; NGSS Lead States, 2013), many approaches to integrated STEM specifically include an engineering context or engineering design problem as the context for learning (e.g., Berland & Steingut, 2016; Mehalik et al., 2008; Moore, Stohlmann, et al., 2014). Indeed, Nathan et al. (2013) argue, the ideals of STEM integration are not likely to be fulfilled by the integration of any pair of STEM fields … the pairing of technology with engineering (the design sciences) is insufficient to satisfy STEM integration, and also excludes pairing science and math (the natural sciences). Rather, it calls for STEM integration that spans the design and natural sciences. (p. 82).

In addition to the centrality of engineering and connection to real-world problems, other aspects of integrated STEM on which there is consensus in the literature include: (a) the use of student-centered pedagogies (e.g., Asunda & Mativo, 2017; Johnson et al., 2016; Thibaut et al., 2018), (b) supporting the development of twenty-first century skills such as creativity, collaboration, communication, and critical thinking (e.g., Sias et al., 2017; Wang & Knoblach, 2018), and (c) connections between STEM disciplines should be made explicit to students (e.g., English, 2016; Kelley & Knowles, 2016; NAE and NRC, 2014). While there is consensus on these aspects as being central to broad definitions of STEM, the literature does not provide detail on how these aspects should be operationalized for quality implementation of integrated STEM education in K^− 12 classrooms.

While integrated STEM education is not restricted to implementation in science classrooms, in the United States there exists a policy mandate to K^− 12 science teachers through the Framework for K^− 12 Science Education (NRC, 2012) and the Next Generation Science Standards (NGSS Lead States, 2013) and consequently the preponderance of integrated STEM research occurs within the context of science education (Takeuchi et al., 2020). Thus, in this paper we specifically focus on STEM integration within K^− 12 science classrooms. It is also important to state that integrated STEM is not promoted to the exclusion of other important learning goals within a K^− 12 science classroom. Plainly stated, not all science content can and should be taught using an integrated STEM approach; attention should also be paid to the nature of science and engaging students in learning science concepts through inquiry-based learning.

While the field has moved towards increased agreement on definitions and broad characteristics of integrated STEM education, there remains a lack of specification in how these characteristics should be operationalized within curricula and classrooms. Educators and curriculum developers need specifics if the implementation of integrated STEM education is to meet the policy goals of using interdisciplinary and integrated approaches to teaching STEM content to increase students’ interest and readiness for STEM careers (e.g., National Academy of Science, National Academy of Engineering, and Institute of Medicine, 2007; President’s Council of Advisors on Science and Technology [PCAST], 2011). Without clear guidelines, implementation of integrated STEM education comprises a broad range of approaches (Moore et al., 2020), many of which, as discussed below, are problematic (e.g., Gunckel & Tolbert, 2018; McComas & Burgin, 2020). There is a clear need for research to provide critical evidence of the impact of integrated STEM education on student learning and affect toward STEM, as many arguments for integrated STEM are argued from policy and theoretical positions (e.g., NAE and NRC, 2014). The development of valid assessments and protocols to research integrated STEM teaching and learning requires that characteristics of integrated STEM education are developed in explicit detail. Thus, this paper develops a detailed framework for integrated STEM education that expands on previously established components of quality integrated STEM as broad statements to detailed constructs that describe fully what quality integrated STEM implementation should look like in the classroom. First, we examine the policy environment in which integrated STEM education is being promoted. Second, we provide an extensive literature review which expands on the consensus aspects of integrated STEM education described above to provide a more nuanced and detailed discussion of key characteristics of integrated STEM.

STEM policy

It is important to understand the policy context in which integrated STEM education is being promoted, as the myriad approaches are in response to policy directives, originating within the US, that call for addressing pressing issues such as STEM workforce needs (Takeuchi et al., 2020). Indeed, dominating policy arguments is the suggestion that continued national prosperity is dependent on meeting STEM workforce needs to address critical challenges such as energy, health, the environment, national security, and global development (e.g., National Academy of Science, National Academy of Engineering, and Institute of Medicine, 2007; PCAST, 2011). The number of STEM jobs is growing faster than non-STEM jobs (U.S. Bureau of Labor Statistics, 2020), which may result in a shortage of up to 3.5 million STEM workers in the United States by 2025 (National Association of Manufacturing and Deloitte Report, 2018). STEM workforce arguments are used in countries throughout the world to establish new STEM education policies and initiatives (Freeman et al., 2014). However, policy documents do not unpack specifics about STEM workforce needs beyond shortages of STEM workers. For integrated STEM education to address policy calls related to the STEM workforce, it is necessary to better understand the knowledge and skills that students need to be successful as STEM professionals.

More specific to the needs of the STEM workforce are concerns about a “creativity crisis” in the United States and around the world (Bronson & Merryman, 2011; Kim, 2011; Lin, 2011). STEM employers are looking for a workforce with not only strong STEM content knowledge and skills, but also an ability to compete in the global economy in a workforce with strong twenty-first century skills (e.g., critical thinking, communication, collaboration, and creativity) (Bronson & Merryman, 2011; Charyton, 2015). According to a World Economic Forum survey, approximately 65% of today’s Kindergarteners will end up working in jobs that do not currently exist given the rapid growth of automation and artificial intelligence in the workplace (World Economic Forum, 2016). Thus, it is no longer enough to expect our students to simply learn isolated facts and content. Rather than positioning students as consumers of information, students should be involved in knowledge construction. The deep understanding of content developed through knowledge construction forms the basis for students to apply twenty-first century skills to create, analyze, evaluate, innovate, and address real-world problems (Stehle & Peters-Burton, 2019).

Less visible in the current STEM policy rhetoric are arguments that integrated STEM education should promote increased STEM literacy and awareness, as well as addressing issues in developing countries related to equitable education and poverty reduction (Freeman et al., 2014; National Academy of Sciences [NAS], 2014). Indeed, teaching STEM solely from a workforce rationale is viewed by some science educators as problematic (e.g., Hoeg & Bencze, 2017; Zeidler, 2016; Zeidler et al., 2016). For example, Gunckel and Tolbert (2018) call out the technocratic, utilitarian, and neoliberal underpinnings of engineering design as portrayed in the Framework (NRC, 2012). These critiques are carefully considered and integrated in our development of an understanding of integrated STEM education to guide both educators and researchers seeking to better understand integrated STEM and ensure a positive learning experience for all students.

Integrated STEM framework

Throughout this literature review, we propose a framework for K^− 12 integrated STEM education that provides essential details for consistent implementation and evaluation of integrated STEM teaching. Without common understandings of integrated STEM education, it is difficult at best to draw conclusions across studies about teacher practices related to integrated STEM instruction and student outcomes. This common understanding needs to move past definitions and lists of consensus features of integrated STEM that can be interpreted in myriad ways by educators. Our framework includes seven key characteristics of integrated STEM: (a) focus on real-world problems, (b) centrality of engineering, (c) context integration, (d) content integration, (e) STEM practices, (f) twenty-first century skills, and (g) informing students about STEM careers. Table 1 provides a summary of these characteristics, and a detailed literature review for each characteristic follows this overview of the framework. These key characteristics are aligned with and expand upon three of the four consensus features of integrated STEM identified in the preceding sections: (a) integrated STEM is contextualized by a real-world problem, (b) integrated STEM supports the development of twenty-first century skills, and (c) connections between STEM disciplines should be made explicit to students. We note agreement within our framework that integrated STEM requires the use of student-centered pedagogies; however, we focus on student engagement in STEM practices rather than broad notions of student-centered pedagogies. Our framework extends conceptualizations of integrated STEM to explicitly address the nature of integration, the role of engineering, and STEM career awareness. Finally, our framework directly attends to issues of diversity and equity as opposed to the techno-centric focus of prevalent conceptualizations of integrated STEM. It is important to note that none of the characteristics in Table 1 operate in isolation from each other (see Fig. 1). The following section grounds each characteristic in the literature and illustrates the connections amongst the characteristics.

Table 1 Seven Key Characteristics of Integrated STEM

Fig. 1

Interactions between critical characteristics of integrated STEM

Focus on real-world problems

If learning is not centered on developing solutions to a real-world problem (Characteristic 1), a lesson cannot be considered to be representative of integrated STEM education. Indeed, as noted earlier, the most common feature included in definitions of integrated STEM in the literature is that STEM integration should be centered around a real-world problem or context (e.g., Kelley & Knowles, 2016; Kloser et al., 2018; Moore et al., 2020). Indeed, many students find it difficult to relate to STEM content presented using traditional, disciplinary approaches (Kelley & Knowles, 2016). Proponents of integrated STEM education argue that using real-world or authentic problems as a context for learning provides motivation and purpose for learning STEM content (e.g., Kelley & Knowles, 2016; Monson & Besser, 2015). Research shows that engaging students in learning through authentic engineering design problems improves student interest in science and engineering (Guzey, Moore, & Morse, 2016; Lachapelle & Cunningham, 2014; McClure et al., 2021). However, the selection of a real-world problem requires careful consideration as the ability to engage students with all characteristics of integrated STEM education hinges on the nature of the real-world problem (Fig. 1).

Our framework expands consideration of the importance of the nature of these real-world problems as care needs to be taken that these authentic problems generate interest and motivation in learning for all students (Carter et al., 2015; Monson & Besser, 2015). Given the lack of diversity within many of the STEM fields (Vakil & Ayers, 2019), there is a need to increase STEM interest for students that are historically under-represented in STEM. It is important to engage students in real-world problems that are personally motivating and connect STEM content to students’ lived experiences. This has been shown to make learning more meaningful and relevant, which enhances student engagement in science (Djonko-Moore et al., 2018) and positions students as epistemic agents in their learning (Miller et al., 2018). Often, integrated STEM classroom activities tend to focus on the male-oriented, technical aspects of engineering related to the design of “things”, such as designing cars and rockets (Gunckel & Tolbert, 2018). However, research shows that girls and students of color are more motivated by projects with a communal goal orientation, focused on societal issues such as health, the environment, and social justice as opposed to these types of gendered engineering projects (Billington et al., 2013; Diekman et al., 2010; Leammukda & Roehrig, 2020). The emphasis on “things” and technical criteria is oppositional to a communal goal orientation which negatively impacts interest in STEM careers (Diekman et al., 2010). This line of research parallels the arguments of Gunckel and Tolbert (2018), who argue for considerations of the dimensions of care and empathy in integrated STEM. While the literature has demonstrated a clear consensus that integrated STEM education should include an authentic problem to contextualize learning (e.g., Kelley & Knowles, 2016; Moore, Stohlmann, et al., 2014), there are important considerations about the nature of such problems if content learning and student motivation are to be promoted as argued in policy documents (e.g., Australian Curriculum, Assessment, and Reporting Authority, 2016; European Commission, 2015; NRC, 2012). Drawing on personal and community interests and lived experiences of students will be more motivating for students, and with purposeful consideration of students’ interests there is the potential to diversify STEM fields.

Centrality of engineering

Given the prominence of engineering within STEM policy documents (e.g., NRC, 2012), real-world problems are represented as an engineering design challenge (Characteristic 2) (Moore et al., 2020). Engineering is considered central in most definitions of integrated STEM (e.g., Berland & Steingut, 2016; Mehalik et al., 2008; Moore, Stohlmann, et al., 2014; Nathan et al., 2013); even within research that calls for the integration of only two disciplines to be considered integrated STEM, the most common combination is science and engineering (Moore et al., 2020). Thus, our framework links real-world problems to engineering design challenges (Characteristics 1 and 2 in Fig. 1) to promote the practices called for within current reform documents (e.g., NRC 2012).

Developing solutions to an overarching real-world problem relies on using and developing understanding of content from multiple disciplines (e.g., Cavlazoglu & Stuessy, 2017; Thibaut et al., 2018; Walker et al., 2018). Specifically, within integrated STEM education, students are expected to engage in engineering practices to develop possible design solutions to real-world problems (Berland & Steingut, 2016; NAE and NRC, 2014; NRC, 2012). Engineering practices are loosely defined within the NGSS through the eight science and engineering practices; however, successful integration of engineering practices into science classrooms requires a more robust articulation of engineering practices (Cunningham & Carlsen, 2014; Moore, Glancy, et al., 2014). In our work, we draw heavily on the Framework for Quality K^− 12 Engineering Education (Moore, Glancy, et al., 2014), which proposes three domains consisting of 12 key indicators of quality K-12 engineering (see Table 2).

Table 2 Domains and key indicators for quality K-12 engineering

Engineering is a systematic and iterative approach to designing solutions (products, processes, and systems) based on the needs of a client (NRC, 2012). As such, design is widely considered to be the central activity of engineering (Dym, 1999). Engineering design is an iterative process of “testing the most promising solutions and modifying what is proposed on the basis of the test results leads to greater refinement and ultimately to an optimal solution” (NRC, 2012, p. 210). In other words, response to failure is central to the engineering design process; failure is expected if innovation is to occur as it can lead to stronger, more innovative designs (Henry et al., 2021; Simpson et al., 2018). Thus, it is critical that K-12 students have opportunities within integrated STEM curriculum to fully engage in the iterative engineering design process and engage in at least one cycle of evaluating and redesigning a proposed solution or set of solutions (Moore, Stohlmann, et al., 2014). Learning from failure needs to be explicitly scaffolded for students, purposefully engaging them in a reflective decision-making process (Wendell et al., 2017).

Unfortunately, in K-12 classrooms engineering design is usually depicted solely as a technical problem (Gunckel & Tolbert, 2018). Thus, our framework expands on the Framework for Quality K-12 Engineering Education (Moore, Glancy, et al., 2014) to extend its focus on the technical aspects of engineering design to explicitly consider diversity and equity within STEM. Parallel to the work of professional engineers, students are expected to understand and address the criteria and constraints of a problem in developing possible design solutions (Watkins et al., 2014). Yet, these constraints are usually limited to realistic, but surface-level, issues such as time, access to materials, and budget, often ignoring the social, political, and ethical issues that are inherent in most real-world problems (Gunckel & Tolbert, 2018; Roehrig et al., 2020). Indeed, some researchers argue the NGSS (NGSS Lead States, 2013) and the Framework (NRC, 2012) marginalize the moral and ethical considerations within engineering design (e.g., Kahn, 2015). Gunckel and Tolbert (2018) caution that, while engineering education has elevated a focus on ethics, the focus of this approach still draws on technocratic and utilitarian principles. An approach grounded in care and empathy is necessary to reframe engineering education to engage students in considering the societal implications of their design solutions (Gunckel & Tolbert, 2018; Jackson et al., 2021). Similarly, researchers have promoted the inclusion of socio-scientific issues (SSI) into integrated STEM instruction (Kahn, 2015; Owens & Sadler, 2020; Roehrig et al., 2020). In addition to promoting scientific solutions to a real-world problem, SSI explicitly address moral and ethical considerations (Kahn, 2015; Zeidler, 2016). This approach to integrated STEM education not only elevates the purpose to include STEM literacy for all citizens regardless of their future participation in a STEM career, but also reimagines the necessary skills needed in the STEM workforce to improve and diversify thinking and approaches to engineering design.

Context integration

The real-world problem and/or engineering design challenge used to motivate student learning should be complex enough to foster multiple solutions (Lachapelle & Cunningham, 2014) and engage learners in applying and expanding their knowledge of the STEM disciplines (Berland & Steingut, 2016; Monson & Besser, 2015). There needs to be clear alignment between the engineering design challenge or real-world problem and specific content learning objectives (see Fig. 1), with the challenge or problem framed such that students need to draw upon STEM content knowledge to generate possible designs and make evidence-based decisions. This is represented in Fig. 1 as context integration (Characteristic 3).

Without clear and explicit integration between the problem context and content learning goals, students will resort to tinkering (a form of trial and error), negating the achievement of content learning objectives (McComas & Burgin, 2020; Moore, Glancy, et al., 2014; Roehrig et al., 2021). This relates to a significant problem pointed out by Takeuchi et al. (2020) in that there is a lack of a clear focus on specific STEM concepts. In their systematic review of the literature, Takeuchi et al. (2020) reported that almost 40% of the 154 integrated STEM articles they reviewed focused on students’ career aspirations and choices rather than learning of specific STEM concepts. The real-world problem and engineering design challenge must provide a context for learning target STEM content, as well as being motivating and engaging for students to help promote positive STEM identities (e.g., Tai et al., 2006).

Unfortunately, even with a real-world context, design tasks can degenerate into simply making crafts or tinkering solely through trial and error, neither of which require knowledge of STEM content or practices to develop solutions. While engineers develop both products and processes as solutions to real-world problems, K-12 engineering and integrated STEM educators tend to gravitate toward the building of physical products. For example, engineering courses, makerspaces, and digital fabrication labs have proliferated in K-12 schools over the past decade (Adams Becker et al., 2016). The focus of makerspaces and fabrication labs is the development of a product, often through “tinkering with materials with an endpoint in mind” (Sheffield et al., 2017, p.149). In effect, these spaces are the modernized versions of vocational education or shop class (Blackley et al., 2017; McComas & Burgin, 2020). Studies demonstrate limited content learning in science and mathematics for students participating in hands-on, project-based engineering courses because of the lack of clear and explicit connections to science and mathematics content (Tank et al., 2019). Makerspaces, fabrication labs, and engineering programs are not commensurate with characteristics of integrated STEM education unless teachers make explicit connections to mathematics and science content (Sheffield et al., 2015). As such, integrated STEM education requires an authentic problem or engineering design challenge that engages students in explicitly learning and applying science and mathematics concepts.

The practice of engineering requires the use and application of science, mathematics, and engineering knowledge. K-12 STEM education should emphasize this interdisciplinary nature by providing students with opportunities to apply developmentally appropriate mathematics or science content within the context of solving engineering problems (Arık & Topçu, 2020; NRC, 2012; Reynante et al., 2020). Indeed, engineering as a discipline involves an “understanding of the science undergirding physical relationships and the mathematical foundations of models that guide engineering design, as opposed to tinkering or making random modifications without basing those changes upon mathematical and/or scientific analyses” (Householder & Hailey, 2012, p.12). Design iterations throughout the engineering design process are based on evidence, scientific and mathematical knowledge, and analyses of the data generated through the testing of prototype designs (Mathis et al., 2016; Mathis et al., 2018).

Our argument is that integrated STEM education at its core is driven by real-world problems and the development of possible solutions to those problems using knowledge and practices from any relevant discipline. If students are to consider and understand the full socio-historical-political context of the problems in developing and evaluating design solutions to real-world problems (e.g., Gunckel & Tolbert, 2018), then knowledge and practices from the social sciences are necessary in addition to the technical knowledge of the STEM disciplines. In addition, critical to addressing issues of equity and diversity in STEM, is promoting students’ lived experiences and cultural knowledge, as well as disciplinary knowledge, as relevant to proposing solutions to real-world problems and engineering design challenges. Unfortunately, the cultural knowledge of students who are marginalized and under-represented in STEM are often perceived as deficit and not as legitimate ways of engaging in STEM (Tan & Calabrese Barton, 2018). Limited attention has been paid within the integrated STEM education literature to elevating the application of cultural and indigenous knowledge in engineering design; however, promoting STEM interest and learning for all students needs to attend to approaches such as cultural maker education (Tan & Calabrese Barton, 2018) and ethno-engineering (Friesen & Herrmann, 2018; Kilada et al., 2021).

Content integration

In addition to explicit connections between the real-world problem/engineering design challenge and the targeted science and/or mathematics content (Characteristic 3 - contextual integration), it is important that connections between the disciplines (Characteristic 4 - content integration) are also made explicit to students (English, 2016; Kelley & Knowles, 2016; NAE and NRC, 2014). Although teachers may understand the connections across the range of content representations and activities within an integrated STEM lesson, students often struggle to make these connections on their own (Dare et al., 2018; Tran & Nathan, 2010). Since students seldom make these connections spontaneously (Tran & Nathan, 2010), teachers must either help students recognize and identify these connections or explicitly make these connections clear for students. In a study of a high school engineering classroom, Nathan et al. (2013) discuss productive pedagogical moves to help make these interdisciplinary connections explicit to students. Their suggestions include asking questions, facilitating problem solving, creating models and representations, and explicitly foregrounding disciplinary knowledge to help students to identify the presence of specific content.

Content integration can be achieved through multidisciplinary, interdisciplinary, or transdisciplinary approaches (Bybee, 2013; Moore & Smith, 2014; Vasquez et al., 2013). Some researchers argue that one approach is not superior to another (Rennie et al., 2012), whereas others define a continuum of increasing integration from disciplinary to transdisciplinary (e.g., Vasquez et al., 2013; Wang & Knoblach, 2018). Proponents of an interdisciplinary approach argue that this approach is superior because a theme or real-world problem anchors the learning (e.g., Vasquez et al., 2013) in contrast to multidisciplinary approaches that “begin and end with the subject-based content and skills [with] students expected to connect the content and skills in different subjects that had been taught in different classrooms” (Wang et al., 2011, p.2).

While many researchers define multidisciplinary integration as occurring across multiple classrooms (e.g., Vasquez et al., 2013), the calls to integrate engineering and mathematical thinking in science classrooms (e.g., NRC, 2012) require integration across the disciplines within a science lesson or unit of instruction (Capobianco & Rupp, 2014; Moore, Stohlmann, et al., 2014). In a multidisciplinary approach, each STEM discipline would be identifiable within the curriculum and instruction, whereas in an interdisciplinary approach, each discipline would be difficult to distinguish from one another (Lederman & Niess, 1997). Given the argument that integrated STEM education can improve students’ learning of science and mathematics concepts (e.g., Berland & Steingut, 2016; Fan & Yu, 2017; Guzey et al., 2017) and the difficulty faced by students in recognizing the way in which different content areas support and complement each other (English, 2016; NAE and NRC, 2014), the connections between content areas need to be made explicit for students (English, 2016; Kelley & Knowles, 2016). As stated in the NAE and NRC (2014) report:

Connecting ideas across disciplines is challenging when students have little or no understanding of the relevant ideas in the individual disciplines. Also, students do not always or naturally use their disciplinary knowledge in integrated contexts. Students will thus need support to elicit the relevant scientific or mathematical ideas in an engineering or technological design context, to connect those ideas productively, and to reorganize their own ideas in ways that come to reflect normative, scientific ideas and practices. (p. 5)

While not discounting transdisciplinary and interdisciplinary approaches to integrated STEM education, multidisciplinary approaches yield the best approach for students to learn and apply disciplinary content and develop an understanding of the ways in which disciplinary content is connected.

Given the positioning of engineering within national and state science standards, mathematics and technology have received little attention in the literature and their inclusion within integrated STEM curriculum is often limited (Roehrig et al., 2021) (e.g., Roehrig et al., 2021)). Thus, it is critical that more explicit attention is given to mathematics and technology in the development of more robust and detailed models of integrated STEM education.

The case of mathematics

Despite a long history of integration between science and mathematics (e.g., Berlin & White, 1995; Davison et al., 1995; Huntley, 1998), the integration of mathematics is particularly difficult within integrated STEM education (Walker, 2017; Zhang et al., 2015), and studies show only small impacts on students’ mathematical knowledge (e.g., Becker & Park, 2011; NAE and NRC, 2014; Nugent et al., 2015). For example, Huntley (1998) describes the interdisciplinary approach as having one discipline that is in the foreground with the second discipline in the background simply to provide context. However, most often in science (and more recently in integrated STEM lessons), mathematics is backgrounded as a tool for data measurement and analysis with few or no conceptual learning goals for mathematics (e.g., Baldinger et al., 2021; Ring et al., 2017; Roehrig et al., 2021; Walker, 2017). This treatment of mathematics is reinforced by the NGSS through the inclusion of mathematics and computational thinking as one of the eight science and engineering practices (NRC, 2012). This practice presents mathematics as a tool that is central to science and engineering (Hoda, Wilkerson, & Fenwick, 2017) including “tasks ranging from constructing simulations, to making quantitative predictions, to statistically analyzing data, to recognizing, expressing, and applying quantitative relationships” (Aminger et al., 2021, p. 190).

While it is difficult to imagine teaching and learning science or engineering without engaging in mathematical practices, the mathematical connections are most often implicit and may not be transparent to students (Roehrig et al., 2021). Successful mathematics integration requires that the role of mathematics be made explicit, such as through putting mathematics in the foreground (Silk et al., 2010). For example, in a meta-analysis, Hurley (2001) found the greatest effect sizes for mathematics learning occurred when students learned science and mathematics content in sequence through a multi-disciplinary approach, rather than interdisciplinary approaches. More recently, Baldinger et al. (2021) argued that science and mathematics learning opportunities need to be strategically positioned and highlighted across a unit. Indeed, as noted previously, conceptual learning of science and mathematics is improved through a multidisciplinary approach that allows mathematics and science concepts to be explicitly and purposefully foregrounded within a unit.

In a rare study of the implementation of mathematical and computational thinking in K-12 science classrooms, Aminger et al. (2021) found that teachers were able to improve students’ understanding of scientific phenomena only when engaged in high cognitive demand mathematical tasks, such as mathematical modeling. Modeling uses mathematical equations to represent scientific phenomena and communicate scientific ideas (e.g., Bialek & Botstein, 2004; Brush, 2015; Lazenby & Becker, 2019). While students are expected to interpret the mathematical and scientific meaning represented by an equation (e.g., Bialek & Botstein, 2004; Sevian & Talanquer, 2014), studies at the postsecondary level show that students rely on algorithmic procedures without making connections between the mathematical equation and the scientific phenomenon (e.g., Bing & Redish, 2009). Postsecondary researchers advocate for blended sensemaking, where students’ scientific and mathematical knowledge is activated and used to develop understanding of scientific phenomena (Zhao & Schuchardt, 2021). When instruction encourages engagement in mathematical modeling through blended sensemaking, students show improved quantitative problem solving (e.g., Becker, Rupp, & Brandriet, 2017; Lazenby & Becker, 2019; Schuchardt & Schunn, 2016).

The case of technology

Technology is rarely explicitly called out within definitions of integrated STEM education (e.g., Ellis et al., 2020; Herschbach, 2011). Implicit treatments of technology take two primary forms: the integration of educational technology and technology as the production and use of technology within engineering (Ellis et al., 2020; Kelley & Knowles, 2016). Unquestionably, educational technology plays an increasingly large role in K-12 classrooms and, as is the case for all teachers, science teachers are involved in using digital technology tools to present content and allow students to complete their work, often through one-to-one technology initiatives. Standards guiding the use of technology in K-12 classrooms, such as the International Society for Technology in Education (ISTE) Standards for Educators, which define the technological skills educators need (ISTE, 2000), are content- and grade-level agnostic (Ellis et al., 2020). Most often, these digital technologies are used as replacements to traditional paper and text learning. For example, in science classrooms, digital notebooks have been used instead of paper notebooks (Constantine & Jung, 2019). While this allows students to include multimedia such as photos and videos and work collaboratively through web-based tools, these uses of technology are not specific to STEM.

Given the focus on engineering within the NGSS, views of technology within integrated STEM education are often connected to how technology is portrayed within engineering curriculum. In a review of K-12 engineering curricula, technology was primarily represented as the product of engineering (NRC, 2009). This representation of technology within integrated STEM education is clearly stated within the NGSS where engineering is defined as “a systematic practice for solving problems, and technology as the result of that practice” (NRC, 2012, p. 103). Similarly, the Framework states that “technologies result when engineers apply their understanding of the natural world and of human behavior to design ways to satisfy human needs and wants” (NRC, 2012, p. 12). In essence, under this definition of the “T” in STEM, STEM becomes SEM, resulting in technology being subsumed by engineering.

More productive in defining technology specific to integrated STEM education is the view of the “T” in STEM defined as the tools used by practitioners of science, mathematics, and engineering (Ellis et al., 2020; NAE and NRC, 2014). To support student engagement in the authentic practices of STEM professionals, students should have opportunities to use STEM-specific tools or technologies (e.g., Bell & Bull, 2008; Ellis et al., 2020; McCrory, 2008). A common example in science classrooms is the use of digital probes to collect and analyze data (e.g., Hechter & Vermette, 2014). More recently, with the addition of engineering into science classrooms, new technologies such as computer-assisted design (CAD) software and 3-D printers are being introduced (e.g., Wieselmann et al., 2019). Critical to integrated STEM education, however, is that these tools should not be limited to data collection devices; rather, they should encourage deeper student engagement with science content (Bull & Bell, 2008). Moving beyond basic data practices, technology practices in STEM education can be elevated to incorporate simulation and modeling practices which have been shown to improve students’ conceptual science understanding (Aminger et al., 2021).

Summary of content integration

Given the need for disciplinary knowledge to be activated and applied in integrated STEM lessons, there is a strong argument for a multidisciplinary approach where students have opportunities to both learn the content and connect that content to an authentic problem. Implicit connections are not enough; observations of instruction should yield clear and explicit discussion orchestrated by the teacher to facilitate students’ understanding of the connections across the disciplines. The inter-relationships among the disciplines are complex and require teaching STEM content in deliberate and purposeful ways so that students understand how STEM content is conceptually linked. In the case of mathematics and technology, it is critical that these subjects are not limited to tools in the service of data collection and analysis. When appropriate, curriculum developers and teachers should engage students in higher cognitive demand practices and explicit sensemaking through mathematical and technology-assisted modeling. While the literature related to modeling in physics is more robust (e.g., Hestenes, 2010), modeling literature also exists in other scientific disciplines that can be used to guide higher quality mathematics integration (e.g., Lazenby & Becker, 2019; Schuchardt & Schunn, 2016; Zhao & Schuchardt, 2021). Engagement in these data and mathematical practices, as practiced by STEM professionals, is a STEM-specific approach to technology integration.

Integration through STEM practices and twenty-first century skills

Also common across definitions of integrated STEM are references to specific disciplinary practices (e.g., inquiry, engineering design), as well as to shared practices and skills (e.g., critical thinking, creativity) (Moore et al., 2020). In addressing real-world problems and engineering design challenges, students should engage directly in authentic STEM practices (Characteristic 5) and twenty-first century skills (Characteristic 6) to develop potential solutions (Fig. 1) (e.g., Kelley & Knowles, 2016; Moore, Stohlmann, et al., 2014). The nature of the engineering design challenge is critical in promoting the desired learning outcomes and should be structured with multiple possible solution pathways. For example, if the task is too constrained, then the design space becomes limited, and students will not have the opportunity to develop important twenty-first century skills, such as critical thinking and creativity.

STEM practices

Engaging students in STEM practices is a common component of definitions of integrated STEM education (e.g., Kelley & Knowles, 2016; Moore et al., 2020). These practices are “a representation of what practitioners do as they engage in their work and they are a necessary part of what students must do to learn a subject and understand the nature of the field” (Reynante et al., 2020, p.3). Engaging students in STEM practices is supported broadly by pragmatism, which emphasizes learning by doing (Asunda, 2014), and more specifically by social constructivist learning theories that underpin reforms in STEM education that advocate for students’ active construction of knowledge as opposed to transmission of knowledge (e.g., Guzey, Moore, & Harwell, 2016; Riskowski et al., 2009).

Central to knowledge construction and the work of STEM professionals are data practices (Duschl et al., 2007). Data practices include the creation, collection, manipulation, analysis, and visualization of data (Weintrop et al., 2016). Given that engineering design challenges afford multiple solution pathways without a single correct solution (Lachapelle & Cunningham, 2014) and “data do not come with inherent structure that leads directly to an answer” (Weintrop et al., 2016, p. 135), it is important that students are actively engaged in data practices and using data to make decisions as they engage in the engineering design process. Within the Framework (NRC, 2012), this is called out as the practice of engaging in argument from evidence, which features the use of evidence and scientific and mathematical knowledge to develop explanations in science and justify design decisions in engineering.

Argumentation is a common practice within both science and engineering fields (Couso & Simarro, 2020); however, while scientific argumentation is well-supported within the research literature (e.g., Berland & McNeill, 2010), the level to which K-12 students use both evidence and STEM content to justify design decisions is in its infancy (e.g., Mathis et al., 2018; Purzer et al., 2015; Valtorta & Berland, 2015). Argumentation and decision-making require considering the advantages and disadvantages of possible design solutions in light of available evidence and any defined criteria and constraints (Wendell et al., 2017).

Siverling et al. (2017) argue that students’ application of scientific and mathematical content is promoted through the explicit use of evidence-based reasoning within integrated STEM lessons. For example, the classroom activities may require students to justify their thinking about why an initial design solution should be pursued during the planning phase and additionally require students to use evidence and STEM content when evaluating a tested design solution and justifying it to the client (Mathis et al., 2016; Mathis et al., 2018). This formal evidence-based reasoning explicitly asks students to make claims about their designs and design decisions that are supported by both evidence (from iterative testing) and reasoning (using scientific and mathematical content) (Siverling et al., 2019). Students do not spontaneously use science and mathematics content to justify and explain their design choices; rather, students focus on cost and material limitations when engaging in engineering design tasks (e.g., English et al., 2013; Guzey & Aranda, 2017). Thus, explicit inclusion of evidence-based reasoning in K-12 integrated STEM lessons is necessary to scaffold students in connecting science and mathematics content to the engineering design challenge.

STEM content knowledge is not the only consideration in making design decisions. In evaluating a possible design solution, students are expected to prioritize “criteria and trade-offs that account for a range of constraints, including cost, safety, reliability, and aesthetics as well as possible social, cultural, and environmental impacts” (NGSS standard HS-ETS1–3). It is important that the social and cultural aspects of proposed solutions are not ignored, as we truly intend to develop a STEM literate citizenry and develop a future workforce who think more deeply about their work beyond the traditional technocratic focus (Gunckel & Tolbert, 2018; Roehrig et al., 2020; Zeidler, 2016).

Students should have agency in design decisions as they engage in the engineering design process (e.g., Berland & Steingut, 2016; Johnson et al., 2016; Saito et al., 2015). Engineering design challenges should be constructed with multiple solution pathways, allowing students to determine their own solution trajectories and opportunities to build knowledge as possible design solutions develop from students’ questions, ideas, and explorations. Miller et al. (2018) argue that we must also position students as epistemic agents as opposed to receivers of STEM content, without which the call from the Framework (NRC, 2012) for students to engage in STEM practices will not be realized. Miller et al. (2018) define epistemic agency as “students being positioned with, perceiving, and acting on, opportunities to shape the knowledge building work in their classroom community” (p. 1058). Specifically, students should have opportunities to: (a) build on personal and cultural knowledge as a resource for learning, (b) build knowledge, (c) build a knowledge product that is personally useful, and (d) change structures that constrain and support action. When afforded epistemic agency, students can propose solutions to personally meaningful problems, rather than simply learning the canonical facts of the discipline (Schwarz et al., 2017) and mimicking the proscribed practices. Engaging students in engineering design challenges contextualizes learning around meaningful and authentic problems, providing a sense of agency as students can see the content learning goals as useful and relevant to developing solutions to the problem (e.g., Schwarz et al., 2017). Researchers argue that real-world problems should position students as not only knowledge builders, but also change agents in their community, further promoting epistemic agency and the development of STEM identity (Billington et al., 2013; Leammukda & Roehrig, 2020; Miller et al., 2018).

Twenty-first century skills

In addition to specific STEM practices, integrated STEM instruction should support the development of twenty-first century skills (e.g., Moore, Glancy, et al., 2014; Sias et al., 2017). Broadly, twenty-first century skills include knowledge construction, real-world problem solving, skilled communication, collaboration, use of information and communication technology for learning, creativity, and collaboration (Partnership for twenty-first Century Learning, 2016); these are the skills “necessary for a person to adapt and thrive in an ever-changing world” (Stehle & Peters-Burton, 2019, p.2). A recent trend has been to include the arts, as proponents of STEAM education argue that the integration of the arts will enhance students’ critical thinking and problem-solving skills and cultivate their creativity (Trevallion & Trevallion, 2020). However, these arguments are already central to agreed-upon goals of integrated STEM education (NAE and NRC, 2014; Moore, Glancy, et al., 2014), and creativity is pivotal within the STEM disciplines without the insertion of the arts. Integrated STEM education provides a rich environment for the development of critical thinking, collaboration, creativity, and communication (Stehle & Peters-Burton, 2019).

The ill-defined nature of real-world problems and engineering design challenges requires that students engage in critical thinking, drawing on their STEM content knowledge and lived experiences to propose possible design solutions. Engaging in the engineering design process inherently incorporates creativity and critical thinking as there is no single correct solution, thus promoting the potential of transformative and innovative design solutions (Stretch & Roehrig, 2021; Petroski, 2016; Simpson et al., 2018). As students iteratively test and improve their design solutions, they will experience design failure. As previously noted, failure should be expected if innovation is to occur, and the ability to learn from failure can lead to stronger designs and innovation through the application of creativity and critical thinking (Henry et al., 2021; Simpson et al., 2018).

Given the highly interdisciplinary and integrative nature of engineering, students should also be provided opportunities to work together in teams to enhance their collaboration skills (Riel et al., 2012; Rinke et al., 2016; Thibaut et al., 2018), which are necessary to develop negotiated design solutions that synthesize across differing understandings of the same problem space (Wendell et al., 2017). Indeed, in the K-12 classroom, small group activities account for approximately half of instructional time in science classrooms with the expectation that small groups co-construct knowledge of STEM content and design solutions to real-world problems (Wieselmann et al., 2020; Wendell et al., 2017). Sharunova et al. (2020) used Bloom’s taxonomy (Anderson & Krathwohl, 2005) to define a continuum of cognitive engagement that groups engage in during small group engineering design activities. Integrated STEM learning environments involve “new levels of communication, shared vision, collective intelligence, and direct coherent action by students” (Asunda, 2014, p. 8). Further, researchers call for integrated STEM activities wherein students are expected to collectively apply what they have learned to develop possible design solutions and improve these designs through iterative analysis and evaluation (Asunda et al., 2015; Dolog et al., 2016; Sharunova et al., 2020).

Promoting STEM careers

The final characteristic, promoting STEM careers (Characteristic 7), is the least common feature of integrated STEM within the literature. As such, it stands somewhat separate from the other characteristics of the integrated STEM framework but undergirds the policy motivation for including integrated STEM education in K-12 classrooms. With the goal of promoting future participation in STEM careers in mind, integrated STEM education should expose students to details about STEM careers (Jahn & Myers, 2014; Luo et al., 2021). This should include both allowing students to engage in the authentic work of STEM professionals (Kitchen et al., 2018; Ryu et al., 2018) and critically promoting student development of STEM identities. A growing body of research has shown that STEM interest, attitude, and identity serve as predictors of sustained pursuit in the STEM disciplines rather than academic performance in STEM coursework (Avraamidou, 2020; Rodriguez et al., 2017; Tai et al., 2006). Furthermore, identity research has shown that students who show interest and enjoyment in STEM do not necessarily see themselves pursuing a future STEM career (Carlone et al., 2011); this is especially true for students from historically underrepresented groups of people who are less likely to show interest in and identify with the STEM domains (Rodriguez et al., 2017). Further, STEM interests and career aspirations are largely developed by eighth grade (Tai et al., 2006), suggesting a need to introduce students to STEM careers early in their education. In addition to introducing students to STEM careers, research shows that a focus on connections to personal experience and knowledge can help shape students’ identity within STEM (Ryu et al., 2018; Carlone et al., 2014; Sias et al., 2017).

Although supporting students in developing solutions to real-world problems through engaging in STEM practices and twenty-first century skills may also help to develop positive STEM identities and interest in STEM, these activities do not require any explicit connection to STEM careers. Research exploring the development of students’ understanding of engineering is limited and debate remains about whether implicit modeling of STEM professions by engaging students in hands-on STEM activities leads to durable and robust understandings about the work of engineers and other STEM professionals (e.g., Svihla et al., 2017). However, explicit discussion of STEM professions can help students to understand specific career opportunities and align these professions with their interests (Kitchen et al., 2018; Ryu et al., 2018).

Implications and use of the framework

Each of the seven critical characteristics of integrated STEM education (Table 1) has important implications for teachers in their planning and implementation of integrated STEM if integrated STEM in K-12 classrooms is going to be successful in promoting STEM literacy and increasing diversity in the STEM fields. Careful consideration is critical in selecting the context for an integrated STEM lesson, as research shows differences in motivation to engage in STEM for students of color and women who are under-represented in STEM as compared to White males (e.g., Billington et al., 2013; Diekman et al., 2010; Leammukda & Roehrig, 2020). While some science topics lend themselves to simple engineering design activities, such as designing a mousetrap car to travel as far as possible, these activities are not contextualized in a real-world problem. In contrast, students could be asked to design habitats to protect equatorial penguins impacted by climate change, a problem that requires knowledge and application of the scientific concepts of heat transfer (Sheerer & Schnittka, 2012). This engineering design challenge is contextualized by a real-world problem created through human impact on the environment and could easily be adapted to include considerations of human-caused environmental issues and local policies and traditions in developing design solutions. By contextualizing an engineering design challenge in a real-world problem, we ask students not only to understand the technical criteria and constraints of a problem but also to consider the problem within the context of a potentially difficult moral and ethical dilemma. Teachers should seize such opportunities to guide students in sense-making, understanding the authenticity of the context, and approach these problems with a critical perspective. Attention to selecting real-world problems and related engineering design challenges that promote positive STEM identities for students that are under-represented in STEM not only addresses reported workforce needs but brings new perspectives and approaches to how STEM content and practices are applied in the real-world.

Unfortunately, even with a real-world context, engineering design tasks can degenerate into tinkering and iterative improvement of designs through random trial and error (McComas & Burgin, 2020; Moore, Glancy, et al., 2014; Roehrig et al., 2021) if these integrated STEM lessons are poorly planned. As well as providing a motivating context designed to promote positive STEM identities, the real-world problem and engineering design challenge must provide a context for learning specified STEM content. This could involve the reactivation of prior knowledge or the explicit teaching of STEM content within a unit of instruction. We suggest that a pedagogical approach closer to multidisciplinary integration might better afford students’ recognition of the STEM content inherent within an integrated STEM unit. In other words, quality integrated STEM units (e.g., Bhattacharya et al., 2015; Karahan et al., 2014; Moore, Guzey, et al., 2014; Moore et al., 2015) should include lessons designed to explicitly teach relevant STEM content. Given that students rarely make these connections spontaneously (Tran & Nathan, 2010), it is critical that teachers use specific pedagogical approaches, such as evidence-based reasoning (Mathis et al., 2016; Mathis et al., 2018), to help make these connections explicit. Strong teacher facilitation and questioning is needed to help students recognize the connections across the disciplines and use these connections to develop stronger design solutions through iterative and reflective processes.

Our integrated STEM framework helps to not only provide more specific guidance to educators, but also support for integrated STEM research. Despite the push for integrated STEM in K-12 classrooms, the development of observation protocols that assess STEM-integrated teaching has been slow. Until valid protocols are developed, STEM education researchers continue to rely on existing instruments that predate current STEM education initiatives, such as the Reformed Teaching Observation Protocol (Sawada et al., 2002). The lack of a detailed integrated STEM framework thus far has prevented the field from systematically collecting data in classrooms to understand the nature and quality of integrated STEM instruction; this delays research related to the impact on student outcomes, including academic achievement and affect. This framework provides detailed guidance on teacher practices one would expect to observe within an integrated STEM lesson. With this framework, the groundwork is now set for researchers to explore the impact of specific aspects of integrated STEM or the overall quality of integrated STEM instruction on student outcomes as this framework could guide the development of observational protocols for integrated STEM which are currently lacking in the field (e.g., Dare et al., 2021).

Conclusions

Our framework addresses a critical need in the field to move beyond simple definitions of integrated STEM to detailed descriptions that operationalize central constructs such as the nature of integration itself. Based on intentions of STEM policy documents and the extant literature, we proposed an integrated STEM framework that includes seven key characteristics of integrated STEM: (a) focus on real-world problems, (b) centrality of engineering, (c) context integration, (d) content integration, (e) STEM practices, (f) twenty-first century skills, and (g) informing students about STEM careers. While these key characteristics include commonly agreed upon components of integrated STEM (e.g., Johnson et al., 2016; Kelly & Knowles, 2016; Moore, Stohlmann, et al., 2014), our framework conceptualizes each of the key characteristics in detail, operationalizing integrated STEM for educators, curriculum developers, and researchers. This is critical as statements such as “an effort to combine some or all of the four disciplines of science, technology, engineering, and mathematics into one class, unit, or lesson that is based on connections between the subjects and real-world problems” (Moore, Stohlmann, et al., 2014, p. 38) do not provide enough information about critical issues such as how to integrate any subset of the STEM disciplines or what real-world problems would be appropriate to drive learning in STEM for all students.

Most importantly, our framework directly attends to issues of diversity and equity as current definitions and implementation of integrated STEM are content-focused and consider only the technical aspects of engaging in solving real-world problems and/or engineering design challenges. Our framework specifically addresses issues raised by critics of integrated STEM (e.g., Gunckel & Tolbert, 2018; Roehrig et al., 2020; Zeidler, 2016) to give full consideration to the socio-historical-political context in which the engineering design challenge resides and use this knowledge in making design decisions. The framework also attends to the development of STEM identities for all students through understanding how the nature of the real-world problem and/or engineering design challenge can constrain or afford interest and engagement in STEM for girls and students of color (e.g., Billington et al., 2013; Diekman et al., 2010; Leammukda & Roehrig, 2020). Also important to promoting positive STEM identities for all students is elevating students’ lived experiences and cultural knowledge as valid forms of knowledge to be drawn on as they engage in developing solutions to real-world problems.