Policy efforts in mathematics have focused on increasing teachers' mathematics content knowledge (MCK), with the goal of increasing teacher quality and in turn increasing student mathematics learning. An alternative approach to increasing student mathematics achievement is to investigate curricula that can be effectively used by teachers with a range of MCK. Drawing from a large-scale study of kindergarten students (n = 2,598) and their teachers (n = 130), the current study investigated the interaction between teacher MCK and curriculum (Early Learning in Mathematics core kindergarten curriculum vs. business-as-usual curricula) on (a) instructional behaviors and (b) student mathematics achievement gains. Results indicated differential significant interactions across instructional behaviors and a small but negative effect of teacher MCK on student mathematics achievement gains. Implications for future research, policy, and practice are discussed.
The importance of a strong foundation in mathematics is unlikely to be disputed by educational researchers, practitioners, and other stakeholders. However, the learning of mathematics is inherently complex, with many students failing to reach proficiency in understanding of whole number concepts in the elementary grades (National Assessment of Educational Progress, [
Given the complexities of learning and teaching mathematics, teacher quality—or teachers' ability to effectively teach mathematics—has been a long-standing target for improving student outcomes in mathematics (e.g., Darling-Hammond & Berry, [
An alternative approach to improve mathematics instruction is targeting the quality of core mathematics curricula and the inclusion of curricular supports to enable effective implementation for teachers across a range of skill sets (Stein et al., [
The current study investigated two targeted areas in mathematics reform (i.e., teachers' mathematics content knowledge [MCK] and quality of core mathematics curricula) and their associations with instructional behaviors and student mathematics achievement. The following section provides an overview of relations between teacher MCK and student mathematics achievement, as well as curricular features associated with greater student mathematics outcomes.
Teacher MCK has been a construct of interest in the mathematics education literature for several decades and in turn has been defined and studied in a variety of ways. One approach is to measure proxies of teacher MCK, such as teachers' advanced mathematics courses, years of experience teaching, or scores on mathematics skills tests (Mullens et al., [
An alternative approach is to examine teachers' knowledge of how to effectively teach a given academic subject, often described as teachers' pedagogical content knowledge (Shulman, [
Perhaps the most widely used assessment to measure teachers' MCK is the Mathematical Knowledge for Teaching (MKT; Hill et al., [
In the current study, we conceptualized MCK as the knowledge needed for effectively teaching mathematics in the elementary grades. We used the MKT measure as our proxy for MCK, which included items targeting pedagogical content knowledge (e.g., knowledge needed for effectively teaching mathematics) and more general content knowledge. Throughout this article, we use the term "MCK" to describe the construct that we were interested in studying, whereas the specific measure is referred to as "MKT."
Examinations of teacher MCK have revealed a number of critical findings. Above and beyond other variables such as mathematics courses taken or teaching experience, teacher MCK significantly predicts student mathematics achievement gains across the academic year for students in the early and late elementary grades (Campbell et al., [
Given associations between teacher MCK and student mathematics achievement, systematic efforts have been carried out to investigate the impact of content-focused teacher PD programs on teachers' MCK, instructional behaviors, and student mathematics achievement (Garet et al., [
The majority of these programs led to increases in teacher MCK compared with a business-as-usual (BAU) control condition (for an exception, see Garet et al., [
Although limited research indicates that intervening on teacher MCK increases student mathematics achievement, the use of high-quality core curricula has a higher level of evidence for increasing mathematics achievement. For example, Agodini et al. ([
Though teachers' use and implementation of curricula can vary, high-quality curricula may help teachers, even those with limited training in mathematics, employ effective instructional techniques (Stein et al., [
Curricula that provide a high level of instructional support for teachers, such as programs that include specific teacher language or explanations of how to effectively use mathematical representations, may reduce the impact of MCK on teaching behaviors and student outcomes. To date, two studies have investigated relations among teacher MCK and curriculum. The first study, conducted by Stein and Kaufman ([
The second study used data collected from the large-scale evaluation of four early elementary mathematics curricula (Investigations, Math Expressions, Saxon, and SFAW; Agodini et al., [
Though mathematics PD programs frequently target teacher MCK, the vast majority of PD studies intervening on teacher MCK have found null effects on student mathematics achievement (Gersten et al., [
This study draws from a large-scale efficacy study (Clarke et al., [
Research indicates that teacher MCK is positively associated with teaching behaviors (Garet et al., [
We examined this question using a continuous and binary indicator (lowest three quartiles vs. upper quartile) of teacher MCK, given research indicating that associations differ based on how MCK is defined or distributed (Agodini & Harris, [
We hypothesized that in BAU classrooms, teachers' MCK would predict student mathematics achievement gains, given research indicating positive associations between these variables (e.g., Hill et al., [
The ELM large-scale efficacy trial (Clarke et al., [
The 46 participating schools in Oregon and Texas included public (n = 32), private (n = 11), and charter (n = 3) schools in urban and suburban areas. Participating kindergarten teachers (n = 130) taught the 129 classrooms (two teachers each taught a half-day in a single classroom). Of the 130 teachers, 127 (98%) were female. Teacher-reported demographics indicated that 92 (71%) were White, 22 (17%) were Hispanic, 11 (8%) were African American, 1 (<1%) was Native American, 1 (<1%) was Asian American, and 3 (2%) did not report demographic information. Regarding teacher-reported credentials and teaching background, 49 teachers (38%) held a master's degree, 30 (23%) completed three or more college mathematics courses (e.g., including mathematics methods courses and courses such as calculus), 68 (52%) completed college algebra, and 72 (55%) had taught kindergarten for 4 or more years. Twenty-four teachers (18%) reported spending 21–40 minutes per day on mathematics, 45 (35%) reported 41–60 minutes per day, and 37 (28%) reported 61 or more minutes per day.
The full sample of students included 2,598 kindergarteners in ELM (n = 1,401) and control (n = 1,197) classrooms. Of the full sample of students, 120 (5%) were eligible for special education services, and 708 (27%) were identified as English learners (ELs). District-provided demographic data were only available for students who attended public schools, comprising 61% of the sample. Of the students with demographic data, approximately 76% of the student population qualified for free or reduced-price lunch programs. Across Oregon and Texas, 909 (57%) students were White (including students who were Hispanic), 265 (17%) were African American, 218 (14%) were American Indian/Alaska Native, 136 (9%) were Asian, 11 (<1%) were Native Hawaiian or Islander, and 43 (3%) were multiple races.
ELM is a 120-lesson, core kindergarten curriculum, designed for whole-class instruction and focused on building foundational early mathematics concepts. Each lesson consists of a 15-minute daily calendar routine, as well as a 45-minute mathematics lesson. Each lesson includes four to five activities, allowing for lessons to be organized in tracks with skills introduced, built upon, and frequently reviewed over multiple lessons to allow for mastery and retention. Each ELM lesson includes a cumulative Math Practice worksheet with a "Note Home" in English and Spanish to encourage parent involvement and additional at-home practice. The curriculum was designed to support a wide range of learners, with a particular focus on supporting students entering kindergarten at risk in mathematics, through two key elements: (a) focusing on critical mathematics content and (b) using research-based instructional design principles.
The curriculum covers content across three math strands: numbers and operations, geometry, and measurement. Content was selected based on the National Council of Teachers of Mathematics Focal Points for kindergarten (NCTM, [
ELM uses an explicit and systematic instructional design (Gersten et al., [
ELM also relies upon the concrete-representational-abstract (CRA) sequence to build deep understanding of complex mathematical concepts. The CRA sequence is outlined for teachers in lesson scripting and detailed information about program materials. Along with developing understanding of mathematical concepts, ELM places emphasis on developing procedural fluency and automaticity to help students master mathematics concepts and skills. Students receive ample practice on skills over time, leading to increased exposure to mathematical concepts and fostering automaticity. Additional student practice opportunities are built into the end of every lesson through student completion of the independent Math Practice worksheet.
The most commonly used curriculum by classrooms in the control condition was Texas Mathematics or Everyday Mathematics (n = 21). Other programs included Harcourt Math (n = 15), SFAW (n = 7), Progress in Mathematics (n = 3), and Investigations in Number, Data, and Space (n = 2). Four teachers indicated that they used teacher-made materials, and seven teachers did not respond to the survey item. The pedagogical approaches and level of teacher supports varied across the published curricula used in the control condition. For example, Everyday Mathematics has been described as having an "inquiry approach to mathematics, in which students are expected to develop mathematical thinking through the exploration and application of mathematical principles rather than through direct instruction" (Nelson et al., [
Researchers have described Harcourt Math and SFAW as teacher directed, or explicit in nature (Agodini et al., [
The TEMA-3 (Ginsburg & Baroody, [
The MKT survey (Hill et al., [
The Classroom Observation of Student-Teacher Interactions–Mathematics (COSTI-M; Doabler et al., [
All participating teachers (ELM and control teachers) completed surveys, including teacher demographics and the MKT measure, in October 2009 (Oregon) and 2010 (Texas), prior to the implementation of ELM. Student mathematics achievement measures were collected in the fall prior to implementation of ELM, and in the spring after ELM classrooms completed the program. Trained staff administered student measures. These staff met a reliability standard of at least 0.85 prior to collecting data in schools and again during an in-school shadow-coding session. Data collector training ranged from 4 to 6 hours in the fall and again in the spring prior to posttesting. Observers underwent an additional 11+ hours of training focused on the COSTI-M and other observation measures that included lecture, video practice, a video reliability check, and a real-time reliability check in a classroom where observers were required to meet a reliability standard of.80. Trainers provided booster sessions prior to each additional observation. In each ELM and control classroom, an observation was conducted in the fall, winter, and spring, each approximately 6 weeks apart. Out of 379 scheduled observations, only 8 (2%) were not completed due to teacher absences or scheduling conflicts. Observations were conducted for the duration of core mathematics instruction, which varied between classrooms and lasted between 30 and 90 minutes.
ELM teachers participated in three 4-hour trainings conducted across the school year focused on curriculum implementation. The lead curriculum author and/or project coordinator led the trainings. Trainings focused on lesson content, classroom management, and implementing the ELM curriculum with fidelity. Teachers had the opportunity to practice teaching ELM lessons during the training and received feedback from trainers on teacher demonstrations, guided practice, and facilitating group and individual response opportunities.
For RQ1, the dependent variable was teacher instructional behaviors as measured by the COSTI, including (a) teacher demonstrations, (b) group response opportunities, and (c) individual response opportunities. For RQ2, the dependent variable was kindergarten student mathematics achievement gains on the TEMA-3. The independent variable for both RQ1 and RQ2 was teacher MCK, as measured by the MKT (Hill et al., [
For tests of teacher-level moderation effects with a relatively small teacher sample size, the trade-off between Type I and Type II errors represents a delicate balance. False conclusions about significant interaction effects (Type I errors) are problematic, as is failing to detect interaction effects (Type II errors). To balance the likelihood of the two types of errors, Cohen ([
The purpose of RQ1 was to investigate whether the association between teacher MCK and teacher instructional behaviors varied between teachers of ELM and teachers of BAU curricula. We estimated Pearson's r bivariate correlations among teacher MCK, teacher characteristics, and instructional behaviors. Multiple regression models were specified to regress instructional behaviors on Teacher MCK, Condition, and the MCK × Condition interaction, as specified by the following equation,
where Y = the raw score on the teaching behavior variable and b
The purpose of RQ2 was to investigate whether the association between teacher MCK and student mathematics achievement varied between teachers of ELM and teachers of BAU curricula. Given the nested nature of the student mathematics achievement data, with individual students receiving instruction within a given classroom, we used two-level HLMs to investigate the interaction of teacher MCK and condition on student mathematics achievement. We omitted school-level data as a third level of nesting because the primary foci of the study included teacher and classroom variables without taking school effects into account. The multilevel models regressed student mathematics achievement gains at Level 1 on classroom characteristics (Teacher MCK, Condition, and Teacher MCK × Condition) at Level 2:
We used full information maximum likelihood estimation for all analyses and reported robust standard errors. Similar to RQ1 analyses, we evaluated teacher MCK as a continuous, centered variable and as a dichotomous, uncentered variable (lower three quartiles vs. upper quartile) in separate analyses. Specifically, Model 1 included the effect of Teacher MCK, Condition (0 = BAU, 1 = ELM), and their interaction. Significant interaction terms indicated that the effect of Teacher MCK on student mathematics achievement gains varied by condition. For models without any evidence of moderation (i.e., the p value of the interaction term was ≥.10), we respecified Model 2 to exclude the interaction term and analyzed the main effects model. We computed all HLMs using HLM 8.0 (Raudenbush et al., [
We conducted baseline equivalency analyses to ensure that random assignment of classrooms to the ELM and control conditions resulted in equivalent groups on student and teacher pretest characteristics. We used independent samples t-tests and chi square analyses to examine data for baseline differences between the ELM and control conditions on demographic and key study variables. We did not observe any differences across conditions on any student and teacher demographics, with the exception of a higher proportion of ELs in the ELM (n = 407) compared with BAU (n = 301) condition, (X
Mathematics achievement gain scores on the TEMA-3 were available for 1,972 students (approximately 76% of the total sample). Given the proportion of missing data, chi square and independent samples t-tests were conducted to determine whether key variables differed between students with and without available TEMA-3 gains scores. We did not find differences in regard to gender (X
Because group comparisons indicated that missing TEMA-3 gain score data were systematically related to other variables, we used multiple imputation to estimate missing values. Predictors of student-level missing data included TEMA-3 pretest scores and dummy-coded demographic characteristics: EL status (0 = English speaker, 1 = English learner), ethnicity (0 = White, 1 = non-White), and special education eligibility (0 = not eligible, 1 = eligible). For each HLM, we imputed 100 data sets, and their average was used to generate model parameters.
We report descriptive statistics for study variables by condition in Table 1, along with Pearson's r bivariate correlations among teacher characteristics and instructional behaviors. Correlations ranged from −0.11 to 0.47. Teacher MCK was significantly correlated with the number of college math courses (r =.24, p =.007), teacher demonstrations (r =.19, p = 0.34), and group response opportunities (r =.29, p =.001). Teacher MCK was not significantly correlated with individual response opportunities (r =.13, p =.154). Correlations were highest between teacher demonstrations and group response opportunities (r =.47, p <.001). Correlations were not significant between the number of college math courses taken and any of the instructional behaviors. The number of years teaching was not significantly correlated with any other variable.
Table 1. Descriptive Statistics by Condition and Correlations among Key Variables (n = 127)
(1) (2) (3) (4) (5) (6) ELM Control Teacher variables: 1. Teacher MCK (% correct) – 51.41 47.39 (15.41) (17.15) 2. Years teaching −.02 – 3.76 3.85 (1.35) (1.31) 3. Number of college math courses .24 .07 – 1.94 1.81 (1.02) (1.03) 4. Teacher demonstration rate/min .19 −.08 −.10 – .58 .52 (.30) (.31) 5. Group response rate/min .29 −.03 .06 .47 – 1.34 .77 (.63) (.62) 6. Individual response rate/min .13 .02 −.11 .08 .19 – .65 .46 (.38) (.27) Student variables: TEMA-3 pretest raw score 19.70 20.06 (10.46) (10.04) TEMA-3 gain score 14.36 13.38 (.21) (.21)
Graph
1 Note. ELM = Early Learning in Mathematics; MCK = mathematics content knowledge; TEMA-3 = Test of Early Mathematics Achievement, Third Edition.
- 2 * p <.05.
- 3 ** p <.01.
We first examined teacher MCK as a continuous predictor, with regression model results displayed in Table 2. The Model 1 columns in Table 2 show that the MCK-by-condition interaction was not significant for two of the instructional behavior outcomes: teacher demonstrations (p =.136) and group response opportunities (p =.793). We dropped the interaction term from these models to examine the main effect of teacher MCK with condition retained as a covariate (see Table 2, Model 2).
Table 2. Results of Regressing Teachers' Instructional Behaviors on Teacher MCK as a Continuous Variable, Condition, and the Teacher MCK-by-Condition Interaction
Teacher Demonstration (rate/min) Group Response (rate/min) Individual Response (rate/min) Model 1 Model 2 Model 1 Model 2 Model 1 Intercept .509 .505 .761 .759 .449 (.37) (.037) (.078) (.078) (.043) Teacher MCK .005 .003 .011 .010 −.001 (.002) (.002) (.005) (.003) (.003) Condition .071 .071 .558 .558 .191 (.051) (.051) (.107) (.107) (.059) Teacher MCK × Condition −.005 – −.002 – .006 (.003) (.007) (.004) .067 .050 .251 .251 .113 2.95 3.27 13.76 20.76 5.22
Graph
- 4 Note. Model 1 presents results from the moderation analyses. When interaction terms were not significant at the p ≤.10 level, the interaction term was excluded from the model to examine main effects of teacher MCK and condition (see Model 2). Standard errors are reported in parentheses. MCK = mathematics content knowledge.
- 5 + p <.10.
- 6 * p <.05.
- 7 ** p <.01.
For teacher demonstrations, there was a significant positive linear relationship between teacher MCK and the rate of teacher demonstrations after controlling for condition (b = 0.003, SE = 0.002, β =.17, p =.053). Specifically, for a 10% increase in teacher MCK, the teacher demonstration rate increased by 0.03 demonstrations per minute. ELM teachers did not have significantly higher rates of teacher demonstrations than teachers of BAU curricula after controlling for MCK (b = 0.071, SE = 0.051, β =.12, p =.167). For group response opportunities, there was a significant positive linear relationship between teacher MCK and the outcome after controlling for condition (b = 0.010, SE = 0.003, β =.24, p =.003). For a 10% increase in teacher MCK, the rate of group response opportunities increased by 0.10 responses per minute. ELM teachers had significantly higher rates of group response opportunities than teachers of BAU curricula after controlling for MCK (b = 0.558, SE = 0.107, β =.41, p <.001), eliciting an additional 0.56 group responses per minute.
The interaction term for the rate of individual response opportunities was significant (b = 0.006, SE = 0.004, p =.086), indicating that the association between teacher MCK and the rate of individual responses varied by condition. Simple slopes analyses revealed that for teachers using ELM, the relationship between teacher MCK and individual response opportunities was positive and significant (b = 0.005, SE = 0.003, β =.25, p =.047). Specifically, for every 10% increase in teacher MCK, ELM teachers elicited an additional 0.05 individual response opportunities per minute. For teachers of BAU curricula, the relationship between teacher MCK and individual response opportunities was not significant (b = −0.001, SE = 0.003, β = −.05, p =.674).
We next examined teacher MCK as a dichotomous variable, comparing teachers who scored in the lower three quartiles with teachers who scored in the upper quartile (0 = lower, 1 = upper; see Table 3). The interaction term for teacher demonstrations was significant (b = −0.250, SE = 0.126, p =.049), indicating that the association varied by condition between the lower three quartiles and upper quartile of teacher MCK and teacher demonstrations. Decomposing the significant interaction revealed that for ELM teachers, the difference in teacher demonstration rate between the lower three quartiles and the upper quartile of teacher MCK was not significant (b = −0.036, SE = 0.077, d = −.12, p =.639). For teachers using BAU curricula, there was a significant positive difference in teacher demonstration rate between the lower three quartiles and the upper quartile of teacher MCK (b = 0.214, SE = 0.099, d =.71, p =.033). Thus, the effect of being a control teacher in the upper quartile of teacher MCK resulted in a 0.21 increase in the rate of teacher demonstrations compared with a control teacher in the lower three quartiles.
Table 3. Results of Regressing Teachers' Instructional Behaviors on Teacher MCK as a Dichotomous Variable, Condition, and the Teacher MCK-by-Condition Interaction
Teacher Demonstration (rate/min) Group Response (rate/min) Individual Response (rate/min) Model 1 Model 1 Model 2 Model 1 Model 2 Intercept .462 .644 .682 .449 .430 (.041) (.086) (.081) (.047) (.045) Teacher MCK .214 .548 .327 .015 .129 (.099) (.208) (.128) (.114) (.070) Condition .130 .638 .563 .146 .185 (.058) (.121) (.108) (.066) (.059) Teacher MCK × Condition −.250 −.356 – .183 – (.126) (.264) (.145) .058 .245 .233 .118 .107 2.52 13.28 18.88 5.51 7.42
Graph
- 8 Note. Model 1 presents results from the moderation analyses. When interaction terms were not significant at the p ≤.10 level, the interaction term was dropped from the model to examine main effects of teacher MCK and condition (see Model 2). Standard errors are reported in parentheses. Teacher MCK was coded as 0 = lower three quartiles, 1 = upper quartile. MCK = mathematics content knowledge.
- 9 + p <.10.
- 10 * p <.05.
- 11 ** p <.01.
The interaction term was not significant for group response opportunities (p =.179), or individual response opportunities (p =.208; see Table 3, Model 1), and thus we dropped the interaction term from the models to examine main effects. For group response opportunities, the effect of being a teacher in the upper quartile of MCK compared with the lower three quartiles resulted in a 0.33 increase in the rate of group response opportunities. ELM teachers had significantly higher rates of group response opportunities than BAU teachers, after controlling for level of teacher MCK (b = 0.563, SE = 0.108, d =.89, p <.001). Specifically, ELM teachers elicited an additional 0.56 group response opportunities per minute.
For individual response opportunities, there was a significant positive difference in the rate of individual response opportunities between the lower three quartiles and upper quartile of teacher MCK after controlling for condition (b = 0.129, SE = 0.070, d =.34, p =.069), with teachers in the upper quartile eliciting an additional 0.13 individual response opportunities per minute. ELM teachers had significantly higher rates of individual response opportunities compared with control teachers after controlling for level of teacher MCK (b = 0.185, SE = 0.059, d =.49, p =.002), eliciting an additional 0.19 opportunities per minute.
Table 4 presents the results of the HLMs regressing student gains on the TEMA-3 across kindergarten on (a) teacher MCK as both a continuous and dichotomous predictor (lower three quartiles vs. upper quartile), (b) condition (ELM vs. BAU), and (c) the interaction between the two. For both definitions of teacher MCK, the interaction term was not significant (p =.847 when examining MCK continuously, and p =.973 when examining MCK dichotomously; see Table 4, Model 1) and was therefore excluded from Model 2. Thus, interpretation focuses on Model 2, regressing student mathematics achievement gains on teacher MCK and condition.
Table 4. Results of Hierarchical Linear Models Regressing Student Mathematics Achievement Gains on Teacher MCK as a Continuous and Dichotomous Variable, Condition, and the Teacher MCK-by-Condition Interaction
MCK as Continuous Predictor MCK as Dichotomous Predictor Model 1 Model 2 Model 1 Model 2 Fixed effects: Intercept 15.34 15.41 15.81 15.82 (.51) (.52) (.60) (.56) Teacher MCK −.06 −.05 −1.72 −1.79 (.03) (.02) (1.04) (.80) Condition 1.64 1.54 1.52 1.52 (.71) (.71) (.83) (.72) Teacher MCK × Condition .01 – −.05 – (.04) (1.51) Variances: Between classrooms 8.57 8.63 8.79 8.72 (2.93) (2.94) (2.96) (2.95) Between students 39.92 39.89 9.66 39.93 (6.32) (6.32) (6.30) (6.32)
Graph
- 12 Note. Model 1 presents results from the moderation analyses. In both analyses, the interaction term was not significant and was excluded from the model to examine the main effects of teacher MCK and condition (see Model 2). Standard errors are reported in parentheses. When examining Teacher MCK as a dichotomous predictor, the variable was coded as 0 = lower three quartiles, 1 = upper quartile. MCK = mathematics content knowledge.
- 13 + p <.10.
- 14 * p <.05.
- 15 ** p <.01.
First, examining teacher MCK as a continuous predictor, for a 1 percentage point increase in teachers' MCK score, student gain scores decreased by −0.05 points (SE = 0.02, p =.033) after controlling for intervention condition. Compared with students of control teachers, students of ELM teachers had higher gain scores by 1.54 points (SE = 0.71, p =.038) after controlling for teacher MCK. Variance components indicated that 21.6% of the variance in student mathematics occurred between classrooms. Significant between-classroom variation remained after accounting for teacher MCK and condition (p <.001). We next examined teacher MCK as a dichotomous predictor of student mathematics achievement. Having a teacher who scored in the upper quartile of MCK compared with the lower three quartiles of MCK resulted in a decrease in student mathematics achievement gains by 1.79 points (SE = 0.80, p =.026) after controlling for condition. Students of ELM teachers benefited from a 1.52 increase in student mathematics achievement gains (SE = 0.72, p =.036) after controlling for teacher MCK.
The purpose of the current study was to investigate the interaction between teacher MCK and curriculum (ELM vs. BAU) on teacher instructional behaviors (RQ1) and student mathematics achievement (RQ2). With heightened focus from policy makers and PD leaders on increasing teachers' MCK, along with research indicating that teacher MCK is associated with teaching behaviors and student outcomes, the results of this study contribute to the extant literature by examining MCK in the context of a research-based curriculum (Clarke et al., [
Although our hypotheses did not specify different patterns of findings for the instructional behaviors examined (i.e., teacher demonstrations, group response opportunities, and individual response opportunities), this emerged in the analyses. Significant interactions also differed depending on how teacher MCK was examined (i.e., continuously or dichotomously). Below, we summarize results and interpretations separately for each instructional behavior.
Examining teacher MCK continuously, no significant interaction emerged between teacher MCK and condition on teacher demonstrations, though the interaction term was trending toward significance with a p value of.136. Examining teacher MCK dichotomously, there was a significant interaction between the lower three quartiles and upper quartile of teacher MCK and condition on teacher demonstration rate. This interaction revealed that for ELM teachers, the rate of teacher demonstrations was not significantly different depending on level of teacher MCK (rates were 0.592 and 0.556 for the lower three and upper quartiles, respectively). In a 60-minute mathematics lesson, this would translate to ELM teachers providing about 33–36 teacher demonstrations, regardless of teacher MCK level. For control teachers, there was a higher rate of teacher demonstrations for teachers scoring in the upper quartile of MCK compared with those scoring in the lower three quartiles. Specifically, teachers in the lower three quartiles of MCK had a demonstration rate of 0.462 (about 28 demonstrations in a 60-minute lesson) compared with 0.676 (about 41 demonstrations in a 60-minute lesson) for teachers in the upper quartile of MCK.
The nature of this interaction aligned with our original hypothesis that a positive relationship between teacher MCK and instructional behaviors would emerge for control teachers, but that the instructional behaviors of ELM teachers would be relatively consistent across different levels of teacher MCK. Given that ELM is fully scripted and provides highly specified teacher models, it is not surprising that the rate of teacher demonstrations was consistent across levels of teacher MCK for ELM teachers. Control teachers used curricula that varied in the degree of built-in teacher supports to facilitate demonstrations, such as specific language to model mathematics concepts. Several teachers in the control condition used teacher-developed curriculum materials, which likely did not specify demonstrations of mathematical concepts. It follows that teacher MCK would play a greater role in determining the rate of teacher demonstrations for teachers of BAU curricula.
Examining teacher MCK both continuously and dichotomously, no significant interactions emerged between teacher MCK and condition on the rate of teacher-elicited group responses. Main effects models revealed a positive relationship between teacher MCK and the rate of teacher-elicited group responses. In addition, ELM teachers provided a higher rate of group response opportunities overall. Examining teacher MCK continuously, ELM teachers with average MCK had a group response rate of 1.317, eliciting about 79 group responses in a 60-minute mathematics lesson. Control teachers with average MCK had a group response rate of 0.759, eliciting about 46 group responses in the same time frame.
Our findings were contrary to our hypotheses, with the results of the current study suggesting that, regardless of curriculum, the rate of teacher-elicited group response opportunities was positively associated with teacher MCK. In addition, across the continuum of MCK, ELM teachers provided higher rates of group response opportunities. These findings are noteworthy for several reasons. First, although ELM is a fully scripted curriculum, teachers' use of group responses varied depending on their knowledge for teaching mathematics. This suggests that even with highly specified group response opportunities, teachers with varying levels of MCK made use of the curriculum in different ways. Another point of interest is the finding that ELM teachers provided higher rates of group response opportunities across levels of MCK. To further contextualize this, a control teacher with average MCK would need to increase their MKT score by about 50% to equal a teacher with average MCK in the ELM condition. Perhaps the specificity of group response opportunities written into ELM supported teachers with lower MCK to use a higher base rate of group response opportunities compared with BAU teachers. It is also possible that ELM teachers with higher MCK went above and beyond, making use of the group response opportunities built into the curriculum but also incorporating more opportunities for students to participate as needed throughout instruction. The fact that curriculum played a role in the rate of teacher-facilitated group response opportunities is in line with previous research that curriculum can influence teacher behaviors and student learning opportunities (Remillard & Reinke, [
We detected a significant interaction between teacher MCK and condition on individual response opportunities when examining teacher MCK continuously, though not dichotomously (p =.208). The pattern of significant findings indicated that for ELM teachers, as teacher MCK increased, the rate of individual response opportunities increased, whereas for control teachers there was no relationship between teacher MCK and the rate of individual response opportunities. Specifically, a 10% increase in teacher MCK for ELM teachers resulted in an additional 0.05 individual response opportunities per minute, translating to about three additional individual response opportunities in a 60-minute lesson.
The nature of the significant interaction was contrary to our hypothesis. We found a positive relationship between teacher MCK and individual response opportunities for ELM teachers, and no relationship for control teachers. This finding could be explained by the way that individual response opportunities are presented in the ELM curriculum. Typically, directions for eliciting individual responses are less specific and include statements such as "As time allows, call on several children to choose a card and perform an action," or "Have individual children show you groups of 2 from the chant." Given that the number of individual responses to provide was left open to teacher interpretation, it is possible that teachers with higher MCK differentiated instruction to a greater degree or made better use of instructional time overall, allowing for more individual practice. In the BAU condition, teachers provided a similar rate of individual response opportunities regardless of MCK. Though purely speculation, it is possible that control teachers with higher MCK prioritized different instructional behaviors during their instructional time, such as group response opportunities. It would follow that control teachers with lower MCK were more likely to provide individual response opportunities, and teachers with higher MCK minimized their use of individual response opportunities, resulting in relatively equal rates of individual response opportunities across MCK levels.
We hypothesized that there would be a significant interaction between teacher MCK and curriculum on student mathematics achievement gains, such that for ELM teachers the association would be weaker between teacher MCK and student mathematics achievement compared with teachers of BAU curricula. Contrary to these hypotheses, the results of the current study suggest that there was not a significant interaction between teacher MCK and curriculum on student mathematics achievement. Main effects models revealed a similar pattern when examining teacher MCK continuously and dichotomously; therefore, only the continuous results are discussed here. There was a negative effect of teacher MCK on student mathematics achievement after controlling for condition, such that a 1 percentage point increase in teacher MCK resulted in a decrease in student mathematics achievement gain scores by 0.05 points. By these same parameters, a 10% increase in teacher MCK would result in a 0.50-point decrease in student mathematics achievement gain scores. There was a positive effect of ELM on student mathematics achievement, resulting in an increase in student mathematics achievement gains by 1.54 points after controlling for MCK. The finding that teacher MCK had a negative effect on student mathematics achievement gains is surprising given other research indicating a positive relationship between the two variables (e.g., Hill et al., [
Nevertheless, the negative effect of teacher MCK is interesting and warrants discussion. One consideration with the current sample of students is that a large number of students were identified as at risk (defined as ≤40th percentile on the TEMA-3, including 66% of the sample in Clarke et al. [[
The findings of the current study must be considered in light of several limitations. First, given that the documented effect of teacher MCK is small (e.g., Agodini & Harris, [
Third, although the specific curricula used in the BAU condition were documented for most teachers, it would be useful to have more information about instruction in the control condition, including what curricula was used (if any) by the seven teachers who did not respond to the item. In addition, because teachers in the control condition used a variety of different curricula, we are unable to pinpoint specific curricular features that may have resulted in interaction effects on teacher instructional behaviors. An examination of the most commonly used BAU curricula revealed that around 70% of control teachers were using programs that have been described in the research as providing minimal or low teacher support. Nonetheless, one can only draw conclusions about features of ELM compared with a range of BAU curricula in the control condition that may or may not have included similar features. Last, given that ELM was implemented in the context of a larger RCT, ELM teachers received three 4-hour PD sessions throughout the academic year. Whether control teachers received similar levels of support is unknown. Although we consider it unlikely given the research demonstrating that PD alone typically does not have an impact on teacher behavior (e.g., Garet et al., [
Given the national focus on increasing student mathematics achievement through teacher variables such as teachers' MCK, the current investigation presents a timely exploration of possible mechanisms to move the dial on student mathematics achievement. Several findings are particularly worthy of revisiting. The results of the current study indicate that teacher MCK did influence teachers' implementation of ELM across two of the three instructional behaviors examined. ELM teachers with higher MCK provided higher rates of both group and individual response opportunities. This supports prior research indicating that different teachers make use of curricula in different ways (Remillard et al., [
These findings have implications for curriculum developers, PD leaders, and districts selecting core mathematics curricula, in regard to how teachers with varying backgrounds might make use of different curricular programs and features. The results of the current study indicate that both teacher MCK and curricular features may contribute to teachers engaging in different instructional behaviors. In addition, although districts should consider that the training and MCK of their teachers may affect implementation of curricula, the results of the current study also suggest that curricula with a high degree of implementation support have the power to shape the instructional behaviors of teachers above and beyond MCK.
Of equal interest is the need for further exploration of the role that teacher MCK and other teaching variables have on student mathematics achievement, particularly for at-risk students. The results of the current study suggest that teacher MCK had a small but negative effect on student mathematics achievement gains, whereas ELM had a positive effect. Given that the effect of teacher MCK was somewhat negligible from a clinical standpoint, targeting curricula with a high degree of implementation support that can be used by teachers with a range of skill sets may be a more practical and effective way to increase student mathematics achievement. Although this study begins to unpack for whom and in what contexts curricula can be effectively implemented, future investigations of teacher and student characteristics are warranted. Developments in this research may help increase our knowledge base of how to best support teachers across the continuum of MCK to effectively implement curricula and ultimately lead to increased student outcomes across the board.
By Marah Sutherland; Ben Clarke; Derek B. Kosty; Scott K. Baker; Christian T. Doabler; Keith Smolkowski; Hank Fien and Joanna Goode
Reported by Author; Author; Author; Author; Author; Author; Author; Author