Educational settings are emotional places where students experience diverse emotions in relation to academic activities and their outcomes. Emotions, in turn, greatly influence students' learning process and engagement. Research on emotions in Design-Based Learning (DBL) has so far been coarse-grained examining how students evaluate their overall feelings towards the DBL project. As yet, little is known regarding how specific DBL activities influence students' emotional experience. Therefore, we report a three-month field study of a DBL project involving 30 middle school students (aged 13–14) addressing dual research purposes: (
Keywords: Design-based learning; Achievement emotion; Context; Learning activity; Student; Children
Design can be seen as a valid form of inquiry, given the general goal of design activities is typically to develop or improve artefacts and services (de Vries [
One of the featured characteristics of DBL is engaging students in complex and sometimes interleaved processes of inquiry and designing. Specifically, the inquiry process in DBL forces students to carry out the design process in a flexible and highly opportunistic manner (Razzouk and Shute [
Research has shown that emotions can influence students' attention, engagement, and their choice of learning strategies (Efklides and Volet [
To address this apparent gap in related research, we carried out a three-month field study in a DBL classroom with 30 middle school students (aged 13–14). Overall, the dual aims of this study are: (
Table 1 The achievement emotions in the present study
Object focus Positive Negative Activating Deactivating Activating Deactivating Activity Enjoyment Relaxation Frustration Boredom Outcome Pride Contentment Anxiety Hopelessness
Table 2 Engagement aspects of emotion experience
Engagement aspect Description Measurement Concentration How well are you concentrating? EmoForm (i.e., From the cognitive aspect, ask the student to self-rate perceived concentration) Observation sheet (i.e., From behavior aspect, ask the researcher to observe the degree of being on-and-off task) Learn better Were you learning anything or getting better at something? EmoForm (i.e., Ask the student to self-rate perceived learning outcomes)
Specifically, the present study addresses the following two central research questions:
How do DBL activities unfold during the process? (e.g., in which manners and sequence DBL activities reveal by students?)
What relationships exist with students' emotional experience, when engaged in different DBL activities? (e.g., which DBL activities have a positive and which have a negative association with students' emotional experience?)
This paper makes the following contributions to the field: (
Learning can be addressed from a variety of perspectives. A constructivist learning perspective asserts learning is affected by the context, namely, in which an idea is taught, as well as by the students' beliefs and attitudes (Olusegun [
Prior attempts in relation to characterizing DBL activities fall into the following two categories: (
However, given the dynamic practices of designing and inquiry processes in DBL, current studies will not suffice in providing detailed accounts of how students approach and unfold tasks amidst DBL. For instance, they do not consider in detail how DBL unfolds in action from a student-centred perspective, and whether or how students interleave the aforementioned prescribed DBL elements while the learning activity takes place. In this paper, we refer to these mentioned critical aspects, especially regarding the designing and inquiry process of DBL, to reconstruct how DBL activities can be unfolded and approached by students; and to understand how DBL activities can be conceptualized and represented.
To understand the DBL activity at a systemic level, we adopted the curriculum development components (van den Akker et al. [
- The learning activity (e.g., the sequence and ritual of design and learning process: how tasks are unfolded and how students are learning);
- The grouping strategy (e.g., the allocation of learning tasks: student learning individually or in small groups);
- The social interaction (e.g., peer-to-peer communication and student–teacher interaction);
- The temporal aspects of the learning task (e.g., the duration on and sequence of learning tasks).
For example, one possible DBL instance could be described along these dimensions as follows: a student works individually (grouping strategy aspect) on interleaving between ideating design concepts and empathizing with design users (learning activity aspect), and the teacher provides support to this student (social interaction aspect) when this student is interleaving between these two tasks for a long time (temporal aspect).
Emotional experiences are ubiquitous and greatly influence the learning process. Some researchers consider emotional experiences as a "way of being" and study them as holistic episodes (Schutz et al. [
In the field of DBL, there has been increasing attention placed on studying or measuring emotion as a part of the evaluation of DBL activities (Barak and Doppelt [
In emotion research, some models and theories use a limited set of categories to classify emotions (Feidakis et al. [
Few studies have directly examined achievement emotions in different learning contexts. For instance, one study (Lichtenfeld et al. [
As argued in a study conducted by Linnenbrink-Garcia and Pekrun ([
Students' engagement that reflects psychological investment and effort is necessary for learning (Shernoff [
The notion of engagement in the DBL has been addressed using different theoretical perspectives. For instance, one recent study in a maker space (Zollars [
Therefore, we put forward our conceptualization of engagement in the present study. This conceptualization is built on an integrated understanding of engagement according to the Flow theory and Broaden-and-Build theory. Table 2 illustrates this engagement conception, which includes the degree of concentration (i.e., how well you are concentrating?) and its perceived associated outcomes (i.e., were you learning anything or getting better at something?).
We report on a three-month case study of a class with 30 middle school students engaging in DBL activities carried out as part of the standard Dutch school curriculum in design and research. The study had a dual purpose of studying the activities in the DBL context and the students' associated emotions experience. A triangulated mixed-methods approach (Creswell [
The present study was embedded in a Design & Research subject (i.e., O&O; the Dutch abbreviation for "Onderzoeken en Ontwerpen") at a Dutch public school so-called "Technasium." Students at Technasium develop STEM-related competences and design skills (e.g., creativity, collaboration, communication, planning, and project-based work). Overall, the Design & Research (O&O) subject in Technasium education is closely related to STEM contexts (Vossen et al. [
In the present study, the design challenge of this DBL project was to design an escape room for the local fire department to allow participants to playfully and interactively improve awareness of fire safety in and around the house. In this Escape Room project in the present study, the design challenge students have to address is more related to the technological and engineering content and knowledge about design and inquiry. The learning goal in this Escape Room design project is open-ended and depending on the student-oriented personal learning objective. In general, the typical learning goal in this project is to learn design and inquiry skills (e.g., empathize with the client's need, inventing, modeling, use, and value information) and collaboration skills (e.g., communicate and cooperate with peer students and stakeholders). The design brief of this Escape room project is described in detail in "Appendix 1". The learning outcomes of this escape room DBL project includes students' puzzle design artefacts (see examples in "Appendix 2") and their project reports documenting how they develop their design works.
Before the study was initiated, we ascertained that the planned learning activities match four DBL characteristics that have been used in prior studies (Zhang et al. [
- The learning activity should be open-ended, followed by a design process, and involving multidisciplinary knowledge and skills. Furthermore, the challenge and problem introduced in this learning activity should be embedded in an authentic context.
- The teacher's role should be that of a coach enabling the students to become active learners.
- The grouping should enable students to share a sense of responsibility and be able to communicate and collaborate with peers and stakeholders.
- Materials and resources should support hands-on activities, e.g., prototyping or testing and minds-on activities, e.g., empathizing, defining, or ideating.
Participants were a class of 30 middle school students aged 13–14 who are at the level of HAVO2 (equivalent to the grade 7–8 in a secondary education system). In the Dutch education system, the HAVO stream gives access to polytechnic level tertiary education, which in the Netherlands is considered an applied science university. This stream is not the most challenging in secondary education, but one where science and design skills are of high importance. Participants in this study already had 1 year of experience with STEM and DBL. Before participating in the Escape room design project, they have already been involved in two design projects (e.g., designing a working toy for pigs in an organic form and designing a system encouraging students to classify garbages). Besides, they have also participated in several skill training modules, such as technical drawing and sketching, making video presentations, and working with workspace tools and materials (e.g., wood, acrylic, cardboard, etc.). The guardians of participating students provided informed consent before the start of the study.
To overcome the challenges involved in obtaining reliable data about young students' emotions in the DBL classroom (Zhang et al. [
EmoForm (Zhang et al. [
Graph: Fig. 1 Example of a filled EmoForm (a made-up example based on actual reports)
The content of EmoForm consists of four sections of questions: (
Combined with students' self-reporting with EmoForm, we used an observation note sheet which applies continuous recording (Miltenberger [
We've involved two participating observers (i.e., research assistants) who were trained before the start of the study. They observed one team using the observation note during every lesson. Every group in the class is observed in a pre-determined order over time.
Two types of interview were conducted during and after the DBL project. (a) a semi-structured interview following a predetermined protocol was conducted during the project. Specifically, one observer observed a specific team (following a predetermined order) at every lesson. Before the daily lesson ended, the observer interviews the same group of students one by one. The questions during the interview revolved around one or two episodes the observer has recorded. (b) After the end of this project, a structured in-depth interview was conducted with the students who have reported multi-tasking activities, to get a deeper understanding of reported cases.
Seventeen lessons were scheduled during this DBL course lasting three months. The lesson duration varied: three sessions of 50 mins, eight sessions of 100 mins, and six sessions of 150 mins. As shown in Table 3, all seventeen lessons/sessions were observed using our observation note sheets. However, semi-structured after-lesson interviews and EmoForm were completed only in fourteen and fifteen sessions, respectively. The exceptions, where data was not collected from both measurements, concern some unexpected situations (a canceled lesson, and a visit to the local fire department where it was not possible to distribute questionnaires nor interview). Besides, one structured in-depth group interview was conducted after the end of this project.
Table 3 The procedure of scheduled lessons and data collection
Lesson date Lesson duration Data collection (Year 2017) (mins) EmoForm Observation Interview (a) Interview (b) March 29 100 √ – April 11 100 √ √ √ – April 12 150 √ √ √ – April 18 100 √ √ √ – April 19 50 √ √ – April 25 100 √ √ √ – April 26 50 √ – May 16 100 √ √ √ – May 17 150 √ √ √ – May 23 100 √ √ √ – May 24 150 √ √ √ – May 31 150 √ √ √ – June 07 150 √ √ √ – June 13 100 √ √ √ – June 14 150 √ √ √ – June 20 100 √ √ √ – June 21 50 √ √ √ – Post project – – – – √
Annotation not applicable; interview (a) semi-structured after-lesson interview; interview (b) after-project structured think-aloud group interviewNote The exceptions of missed sessions concerned some unexpected situations (i.e., a canceled lesson and a lesson was scheduled to visit the local fire department where it was not possible to distribute questionnaires), where data was not collected from EmoForm and interview (a)
In this paper, we analysed the data collected from EmoForm as the primary source, while observations and interview recordings as supplementary sources. The quantitative analyses are made with IBM SPSS statistics 25 (IBM Corporation [
To answer RQ1 (How do the DBL process unfold?), we first qualitatively analyzed the data collected by observations and EmoFoms following a thematic analysis approach (Braun and Clarke [
Table 4 The categorized activities in the task dimension
Category Activity Theoretical source Design Thinking Process (DTP) Empathize Design User (EDU) Design element Define Design Problem (DDP) Design element Ideate Design Solution (IDS) Design element Make Prototype (MP) Design element Test Prototype (TP) Design element Combined the above steps (DTP) Project Management (PM) Design Documentation (DD) Design element and project characteristics Planning (PL) Project characteristics Prepare/present Presentation (PP) Design element and project characteristics Combined the above steps (PM) Task-related Social Interaction (TSI) Get Support from Teacher (GST) Teacher's role Get Feedback from Others (GFO) Assessment and social context Ask or Offer Help (AOH) Social context Review Other's Work (ROW) Social context Chat With Peers (CWP) Social context Combined the above steps (TSI) Mixed design process steps and task-related social interaction (DTP-TSI) e.g., EDU-GST, IDS-GFO, etc. Mixed design thinking process steps and project management (DTP-PM) e.g., DDP-DD, IDS-PP, etc. Mixed project management and task-related social interaction (PM-TSI) e.g., PP-GST All categorized tasks in parallel (DTP-PM-TSI) e.g., MP-PP-GST
Additionally, we descriptively reported sequences of switching tasks based on data from both EmoForm and observation notes, and we portrayed the overall evolution of participating DBL tasks per student over days (as seen in Fig. 2). Likewise, we reported the manner of combining tasks based on EmoForm data, and we then furtherly validated these results through interviews. More detailed results can be found in the task strategy (single-tasking vs. multi-tasking) Result section. We also analysed the highlighted types of combined tasks based on the frequency of reported students (as shown in Table 5), and we portrayed the relationship between combined tasks during DBL (as seen in Fig. 3). For executing tasks in the manner of groups or individually, we analysed the types of tasks favoured in teamwork and individual work based on the reported time spent. Besides, we also calculated students' average time spent on tasks when utilizing specific collaboration strategies (as shown in Tables 6 and 7). Detailed results can be found in the collaboration strategy (collaborative-tasking vs. individual-tasking) Result section.
Graph: Fig. 2 Evolution of participating DBL activities (per child) over days
Table 5 Highlighted task co-occurrence during multi-tasking
Type of task co-occurrence Co-occurrences Students (N) Total duration (mins) Mean Sd Max Min (1) Combining design process steps EDU-DDP 10 118.75 120.37 375 12.5 EDU-IDS 8 51.56 43.01 125 12.5 IDS-MP 5 80 68.81 175 12.5 MP-TP 5 117.5 59.69 150 12.5 (2) Combining task-related interaction GST-GFO 4 18.75 7.22 25 12.5 (3) Mixing design process steps and task-related social interaction EDU-GST 6 58.33 73.60 200 12.5 EDU-GFO 5 30 11.18 50 25 IDS-GST 8 50 62.32 200 12.5 IDS-GFO 7 42.86 37.40 100 12.5 DDP-GFO 4 62.5 53.03 125 12.5 EDU-IDS-GFO 4 53.13 41.30 100 12.5 IDS-GST-GFO 4 15.63 6.25 25 12.5
Note some task co-occurrences are selected and represented in this table when reported on the EmoForms by more than four students (N ≥ 4), to have some ideas on frequently reported types of multi-tasking Abbreviations EDU, Empathize Design User; DDP, Define Design Problem; IDS, Ideate Design Solution; MP, Make Prototype; TP, Test Prototype; GST, Get Support from Teacher; GF, Get Feedback from Others
Graph: Fig. 3 Relationship between DBL activities in multi-tasking
Table 6 Average time (in mins.) on collaborative-tasking (CT)
Collaboratively involved in a single task (CT*ST) CT*MT Total EDU DDP IDS MP TP PP GST GFO DD PL Mean 66 69 51 45 58 50 925 sd 276 94 182 222 43 10 35 48 24 0 217 408 Max 1075 262.5 587.5 750 175 87.5 112.5 112.5 175 50 737.5 1537.5 Min 25 12.5 12.5 50 25 25 12.5 12.5 100 50 12.5 25
Table 7 Average time (in mins.) on individual-tasking (IT)
Individually involved in a single task (IT*ST) IT*MT Total EDU DDP IDS MP TP PP GST GFO DD PL Mean 63 31 44 82 449 sd 121 70 160 74 32 35 22 27 43 n.a. 180 338 Max 462.5 225 550 275 100 100 50 62.5 150 n.a 662.5 1250 Min 12.5 12.5 12.5 37.5 25 50 12.5 25 25 n.a 12.5 25
Note In both Table 6 and Table 7: Tasks with a number in boldface are the ones with the majority proportion of time spent. The total column represents the total accumulative time spent (by all participants) on collaborative-tasking and individual-tasking, respectively AbbreviationIn both Table 6 and Table 7: ST—single-tasking; MT—multi-tasking (all combination of multitasking activities); CT*MT—all collaboratively involved multi-tasking tasks; IT*MT—all individually involved multi-tasking tasks; EDU—empathize design user; DDP—define design problem; IDS—ideate design solution; MP—make prototype; TP—test prototype; PP—prepare/present presentation; GST—get support from the teacher; GFO—get feedback from others; DD—design documentation; PL—planning
Based on the qualitative results relating to RQ1 (How do the DBL process unfold?), we synthesized a three-dimensional perspective of DBL activities (task, task strategy, and collaboration strategy dimension). Based on these results, we furtherly proposed the Activity-and-Affect model of DBL (as seen in Fig. 4) to establish the nuanced channels between DBL activities and students' emotional experiences. To assess the goodness of fit of the model, we fitted the data repeatedly collected by EmoForm into the taxonomy of this proposed model and then performed a linear regression using a hierarchical data structure (as shown in Table 8). Detailed analysis procedures and results can be found in the subsection of the Result section—A conceptual framework: the Activity-and-Affect model of DBL.
Graph: Fig. 4 The conceptual Activity-and-Affect model of DBL
Table 8 Coefficient regression using a hierarchical data structure
Emotion experience Model Level 3: Students Level 2: Days (student) Level 1: Task (days(student)) Level 1: Task strategy (days(student)) Level 1: Collaboration strategy (days(student)) Enjoyment .848 .659 .723 .047 .024 .754 .129 Relaxation .876 .736 .746 .033 .045 .085 Boredom .852 .629 .754 .033 .044 .109 Frustration .846 .616 .749 .044 .031 .385 .082 Concentration .799 .555 .672 .029 .039 .082 .086 Learn better .836 .595 .718 .069 .063 .093 Contentment .609 .301 – – .184 .377 .115 .202 .203 .057 Pride .640 .342 – – .139 .891 .106 .307 .149 .542 Anxiety .529 .196 – – .228 .053 .069 .853 .190 .112 Hopelessness .612 .289 – – .152 .778 .100 .402 .160 .398
Note (
Finally, to answer RQ2 (How are emotional experiences related to different DBL activities?), we performed multiple linear regressions using a stepwise method to furtherly measure which DBL activities significantly contribute to students' emotional experience (see Table 9 in "Appendix 3"). Specifically, this analysis investigates DBL activities from the dimensions of the task, task strategy, and collaboration strategy, respectively. All the multiple regression analyses were calculated on a group level, rather than distinguish individual differences. A detailed explanation of the analysis procedure and results are presented in the Results section.
Table 9 Coefficients of multiple linear regressions
Model Predictors Std. β (Constant) .000 DDP −.122 .000 CT .112 .000 ST −.138 .000 MP .129 .000 PP −.049 .042 (Constant) .000 EDU −.062 .019 GFO .101 .000 DD −.064 .010 GST .075 .002 %DTP-TSI .090 .000 MP .086 .001 (Constant) .000 EDU −.197 .000 TP −.132 .006 IDS −.130 .009 (Constant) .000 ST −.339 .000 MP .133 .008 %DTP −.127 .032 (Constant) .000 IDS −.106 .000 MP .201 .000 ST −.163 .000 IT −.074 .002 (Constant) .000 ST −.158 .000 IDS −.067 .007 PL −.058 .016 %DTP-PM .050 .039 (Constant) .000 MP −.130 .008 DDP .109 .026 (Constant) .000 %PM-TSI .170 .001 PP .148 .002 (Constant) .000 MP −.198 .000 EDU .148 .000 DDP .075 .002 %DTP −.071 .004 PL −.061 .009 GST .059 .012 %DTP-PM −.054 .021 (Constant) .000 %DTP-TSI .231 .000 EDU .157 .000 PP .082 .001 TP .070 .004 intT −.047 .052 GST .049 .040 DD .049 .043
Abbreviations EDU—empathize design user; DDP—define design problem; IDS—ideate design solution; MP—make prototype; TP—test prototype; PP—prepare/present presentation; GST—get support from the teacher; GFO—get feedback from others; DD—design documentation; PL—planning; intT—intertwined individual and collaborative tasking; %DTP—design thinking process; %DTP-TSI—combined design thinking process and task-related social interaction; %DTP-PM—combined design thinking process and project management; %PM-TSI—combined project management and task-related social interaction
We report the findings relating to RQ1 (How does the DBL process unfold?) from the following three aspects: (a) task dimension: various tasks and varied paths of the process, (b) task strategy dimension: multi-tasking versus single-tasking strategy, and (c) collaboration strategy dimension: collaborative-tasking versus individual-tasking used in the process. For each aspect, we first report the empirical findings derived from the present study and then discuss the theoretical implications relating to the literature. To the end, we propose a conceptual framework called the Activity-and-Affect model of DBL to construct a three-dimensional perspective of DBL activities and to describe a flexible view that taking account of how different DBL activities could be associated with mixed emotions.
In general, investigating how the process unfolds is essential for a proper understanding of context and its influence on behavior (R. Mehl and Conne [
On the top legend of this figure, each colour represents one type of tasks documented in EmoForm. Each square block in the table of Fig. 2 represents 1 day. The colourful stripes in the square block represent the tasks a student has completed within a day. For instance, the data described in Fig. 1 from a student, can be compressed into a single square block filled with five differentiating coloured strips (resembling the block of student H4 on day-2 in Fig. 2). The whole colourful square table describes all participated students involved activities in this DBL project. Nine teams were denoted in this figure alphabetically ranging from "A to I," and each group (containing three to four individual students) was denoted by a number, e.g., A1, A2 A3. The left side of this figure illustrates the observation data and primarily lists types of activities that were identified by observations rather than predetermined by EmoForm.
Due to the open-end nature of DBL, students have autonomy in planning and implementing tasks. As a consequence, how they went through a sequence of DBL activities varied across teams. For example, only teams B and E experienced all predetermined task-focused activities foreseen in the design of the EmoForm (refer to the top legend in Fig. 2). It is because some teams missed reporting some activities. Indeed, we observed that some teams (e.g., team A) participated in design documentation, and others (e.g., C, D, and F) participated in the planning despite that participants did not report on this. There is also quite some variation in how teams experienced the DBL process: e.g., two teams (F and G) did not report social interactions (getting support from a teacher or giving feedback to others). Moreover, the degree of iteration in the process also varied substantially between teams. For example, team H went through activities iteratively most times, whereas teams F or G the least times.
Students seemed to follow a relatively consistent activity pattern over time. As one might expect, the activity of empathizing and understanding users (EDU) was reported mostly at the initial steps of their design process (almost all students report this on the first day and slightly fewer on the second). Continuing on the general pattern, we see that the activity of defining a design problem (DDP) very often happens together with, or right after the event of empathizing with the design user (EDU). There were more variations with regards to ideating design solutions (IDS), which took place early on or even only in the last few days of the project (Fig. 2).
Despite that all teams participated in defining the designing problem (DDP), it was only a small number of individual students who did so: on the ninth day of this project, eighteen students in total. The activity of making prototype (MP) and testing prototypes (TP) was left for the later phases of this design project. On the 13th day, all teams were involved in making and testing. The project ended uniformly for all groups and individuals as they were all engaged in preparing and presenting (PP) their work. Getting support from the teacher (GST) and getting feedback from others (GFO) happened at various times during the project with no apparent pattern, most often in parallel with other activities. Too few instances relating to design documentation (DD) and planning (PL) were recorded to allow discerning a common pattern.
Observation data shows some patterns in the learning process. Some off-task cases were indicated in classroom observations, such as dealing with a computer problem, searching for lost documents, looking at the phone while waiting for teacher's support, and goofing around. Apart from these non-task related activities, the most commonly reported events were documenting their designs and planning. Besides, the field observations in this study also discerned another three frequent activities relating to students' task-related social interaction amidst DBL. (a) Asking or offering help (AOH). It can be expressed by answering peer's questions and asking for instructions on the task, or students sometimes would help a team member with a task when they were doing some other tasks. Besides, we found offering help was often concerning trying out another team's prototype. (b) Reviewing other's work (ROW). It often occurred through testing prototypes and when following the presentation of another group. (c) Chatting with peers (CWP). It often happened in idle moments while waiting for other tasks, such as presentation, getting the teacher's support, and sometimes during an off-topic conversation.
In general, characterizing and categorizing DBL activities is a fundamental step to identify the most likely elements of DBL and support learning and teaching in practice. Based on the results derived from this study, we outlined a list of project-related tasks in Table 4, which comprises the three most likely categories: Design Thinking Process (DTP), Project Management (PM), and Task-related Social Interaction (TSI). The mixed steps and tasks in parallel (see the last four rows of Table 4) will be furtherly reported and discussed in the next sub-section in terms of the multitasking strategy.
Design thinking is a general theory of design (Buchanan [
Furthermore, this table identifies the category of project management to refer collectively to some auxiliary activities relating to the DBL context, e.g., presentation, design documentation, planning. Notably, an earlier study (Nieswandt and Mceneaney [
The final category pertains to social interaction, which includes getting support from the teacher or getting feedback from others. The importance of social context has already been emphasized in earlier works, e.g., the teacher's supportive coach role on students' tasks and processes in DBL (Bekker et al. [
During the DBL process, students sometimes engaged in one singular task after the other, and at other times carried out multiple tasks in parallel. Single-tasking refers to a single activity (e.g., one specific stage of the design thinking process, or separate action of receiving help from the teacher, etc.) on which students dedicated a sustained period before interleaving and switching to other tasks. For instance, the EmoForm in Fig. 1 illustrates a single task from the timeframe of 50 min until 75 min. On the contrary, multi-tasking refers to two to three project-related tasks carried out in parallel within the same timeslot. Note that the term multi-tasking here does not apply to non-project-related tasks (such as working while listening to music, or goofing around, etc.).
From the data collected from the first section of EmoForm, students reported working on a single task more often rather than in multi-tasking. For single tasks, students tend to spend the most time on empathizing design users (M = 365 mins, SD = 275 mins), making a prototype (M = 328 mins, SD = 213 mins), and ideating design solutions (M = 318 mins, SD = 205 mins). Overall, students worked on at most two to three tasks within any single time interval (25 mins), and six types of task co-occurrences can be discerned that are detailed below. Notably, the first and third types of task co-occurrences stand more robust than the rest types based on the frequency of involved students.
- Combining different design process steps;
- Combing task-related social interaction;
- Mixing design process steps and task-related social interaction;
- Combining design thinking process steps and project management;
- Mixing project management and task-related social interaction; and
- All categorized tasks in parallel.
When interviewed about their multi-tasking behavior, most students did not mention any motivation or purpose for starting to multi-task. During the interviews, students reported multi-tasking activities when they were involved in different successive tasks (or, in other words, sequential tasking) in a single time interval (e.g., 25 mins). Furthermore, analysis of the interview data (which were also consistent with the results obtained from the observations and the EmoForm) helped identify the following two particular situations which appear to be related to multi-tasking:
- When helping out a team member working on a different task than them; this was confirmed by our observation in the classroom where we could notice, e.g., one child making prototype while helping other with painting their work.
-
When tasks are inherently interdependent, in which case they discover new insights for one task while working on a different task [reflecting the opportunistic nature of the design process (Guindon and Raymonde [
41 ])]. For example, students explained that the task of making the prototype in parallel with ideating for the cases in which they would come up with new ideas (little changes or additional features) when they were building their prototype. Moreover, tasks (e.g., empathizing and ideating) were done in parallel in some cases, in which the team was searching for design inspiration. The combined task of defining the design problem and ideating design solutions happened when students discovered a new aspect of design problems during the time they were designing their solutions, which also in line with the observation findings.
Figure 3 visualizes all the co-occurrence relationships between different DBL tasks, which are extracted from EmoForm data. This figure shows how DBL activities were all be combined to some extent, except for planning. Nodes in the graph represent different types of activities, while lines in the figure represent by their thickness how often the specific activities are combined in multi-tasking. How often here means how many students have reported such a co-occurrence relationship between DBL tasks.
Overall, there is a stronger co-occurrence between empathizing design user (EDU), ideating design solution (IDS), getting support from the teacher (GST), and getting feedback from others (GFO). Additionally, the task of empathizing with the design user (EDU) was carried out throughout the entire design process and often in parallel with other minds-on activities (e.g., DDP, IDS) and also in parallel with other's input such as teacher's support (GST) and other's feedback (GFO). Interestingly, identifying the design problem (DDP) and testing prototype (TP) were not combined. Defining the design problem (DDP) is often combined with empathizing with users (EDU), which is a good example of the first type of task co-occurrence (i.e., connecting different design process steps) as described in the bullet lists above. This combination is understandable, as it provides a springboard for an in-depth understanding of the design challenge. Interestingly, as an example of the fourth type of task co-occurrence (i.e., combining design thinking process steps and project management), one child reported combining the activity of defining the design problem (DDP) with design documentation (DD).
The open-ended nature of DBL, on the one hand, gives students freedom in task implementation to encourage diversity in design approaches (Gómez Puente et al. [
Single-tasking refers to students spending a continuous time interval on a single task before interleaving and/or switching to others. For example, as seen in Fig. 1, the student applied the single-tasking on ideation between minute 50 and minute 75.
Multi-tasking is defined by Pashler ([
Students sometimes worked in small groups or individually during this project. Initially, students seemed to spend similar amounts of time on collaborative versus individual tasks. Different students exhibited different patterns in using collaborative or individual tasking strategy. For instance, the data reported in the EmoForm indicates that student H4 did almost all of the tasks collaboratively, except for a short moment of individual tasking on the fourth day. On the contrary, student A1 spent most time single-tasking except for the first 2 days of collaborative tasking and a few moments of collaborative-tasking on the nineth day. Overall, we found that all students followed both of these strategies, and most of them worked increasingly in collaboration as the project progressed.
Students seemed to spend more time on collaborative tasks than individual tasks based on data collected from the first section of EmoForm. Table 6 shows how students relatively spent relatively more time on collaborative tasks (see activities with boldface numbers) such as empathizing design user (EDU), ideating design solution (IDS), making prototype (MP), and design documentation (DD). Besides, students often engaged with multi-tasking activities collaboratively. Likewise, for individual tasks, as shown in Table 7, students tend to spend more time on empathizing design users (EDU), ideating design solutions (IDS), and making prototype (MP). Comparing the time spent on individual versus collaborative tasks (Table 6 versus Table 7), it seems that some tasks favoured individual works, such as defining the design problem (DDP), presentation (PP), and planning (PL). In some rare instances, students were involved in interleaved collaborative and individual work within a single 25-min timeslot. For example, a student spent half of the time collaboratively getting feedback from others collaboratively and individually for the remaining time.
These findings above are related to the social environment of DBL, which are driven by the peer learning process within and across teams when they share resources, engaging in debate, and exercise freedom in task implementation (Gómez Puente et al. [
Specifically, we refine that the collaborative task refers to small groups of students working together to achieve the same task goal or working together to finish assigned tasks. In contrast, individual tasks are situations when students work on tasks alone. In intertwined individual and collaborative tasks, students interleave individual and collaborative tasks frequently. As shown in the example of Fig. 1, the student is intertwining individual and collaborative tasks regarding empathizing design user and ideating design solution between the minute 125 and minute 150.
The Activity-and-Affect Model of DBL (as shown in Fig. 4) was synthesized from the results in this study to capture how students experience emotions during DBL activities (to answer RQ1 and furtherly understand RQ2 synthetically). It is intended as a conceptual model, and it expands upon earlier descriptions of the DBL process such as the DBL framework (Gómez Puente et al. [
- Describing the DBL activities from a multi-dimensional perspective. More specifically, all these vital elements of DBL are mapped along the task dimension, task strategy dimension, and collaboration strategy dimension, respectively.
- Having a nuanced view of how a specific activity could be associated with an emotional experience. This model establishes the nuanced channels between DBL activities and students' emotional experiences.
As shown in Fig. 4, this model introduces three dimensions of DBL activities using three identified colours. The blue rectangle block represents the task dimension, which includes three categorized tasks (see Table 4); the yellow circle and red circle represent the task strategy dimension and collaboration strategy dimension, respectively. These circles and rectangles presented with identified abbreviations and colors function as the foundations for constructing DBL activities from three dimensions. Further, every loop (connecting three nodes from each of the three dimensions, respectively) in this model represents a possible type of activity in DBL. For example, the loop on edge stringing with the nodes of "IT-MT-DTP" stands for the activity that individually involved multiple tasks in parallel to a design thinking process. In general, the arc connecting nodes represent one indicator of the emotional experience (e.g., enjoyment, frustration, etc.; see Tables 1 and 2 for the indicators of students' emotional experience). For example, the feeling of enjoyment when mixing multiple (task strategy dimension: MT) design stages (task dimension: DTP) in teamwork (collaboration strategy dimension: CT) is a part of a student's emotional experience of DBL. Likewise, the feeling of boredom when mixing multiple (task strategy dimension: MT) design stages (task dimension: DTP) alone (task strategy dimension: IT) is also a possible part of a student's emotional experience of DBL.
The discussion above introduced the Activity-and-Affect model of DBL to describe students' emotional experiences of DBL activities. Potentially this model is intended to explain students' emotional experience in DBL. For this purpose, we fitted a linear regression model to the data collected by EmoForms from a sample of 30 students on a repeated basis adhering to the taxonomy of our proposed Activity-and-Affect model of DBL. Specifically, we performed a linear regression using a hierarchical data structure (i.e., a linear regression-based analysis that takes the hierarchical structure of the data into account) to explain individual student's emotional experiences from DBL activities. Therefore, we sorted the data set collected by EmoForms into a three-level nested structure:
- _I_Level 1 (activity level)_i_ measurement occasions, i.e., DBL activities (where is coded as the dimension of _B__I_task_i_, task strategy, and collaboration strategy according to the structure of Activity-and-Affect model of DBL) nested within-day within-person.
- Level 2 (day level) repeated measurement nested within-day (which is measured as fifteen different lessons/days) within-person.
- Level 3 (student level) repeated measurements nested within-person (which is measured as 30 students).
The three-level multilevel multiple linear regression was calculated to explain six dependent variables of emotional experience (including enjoyment, relaxation, frustration, boredom, concentration, and learning better respectively) based DBL activities within days within-person. It is important to note that only one-time measurement rather than repeated measurement is designed within an occasion for this set of outcome-focused emotions (as seen in the last section of EmoForm in Fig. 1). Therefore, the two-level regression was calculated to explain four dependent variables of emotional experience (including contentment, pride, anxiety, and hopelessness). Overall, the results indicate that a regression model using a multilevel nested structure was a significant predictor of individual student's emotional experience within a day (as seen in Table 8, all outcome variables of emotional experience having the value of R
For example, the results (as seen in Table 8) indicate that a three-level structured regression model can significantly explain 84.8% of enjoyment variance, F (
This three-level structured regression model can significantly explain 87.6% of relaxation variance, F (
Likewise, the three-level structured regression model can significantly explain 85.2% of boredom variance, F (
With regard to frustration, results indicate that the three-level structured regression model can significantly explain 84.6% of frustration variance, F (
Our three-level structured regression model significantly explains 79.9% of concentration variance, F (
Similarly, the three-level structured model significantly explains 83.6% of learning better variance, F (
In terms of four outcome-related achievement emotions (e.g., contentment, pride, anxiety and hopelessness), the two-level structured regression model significantly explains 60.9% of contentment variance, F (
In the previous section, our results suggest emotional experience (including a total of ten dependent variables as summarized in Tables 1 and 2) in DBL is significantly dependent on individual students (level 3). Student's enjoyment, relaxation, frustration, boredom, concentration, and self-perception of learning better are dependent on the day when students took part in an activity (level 2). At the activity level (level 1), the multilevel regression results only indicate the general type of activity (from the dimensions of the task, task strategy, and collaboration strategy, respectively) in DBL.
To answer how specific DBL activities are related to the emotional experience (RQ2), we conducted multiple linear regression using a stepwise method to furtherly measure which DBL activities significantly contribute to students' emotional experience. Specifically, this analysis investigates the fine-grained types of DBL activities from the dimensions of the task, task strategy, and collaboration strategy, respectively. For instance, the task dimension is coded as the different sub-tasks (as summarized in Table 4). The task strategy dimension is coded as single-tasking and multi-tasking. Besides, the collaboration strategy dimension is coded as individual tasking, collaborative tasking, and intertwined individual and collaborative tasking. All the multiple regression analyses were calculated on a group level, rather than distinguish individual differences. The detailed results regarding multiple linear regressions are displayed in "Appendix 3" (see Table 9).
Overall, the descriptive results of each variable showed that students had a positive experience in DBL according to the low scored negative emotions and high scored positive emotions. For instance, the mean scores for anxiety (M = 1.16, SD =.56; N.B. score "1" as "not at all" and "5" as "very much"), hopelessness (M = 1.47, SD =.92) and frustration (M = 1.61, SD =.99) are low. The positive indicators of emotional experience, e.g., enjoyment (M = 3.24, SD = 1.16), contentment (M = 3.56, SD = 1.13), pride (M = 3.18, SD = 1.28) and self-perception of concentration (M = 3.50, SD = 1.11) had a relatively high scores. The remaining three indicators of emotional experience are to different extents near to the middle point of the scale, including boredom (M = 2.47, SD = 1.31), relaxation (M = 2.82, SD = 1.21) and self-perception of learning better (M = 2.32, SD = 1.11).
Getting feedback from others (GST) has a positive effect on student's relaxation (β =.101). Additionally, students who were busy with making prototype (MP) report a higher level of enjoyment (β =.129), relaxation (β =.086), pride (β =.133) and self-perception of concentration (β =.201) but also a lower level of boredom (β = −.198) and hopelessness (β = −.130). A mixed design thinking steps and project management (%DTP-PM) is a specific type of task where applying a multi-tasking strategy was found to have a positive effect on student's self-perception of learning better (β =.050) but a negative impact on student's boredom (β = −.054). Likewise, students using the collaborative-tasking strategy (CT) report a higher level of enjoyment (β =.112).
Some other tasks during the design thinking process seem to have a negative relationship with students' emotional experience. For example, students who were involved in the task of empathizing design user (EDU) report a lower level of relaxation (β = −.062), contentment (β = −.197), and in the meanwhile report a higher level of frustration (β =.157) and boredom (β =.148). Students working on the task of defining design problems (DDP) indicate a lower level of student's enjoyment (β = −.122), and a higher level of boredom (β =.075) and hopelessness (β =.109). Students, when busy with testing a prototype (TP), report a lower level of contentment (β = −.132) and a higher level of frustration (β =.070). Similarly, presentation (PP) and design documentation (DD) are the two project management tasks that both seem to be positively related to frustration (β =.082; β =.049, respectively). Besides, when working on design documentation (DD), students report a lower level of relaxation (β = −.064). In comparison, when busy with presentation (PP), students indicate a lower level of enjoyment (β = −.049) and a higher level of anxiety (β =.148).
The combined design thinking process and task-related social interaction (%DTP-TSI) is another specific type of task in which particularly applying a multi-tasking strategy was found to make students feel a higher level of anxiety (β =.170). Moreover, the single-tasking strategy (ST) seems to have a negative effect on student's enjoyment (β = −.138), pride (β = −.339), self-perception of concentration (β = −.163), and self-perception of learning better (β = −.158). Students using the individual-tasking strategy (IT) report a lower level of self-perception of concentration (β = −.074).
Interestingly, students involved in the task of planning (PL) report a lower level of boredom (β = −.061) and a lower level of self-perception of learning better (β = −.058). The combined design thinking steps (%DTP) seemed to be negatively related to both boredom (β = −.071) and pride (β = −.127). Similarly, students, when getting support from the teacher (GST) and involving a particular task of mixed design thinking steps and task-related social interaction (%DTP-TSI), report a higher level of relaxation (β =.075, β =.090 respectively) and also higher level of frustration (β =.049, β =.231 respectively). Furthermore, getting support from the teacher (GST) seemed also to be positively related to boredom (β =.059).
In summary, our results suggest future work should seek a more fine-grained understanding of the dynamic DBL process since some potential issues need to be clearly articulated, such as the level of iteration and multi-tasking. Besides, our results also suggest that students and educators should have a flexible approach towards the student's emotional experience. It is because there is a subtle relationship between students' emotional experience and different DBL activities that emotion may change along with moving among tasks or strategies.
This paper presents empirical evidence of the variety of ways in which students go through a sequence of DBL tasks. For example, as shown in Fig. 2, students made several transitions between empathizing (EDU) and ideating (IDS); however, not every student spent time reframing design problems (DDP). Few students interleaved making (MP) and testing (TP), while a few students seldom interleaved ideating (IDS) and building (MP). They mostly followed up with making (MP) and testing (TP) for the later parts of the project and uniformly ended the project by preparing and presenting (PP) their work, which consistently with the teacher's plan for the class and to enable assessment. Getting support from the teacher (GST) and getting feedback from others (GFO) occur at different times during the project with no apparent pattern, most often in parallel with other activities. This can be because different teams and individuals do not follow a strict synchronized process, so interactions happen serendipitously. Also, individuals may need help at very different moments depending on their abilities, their task, and their learning. Students in our case spent more time on design thinking steps such as empathizing (EDU), ideating (IDS), and prototyping (MP).
Even though they went through the design process in a relatively consistent way, some individuals do more iterations than others over time. It has been argued before (Hmelo et al. [
Despite that multi-tasking is not a new phenomenon as such, there has not been an earlier attempt to describe how students multi-task during DBL. Task switching has been recognized as a critical element of multitasking (Spink et al. [
Our findings suggest that specific tasks may invite individual work, e.g., empathizing (EDU), ideating (IDS), and prototyping (MP). However, other tasks may favor collaboration, e.g., defining (DDP), presentation (PP), and planning (PL). Students sometimes work individually or in small teams, and this case allowed us to observe how different individuals use different collaborative or individual tasking strategies. A general pattern across individual participants was that as the project progressed, students worked increasingly in collaboration. Future research could attempt to derive guidelines for DBL teachers regarding how to steer students in allocating their effort in individual or joint tasks.
Overall, DBL activities across the project were rated positively. Especially, prototyping is an appealing and enjoyable task in DBL. We found a positive relationship between prototyping and positive emotions, e.g., enjoyment and pride, which also is consistent with earlier findings (Zhang et al. [
Individual work seemed to be negatively related to students' self-perceived concentration levels. On the contrary, teamwork was consistently rated positively, in line with other earlier research, e.g., (Carroll et al. [
Mixing design thinking steps with project management is a type of task as a multi-tasking strategy, which seemed to increase students' self-perception of learning better and decreased boredom. This justifies investing some effort in tracking progress to be able to take charge of the project and also to move back and forward in the design process. Therefore, future design research in DBL could focus on developing tools for scaffolding students' planning and task management.
Earlier research provides no clear answer as to whether learning is more effective while students are in a positive or in a negative emotional state, as the answer largely depends on the nature of the learning task (Fiedler and Beier [
One limitation of this study concerns the potential inconsistencies in students' recording of data. Although we've used mixed methods of data collection (self-reporting surveys, classroom observations, and interviews) to triangulate the results, the risk of inconsistencies in data recording still may exist. It is due to the observation measurement in this study was conducted at a group level while the self-reporting survey was at an individual level. The strategy we've applied to fix the inconsistency is to focus more on the self-reported data while using observations to get more insights on the contextual information and using the interviews to verify the data collected in field observations and self-reporting surveys. We would suggest future work to resolve the potential inconsistency issue by testing the trustworthiness of data collected, which is equally important as using multimodal data collection to triangulate results. Another limitation concerns that the participants in this study already had experience with DBL for 1 year. This may have affected the results. Specifically, we could expect that for students experiencing DBL for the first time, there could be a novelty effect that could potentially result in more positive experiences and a different execution of the design process. In contrast, one strength of the present study is that such a novelty effect does not confound the results. Future research could examine how activities affect participants' emotions for groups who are at varying levels of experiencing DBL (e.g., who are novices or experts to DBL).
This work has been partially funded by China Scholarship Council (CSC) and partially funded by the Department of Science, Innovation and Universities: project RTI2018-099235-B-I00 and University of Oviedo to support the Computational Reflection Research Group (GR-2011-0040).
The authors declare that they have no conflict of interest.
Fire can cause a lot of damage and suffering. You can prevent fire or limit the damage with a few simple measures. Unfortunately, many people do not know what actions they should take if there is a fire. For tips on fire safety in and around the house, (See this link https://
Escape rooms have become enormously popular. The Eindhoven fire service wants to introduce people to fire safety in and around the house in a modern and interactive way via an escape room. Together with other people, you will be stocked in a place and try to escape from the room through instructions and solving puzzles.
You have been hired as a game designer to design an escape room for the fire brigade of Eindhoven. The client is Mr. Peter van der Horst from the Eindhoven fire department.
Design a mobile escape room that allows participants to get acquainted with fire safety in and around the house. This mobile escape room must fit into a sea container so that it can be deployed at different locations.
There are several conditions:
- A group of participants must be able to escape in half an hour.
- At least two puzzle assignments must be mechanical and/or electronic.
To achieve a good result, you may need to go through several steps:
- Step 1 Brainstorming. What do you already know about the subject? Which ideas come to you immediately? The client asks for a mind map of the ideas that the assignment evokes.
- Step 2 Professional training. You will work as a game developer during this assignment. The client wants you to briefly describe what exercise you can do to become a game developer and what the training entails. Also, he wants you to explain what this profession involves and what the activities are.
- Step 3 Understanding technical knowledge. The client wants to be informed about the professional language of the game developer. He expects to know the technical terms in this field and an explanation of how you apply them in the assignment.
- Step 4 Researching escape rooms. The client wonders which game elements provide an ultimate escape room experience. To answer this question, the client expects you to analyze several existing (educational) escape rooms. The client wants to see an analysis of the storyline, the plot, the operation of the 'puzzles,' and the atmosphere worked out.
- Step 5 Researching fire safety. What knowledge about fire safety do you want to impart to the visitors of the escape room? The client is curious about what themes around fire safety you find suitable as a red thread for the escape room (for example, setting up a safe house or what you can do when there is danger).
- Step 6 Identifying design requirements and parameters. The client wants a set of requirements and design parameters of the escape room based on your preliminary investigation. He expects to see an overview in which you indicate what parameters and conditions are set for the form, the content, and the use of the escape room.
- Step 7 Ideating a storyline. A strong story with a good plot is a basis for an escape room. This story connects the puzzles and ensures that the game runs logically. The client challenges you to come up with an engaging storyline that informs visitors about your theme within half an hour. What surprising twists are there? What links are there in the story that visitors have to discover? It is expected that step by step is explained what happens in the story.
- Step 8 Sketching design puzzles. "There are many ways that lead to Rome." Your story can still be worked out in various ways. For every step in the story, several puzzles can be considered. The client wants to see a brainstorm of puzzles per step in the story of every team member. You can refer to the ideas and puzzle forms from Escape rooms that you have found as an example in the preliminary investigation. Sketches and captions will make clear how the puzzle works, and which materials are used.
- Step 9 Designing. There are now several (three to four) ideas per step in the game! It is up to you to respond to each other's ideas in a constructive manner and to choose the best puzzle per step in the story or to make a combination of good ideas. The client expects that the red thread (storyline) comes to the fore through the choice of the puzzles, a good balance of the type of games, and a lot of variety (physical, thinking, mechanical, electronic, etc.). To be able to assess everything accurately, the client wants to see an overall picture of the course of the game and the puzzles that will be discussed. He expects you to explain in the file as visually as possible how the game progresses. He also likes to see an explanation of why your game meets the design requirements.
- Step 10 Prototyping. The client wants to work out at least two puzzles in the form of a working prototype (preferably scale 1: 1). At least one prototype is mechanical and/or electronic. The client expects technical drawings (dimensions in millimeter) and a working drawing so that he has a good view of the requirements for making the puzzle.
- Step 11 Completion of the assignment. The project is completed with a video presentation of the escape room in action. With this, the client has to get a good picture of your escape room. Show how each puzzle works and how it fits into the storyline. How does your escape room ensure that people gain relevant knowledge and found it fun to do?"
Students' puzzle design prototypes addressing the escape room design challenge in this DBL project are varied. For example, one group used the Littlebits to make a system that unlocked a door by a sensor. Some created traditional puzzles (e.g., the case of testing such a prototype in the photo below), while some invented informative puzzles. Some groups used accessible electronics (e.g., lights) to design their interactive puzzles. Some used physical principals (e.g., magnetism) to get a key out of a tube by a magnet.
Graph
Example of testing a puzzle prototype.
See Table 9.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
By Feiran Zhang; Panos Markopoulos; Tilde Bekker; Mpuerto Paule-Ruíz and Martine Schüll
Reported by Author; Author; Author; Author; Author