We have conducted an implementation science project exploring the systematic effect of equipping primary school teachers to incorporate digital learning materials (DLM) into classroom activities. As part of the implementation science framework used in the study–Active Implementation Framework–we drew upon a mixed-methods approach collecting data from a series of interviews, observations, surveys, log-books, and analysis of the data collected from the DLM.

This study explores 34 teachers’ needs, first, and understanding, then, of the integration of DLM into teaching and learning activities developed over time and during the four stages of the implementation project. Teachers participated in a series of workshops based on their expressed needs and then systematically used the DLM, integrating them, during the workshops, into classroom activities. This research is solely based on the explorative thematic analysis of the interview data collected at three intervals, before, during and towards the end of the implementation. All interviews were conducted with Zoom and recorded. We seek to answer the research question: What expectations about digital learning material in relation to teachers’ teaching emerge from the interview data, and how do they differ from a temporal perspective?

The researchers have used ChatGPT-4o to analyse the interview data for two reasons. First, to understand if ChatGPT-4o does a sufficient and maybe even surprising job at capturing the intricacy of practitioners’ concepts about the scope of the research. Second, to check for the accuracy of the analysis by listening to the interviews and going back to the transcribed raw data at random times to build a human-machine trust for future research purposes. It is crucial to pinpoint that the researchers have transcribed all the interviews by Whisper, and then listened to all the interviews while decoding each speaker.

The preliminary results indicate that:1) Teachers anticipated digital tools would enhance student engagement but recognized the need to adjust their teaching methods to integrate these technologies effectively.2) Teachers encountered difficulties such as technical problems, inadequate training, and challenges in keeping students focused and engaged with digital platforms.3) Variations in students' digital literacy affected their ability to engage with digital materials, with some excelling while others struggled, leading to uneven learning experiences.4) The temporal evolution of teacher perspectives on digital learning shows that while initially hesitant, many teachers' attitudes toward digital tools shifted over time as they adapted to and, in some cases, came to value the flexibility these tools offered. Finally, the analysis conducted through ChatGPT-4o was checked for accuracy by randomly choosing 10 events for which the researchers asked ChatGPT-4o to point to specific codes from the interviews and the specific speaker. This resulted in an accurate analysis, which was also supported by the researcher who had listened to all the interviews.

This study demonstrates the positive effects of systematic professional development interventions, the core of our project. It could indicate the impact of professional development on teachers' competence and confidence in using digital tools. But also that ChatGPT-4o can be used for conducting a thematic analysis, especially when the researcher is faced with large interview raw datasets.

Background Clinical education in Emergency services (EMS) is unique due to its dynamic environment, brief patient encounters, and unpredictable cases. EMS provides valuable learning opportunities for nursing students, fostering person-centered care approaches and a variation of clinical training and learning. Formative feedback is crucial todevelop knowledge and skills. Multisource feedback (MSF) offers a comprehensive assessment by incorporating feedback from various individuals, promoting self-reflection and targeted learning. MSF has not, to our knowledge, been systematically evaluated in the context of EMS, and therefore, the aim of the study was to describe nursing students’ experiences with MSF during their clinical education in the EMS, using a digital instrument as a facilitating tool.

Methods A qualitative design with an inductive approach was used. Data were collected in 2021, using focus group interviews (n = 4) with 31 final-semester nursing students in Stockholm, Sweden, who had conducted clinical education in the EMS and received MSF through a digital instrument. Data were analyzed using reflexive thematic analysis, guided by Braun and Clarke’s methodology.

Results Three themes revealed: feedback from sources familiar with the student’s learning objectives, feedbackfrom sources unfamiliar with the learning objectives, and general perceptions of MSF in the EMS. Students valued self-reflection and feedback from peers and supervisors for personal and professional growth. Patient feedback was challenging due to their limited contextual understanding and emotional states, while feedback from other healthcare professionals was appreciated but hindered by the healthcare professionals’ workload and timing constraints. Overall, students appreciated MSF’s diverse perspectives, enriching their learning, performance, and development.

This research investigates the design, development and implementation of Multiple Learning Analytics Dashboards (MLADs) with the goal of enhancing data-driven decision-making among teachers in primary education. The study presents a Design-Based Research (DBR) approach to ensure the iterative development and refinement of MLADs through collaboration with educational professionals. The research involved four key steps in the presented DBR approach: 1) identifying the requirements through stakeholder interviews; 2) generating design ideas through brainstorming sessions and prototyping; 3) collaboratively designing and developing MLADs and conducting usability testing to gather feedback; and 4) implementing the MLADs in real-world educational settings. This paper outlines the research methodology, the participants involved, and the progress made toward developing these Learning Analytics Dashboards (LADs). The outcomes highlight the creation of tailored MLADs for teachers across multiple municipalities, as well as the lessons learned from real-world implementation. Additionally, we analyze user feedback from teachers regarding the dashboard's clarity, navigation, functionality, and design, providing a comprehensive view of the dashboard's usability and areas for future enhancement.

This study is part of a longitudinal, interdisciplinary implementation research project examining how systematic professional development shapes teachers' digital teaching practices. As schools and other educational organisations continue to adopt Digital Learning Materials (DLM), it is essential to understand the ways in which these shifts affect educators' perspectives and practices. This specific study addresses the research question: What discourses on digital learning material emerge in schools involved in a digitalisation project when a traditional (manual) discourse analysis is applied? We are particularly interested in how discourses are used and constructed by teachers and principals within pedagogical practice. 

Data consist of group interviews conducted at three points during the course of the project: at the beginning of the project, after one and a half years, and finally after two and a half years. In each phase, a total of 47 teachers, and school principals from five schools across four municipalities in Sweden were interviewed. 

The results of the analysis reveal both (A) emerging discourses on conceptualization and idealization of DLM and (B) how the discursive field evolves during the project. Within A) Emerging discourses centred on: DLM as a pedagogical tool; DLM as an effectivization tool; DLM as the limit in the Digital/Analog divide. Within B) Discourses of the digital-analog; Discourses of DLM; Discourses of DLM in teaching.

To conclude, the first part of the results provides a broad overview of the discourses that were present throughout the project. The focus here is on DLMs as part of the teaching context and how DLMs gain significance through how the analog teaching is conducted. The second part of the results becomes more detailed through its division of data into three sampling points and shows how different discourses become hegemonic, suppressed, and transformed throughout the project.

This paper presents a methodological case study on teachers' digital professional development, emphasizing the integration of automated and humanistic approaches. Drawing from a four-year pilot project led by the research group, we explore how three distinct analytical methodologies-manual discourse analysis, text mining, and large language model-assisted thematic analysis-were employed to examine teachers' discursive practices regarding digital learning materials. The study investigates how integrating these methodologies enhances our understanding of digital learning material-related discourses and their evolution over time. Key findings reveal two primary conceptualizations: digital learning materials as pedagogical/effectivization tools and as complementary to analogue resources. The integrated approach demonstrated advantages in mitigating methodological biases, improving reliability, and enabling a richer analysis of diverse data sources. This work contributes to the development of robust analytical frameworks for studying the intersection of technology and pedagogy in educational settings.

The promise of Learning Analytics Dashboards in education is to collect, analyze, and visualize data with the ultimate ambition of improving students’ learning. Our overview of the latest systematic reviews on the topic shows a number of research trends: learning analytics research is growing rapidly; it brings to the front inequality and inclusiveness measures; it reveals an unclear path to data ownership and privacy; it provides predictions which are not clearly translated into pedagogical actions; and the possibility of self-regulated learning and game-based learning are not capitalized upon. However, as learning analytics research progresses, greater opportunities lie ahead, and a better integration between information science and learning sciences can bring added value of learning analytics dashboards in education.

There is a significant amount of data available about students and their learning activities in many educational systems today. However, these datasets are frequently spread across several different digital services, making it challenging to use them strategically. In addition, there are no established standards for collecting, processing, analyzing, and presenting such data. As a result, school leaders, teachers, and students do not capitalize on the possibility of making decisions based on data. This is a serious barrier to the improvement of work in schools, teacher and student progress, and the development of effective Educational Technology (EdTech) products and services. Data standards can be used as a protocol on how different IT systems communicate with each other. When working with data from different public and private institutions simultaneously (e.g., different municipalities and EdTech companies), having a trustworthy data pipeline for retrieving the data and storing it in a secure warehouse is critical. In this study, we propose a technical solution containing a data pipeline by employing a secure warehouse—the Swedish University Computer Network (SUNET), which is an interface for information exchange between operational processes in schools. We conducted a user study in collaboration with four municipalities and four EdTech companies based in Sweden. Our proposal involves introducing a data standard to facilitate the integration of educational data from diverse resources in our SUNET drive. To accomplish this, we created customized scripts for each stakeholder, tailored to their specific data formats, with the aim of merging the students’ data. The results of the first four steps show that our solution works. Once the results of the next three steps are in, we will contemplate scaling up our technical solution nationwide. With the implementation of the suggested data standard and the utilization of the proposed technical solution, diverse stakeholders can benefit from improved management, transportation, analysis, and visualization of educational data.

Background Assessment of undergraduate students using assessment instruments in the clinical setting is known to be complex. The aim of this study was therefore to examine whether two different assessment instruments, containing learning objectives (LO`s) with similar content, results in similar assessments by the clinical supervisors and to explore clinical supervisors’ experiences of assessment regarding the two different assessment instruments.

Method A mixed-methods approach was used. Four simulated care encounter scenarios were evaluated by 50 supervisors using two different assessment instruments. 28 follow-up interviews were conducted. Descriptive statistics and logistic binary regression were used for quantitative data analysis, along with qualitative thematic analysis of interview data.

Result While significant differences were observed within the assessment instruments, the differences were consistent between the two instruments, indicating that the quality of the assessment instruments were considered equivalent. Supervisors noted that the relationship between the students and supervisors could introduce subjectivity in the assessments and that working in groups of supervisors could be advantageous. In terms of formative assessments, the Likert scale was considered a useful tool for evaluating learning objectives. However, supervisors had different views on grading scales and the need for clear definitions. The supervisors concluded that a complicated assessment instrument led to limited very-day usage and did not facilitate formative feedback. Furthermore, supervisors discussed how their experiences influenced the use of the assessment instruments, which resulted in different descriptions of the experience. These differences led to a discussion of the need of supervisor teams to enhance the validity of assessments.

Conclusion The findings showed that there were no significant differences in pass/fail gradings using the two different assessment instruments. The quantitative data suggests that supervisors struggled with subjectivity, phrasing, and definitions of the LO´s and the scales used in both instruments. This resulted in arbitrary assessments that were time-consuming and resulted in limited usage in the day-to-day assessment. To mitigate the subjectivity, supervisors suggested working in teams and conducting multiple assessments over time to increase assessment validity.

Halfway through a four-year research project supported by implementation science and the Active Implementation Frameworks (AIF), this article reports on the status of the initial two implementation stages. Our research investigates the impact of systematically preparing educators and educational institutions to integrate digital learning materials and learning analytics dashboards to enrich teaching practices and improve student performance outcomes.

Furthermore, it seeks to establish a foundation for the use of innovative and validated educational technology (EdTech) through sustainable implementation strategies, evidence-based evaluation, and continuous redesign of digital learning materials. By adopting this comprehensive approach, we aim to enhance the knowledge base regarding effective digital innovation integration within educational environments.

We argue that applying implementation science in educational settings facilitates the adoption of effective innovations, promotes evidence-based decision-making, and helps identify and address obstacles to change. Our ongoing research underscores the transformative impact of implementation science in education. Thus far, we have highlighted the crucial role of teacher perspectives and the necessity of co-designing technology aligned with teaching and learning objectives.

This nuanced approach refutes the notion of a one-size-fits-all solution or a quick fix achievable in a single academic year. Instead, it advocates a dynamic, collaborative model that acknowledges the multifaceted nature of implementation. Our journey has reaffirmed the dedication of teachers, showcasing their readiness to invest time and effort when their professionalism is respected, and their input is genuinely valued and acted upon.

Research topic and aim

The generation and use of digital data and analyses in education comes with promises and opportunities, especially where digital materials allow use of Learning Analytics (LA) as a tool in Data- Based Decision-Making (DBDM). An exploratory systematic scoping review was conducted regarding the use and impact of LA and DBDM in classroom practice to outline aspects related to Digital Learning Material (DLM), teacher usage, and student learning in the context of K-12 mathematics education.

Theoretical framework

LA implies, analysing data to understand and optimise learning and learning environments (Siemens & Baker, 2012). In this study we discuss LA as “a sophisticated form of data driven decision making” (Mandinach & Abrams, 2022, p. 196). Data driven decision making or DBDM is a process used by teachers to make decisions based on data, to implement improvement actions and evaluate these innovations (Schildkamp & Kuiper, 2010). LA in DLM can offer learners adaptive functions embedded in DLMs or provide learners (and teachers) compiled student assessments in relation to learning goals extracted from learning activities (Wise, Zhao & Hausknecht, 2014). We focus on LA-use based on digital data for student learning, for teaching and for teachers’ DBDM.

Methodological design

The methodology used the five-stage framework (Arksey & O’Malley, 2005), identifying the research question, identifying relevant studies, study selection, charting the data, collating, summarizing, and reporting the results. For the analysis, thematic summary and synthesis was used to answer:

RQ1: How are analyses of digital data from DLM used in mathematics education?

RQ2: How do analyses of digital data from DLM impact teaching and learning?

Expected conclusions/findings

3653 records were identified whereof 15 studies were included. Results show that LA-research is an emerging field where LA-applications is used across many contents and curricula standards of K-12 mathematics education. LA-usage supports a wide variety of teachers’ data use. However, teaching by DBDM focused on supervision and guidance. LA-usage have a positive effect on student learning where high-performing students benefit most. Finally, we suggest a definition of an additional class of LA, which we introduce as Guiding analytics for learners.

Relevance to Nordic educational research

Research on using LA and DBDM is essential to support teachers and school leaders to meet today’s demands of utilising data, to be aware of possible unwanted consequences, and to use technology to enhance active learners and students’ ownership of learning.