News & Cases

Global News in Smarter Education

Digital Lesson Observation series 1: Pedagogical Review of AI Sokrates

Pedagogical Review of AI Sokrates

The so-called digital lesson observation refers to the process of public teaching or teaching observation such as lesson observation, lesson discussion, and professional feedback, which is carried out in a digital way. During the process, the course data of lesson observation can be automatically collected, including data from teaching activity videos, teaching behaviors, and professional feedback on lesson observation. It is a way for modern digital lesson study or lesson review.

Promoting teachers' teaching professional ability can improve the quality and effectiveness of classroom teaching, and then improve students' academic performance. Research shows that teachers' behavior has a large impact on student achievement in terms of effect sizes, including professional development, quality of teaching, teacher training, teacher-student relationships, micro-teaching, etc. Among them, micro-teaching has the largest effect on student achievement. 

The digitalization of lesson observation is an efficient micro-teaching method and the best way to promote professional  discussion in teaching. In order to promote teacher professional development, open classrooms and hold public lessons activities are a global education trend and an excellent way to accelerate educational innovation and change.

• Pedagogical Review of AI Sokrates

Pedagogical Review of AI Sokrates is an innovative teaching discussion activity of digital lesson observation such as lesson observation/discussion and professional feedback with the support of the TEAM Model smarter classroom system. During the lesson observation, the feedback records of observing experts and the marks of AI Sokrates will be collected at the same time, which is a professional feedback mode combining expert wisdom and machine intelligence. After the lesson observation is over, all the data will be automatically saved in the Lesson Examples Channel, and lesson observers can conduct lesson study activities through the complete and rich lesson observation data on the platform.

• How observers participate

During lesson observation, observing teachers give feedback through the Sokrates Lecture Observation app. With the popularization of video conferencing technology applications, teachers can give feedback on-site (offline) and can also synchronously observe and give feedback online. Teachers who are unable to participate in lesson observation synchronously can also log in to the Lesson Examples Channel after class to do lesson observation and record feedback (asynchronously).

The observation app can be used on a smartphone, tablet, or laptop. The observing teachers give feedback (marking) while listening to the class. The marked content can be in the form of text, picture, audio, or video, preserving a rich variety of observer perspectives, professional feedback, or observation of the classroom learning performance of different groups and students.

• T-Index of Pedagogical Review of AI Sokrates

The machine intelligence of AI Sokrates conducts observation evaluation based on the type of data generated in the lesson, synchronously marks and gives lesson observation index. The index is divided into Technology Interaction (T) Index and Pedagogical Application (P) Index.

The Technology Interaction (T) Index is divided into five categories of analysis indicators, including T1: Data channel, T2: Data feedback, T3: Decision by statistics, T4: Focus on students, and T5: Multi-assessment. Statistics and analysis of the frequency and effective combination of each sub-item are applied, and the sub-item index and the total index are given. T Index ranges from 0 to 99, with 70 or more being shown as green light, 50-70 as yellow light, and 50 or less as red light. An appropriate combination of technology interactive function applications can obtain a higher index, and when the technology interaction index shows a green light, it means that the technology interactive application in this lesson has reached a proficiency level.

• P-Index of Pedagogical Review of AI Sokrates

The Pedagogy Application (P) Index of AI Sokrates has six analysis indexes, including P1: Group learning, P2: Whole-class interaction, P3: Student center decision, P4: Whole-class assessment, P5: Individual learning, and P6: Multi-approach assessment. The P Index uses these six indexes to evaluate the effectiveness of teaching behavior data features. The more effective teaching behavior data features are, the higher the index can be obtained.  P Index also ranges from 0 to 99, with 70 or more being shown as green light, 50-70 as yellow light, and 50 or less as red light.

The P Index reflects the applicability and effectiveness of applied teaching modules. Teaching has no fixed method, machine intelligence can only give feedback (index) from the perspective of assisting teachers. It depends on teachers' self-reflection and appropriate use of teaching modules in order to obtain the best teaching effect.

• Exclusive Lesson Examples Channel & Sokrates Platform

Each observation classroom is automatically connected to the Lesson Examples Channel, and data such as expert wisdom records and machine intelligence are collected and aggregated on the Lesson Examples Channel. Each school has its own independent exclusive channel to ensure the security of lesson observation data within the school. School districts joined by multiple schools also have independent and exclusive school district channels to conduct cross-school lesson observation activities in school districts (or cities). In addition, the lesson examples in the exclusive channel can be shared to the Sokrates Channel for other teachers to view and do academic exchanges with lessons from all over the world. 

Sokrates Video is the lesson example unit that stores the observation lesson data on the Lesson Examples Channel. All the observation lesson data of a lesson example constitute a Sokrates video. (Sokrates video example hyperlink)。

• Output data from the Pedagogical Review of AI Sokrates

Lesson Examples Channel automatically generates five application data, including: A. Sokrates Video, B. Sokrates Report, C. Lesson Observation Form, D. My Sokrates, E. Excel Observation Report. 

A. Sokrates Video is based on classroom teaching records, it includes in-class teaching video, teaching behavioral data characteristics, expert feedback list/content, and other data. When playing the video, related data is automatically synchronized.

B. Sokrates Report is a simple data report of digital lesson observation. The content includes Technology Interaction Index (T), Pedagogical Application Index (P), Content Implementation Index (C), frequency of technology use, and teaching behavioral data characteristics (distribution). You can quickly grasp the teaching pattern of a lesson in one minute with this report.

C. Lesson Observation Form is the summary report of the results of lesson observation, including lesson introduction, lesson observation records (lesson observers, lesson context, lesson observation focus, comment list, hyperlinks of video clips, attachments (photos, audio, videos), Sokrates Report, and Sokrates Pedagogical Application global norm reference table.

D. My Sokrates is a data summary page of individuals participating in lesson observation activities, including public teaching data, lesson observation marked data, Sokrates Video viewing records, my favorite lessons, subscribed channels, lesson notifications, and more.

E. Excel Observation Report can be downloaded for further application. It includes the lesson observation record (observer, time, content, and video clips hyperlink), and index statistics (T, P, C Index, frequency). The Excel statistical analysis function can be used to further analyze the lesson examples, or research software (such as Nvivo) can be used to perform statistical analysis of the keywords marked by experts.

The Pedagogical Review of AI Sokrates is an innovative model of lesson observation digitization. It breaks the limitations of traditional lesson studies, automatically collect lesson data, establishes a culture of collaborative lesson discussion among teachers, and makes good use of the machine intelligence of AI Sokrates to make lesson observation activities more accurate and more effective with lesson data and evidence.

# Repetitive and reproducible things are done by the machine
# Personalized hard-to-copy things are handed over to experts

For more related information, please refer to:

Digital Lesson Observation series: Sokrates Video
Digital Lesson Observation series: Sokrates Report
Digital Lesson Observation series: Lesson Observation Form
Digital Lesson Observation series: Lesson Observation Focus Category

For solutions of Digital Lesson Observation, please refer to:

Digital Lesson Observation General Plan
AI Digital Lesson Observation Starter Plan
Digital Lesson Observation AI Camera Plan
AI Digital Lesson Observation Ultimate Plan