Summary
Today, I seek approval for the integration of the Easy JavaScript Simulation (EJSS) App with the Student Learning Space (SLS).
The value of this App lies in its ability to support teaching and learning through learning analytics. With comprehensive data on students' interactions within the simulations, teachers can gain insights into students' understanding and tailor their instructions accordingly. This detailed data is currently unavailable on other interactive platforms, giving the App a unique advantage in providing tailored information to teachers.
The User journey of embedding and using the App in SLS is aligned to current user SLS flow. Worth noting is App works as part of their SLS assignments. Real-time learning analytics are shown to the teachers through the EJSS Teacher's Dashboard. This detailed analytics will enable teachers to better understand their students' performance.
Finally, the integration of EJSS APP with SLS has a solid funding and sustainability plan. CPDD1 has given in principle approval funding the recurring costs until December 2026. Furthermore, the EJSS authoring toolkit is scheduled for further development in 2024 to increase accessibility and usefulness. Efforts will be made to update existing EJSS resources in SLS and provide professional development workshops to facilitate new users in creating high-quality simulations.
In conclusion, the integration of the Easy JavaScript Simulation (EJSS) App with the Student Learning Space (SLS) is an invaluable addition to our educational technology plan. With its learning analytics through the EJSS App, it presents a new way to empowers teachers to deliver a more personalized learning experience in the context of "knowing what student did on the simulation". Please consider granting the approval needed to proceed with this learning analytics project.
Thank you.
Slides
Easy JavaScript Simulation
(EJSS) App
Technologies for Learning Branch, ETD and Sciences Branch, CPDD1
(2023) 3rd SLS Project Team Meeting
For Approval
Purpose
To seek approval to integrate Easy JavaScript Simulation (EJSS) App with SLS.
1. Introduction
1. Introduction
Application (App) Description
Division : ETD / CPDD1
In-Charge/Liaison : Lawrence Wee / Dr Darren Tan
Name of Application : Easy JavaScript Simulation (EJSS) App
Partner/Vendor : Lawrence Wee / Open Source Physics
Project Development : $ 52,000 development cost from SSTRF
Project Maintenance : $ 2,500 every 2 years for web hosting and domain name
2. Description of EJSS App and its Educational Value
2. Description of EJSS App and its Educational Value
Background
EJSS authoring toolkit is able to create virtual learning simulations1 that offers hands-on interactivity for teaching and learning through virtual science labs, digital manipulatives, sensor webapps and engaging games.
EJSS has been adopted by MOE officers and teachers for various educational purposes and is available on SLS2.
An ETD-CPDD SSTRF2021 project prototyped the integration of EJSS App with learning analytics to track and report students’ interactions within the simulations. The resulting EJSS App was successfully deployed in the SLS Development and Sandbox servers, through LTI 1.3. There are 5 simulations 'ready' for use, and another 20 simulations under refinement which will be released after further user testing.
1 Resources created using EJSS was recognized by UNESCO as Singapore’s ICT Pedagogical Innovation (2016) and received the American Physical Society’s Excellence in Physics Education Award (2020).
2 The SLS MOE Library has 40+ EJSS resources and the Community Gallery has 100+ EJSS resources.
2. Description of EJSS App and its Educational Value
How Application Supports Teaching and Learning
[Learning Analytics] The EJSS App provides teachers with comprehensive data on students’ interactions within the simulations*. Teachers can use this data to check for students’ understanding and hence adjust instruction to provide more meaningful feedback.
The EJSS App is similar to the SLS “Monitor Assignment” page, but provides teachers with information about how students are utilising the simulations within the SLS class assignments.
The EJSS App is currently the only tool capable of providing SLS Class Assignment with comprehensive student interaction data specifically tailored to simulations^.
* E.g. a student’s series of actions leading to a particular answer on a task, the number of times a student attempted a task, or the proportion of students who completed a task correctly/incorrectly.
^ Other interactive platforms like PhET or GeoGebra are currently unable to offer SLS this level of detailed data regarding student interactions on their interactives.
2. Description of EJSS App and its Educational Value
How Application Supports Teaching and Learning
[Content Authoring] As EJSS authoring toolkit is an open-source software, interested HQ officers and teachers can create or customise simulations to set meaningful assignments for students.
3. User Journey
3. User Journey
Embedding App
To add an EJSS App, click on the “</>” icon in the Text/Media component.
Alternatively, teacher can also click on “App” under the “Text/Media” component.
3. User Journey
Embedding App
Browse for suitable EJSS to add, say “Mathematics Eight Point Compass Start from Origin”.
Once found, click on the “Resource URL” and click the button “Select Text” and copy the text using keyboard shortcut CTRL+C.
Navigate below to paste in the “Resource URL” and click “SAVE”, refer to Annex A.
3. User Journey
Student’s View
Student will interact with the EJSS as per normal in any assignment, refer to Annex B.
All the interactions involving the EJSS performance tasks will be recorded as the history, marked awarded accordingly 1 mark for reattempts and 2 marks for first attempt correct, refer to Annex C.
3. User Journey
Teacher’s View
Teacher will click on the "See Analytics" button within the EJSS teacher interface. This action will grant the teacher access to the student's responses and interactions through the teacher’s dashboard.
3. User Journey
Teacher’s View
Teacher can see their dashboard viewing the assignment with “real-time” interactions on EJSS by the student. Mouse over of the marks will provide the history of interactions such as in question 2 attempt of “moving the cow 4 squares south” in the order of attempts.
They are
(0,-5) ❌ incorrectly
(0,-3) ❌ incorrectly
(0,-4) ✅ correctly
With this data, teacher can have a better idea of students’ performance “difficulties” and the collective data of all students can provide information of which question is poorly attempted by majority of students etc., refer to Annex D.
4. Data Exchange between Application and SLS
4. Data Exchange between Application and SLS
Required Data from SLS
5. Funding, Sustainability and Implementation Plan
5. Funding, Sustainability and Implementation Plan
Funding and Sustainability Plan
Development of the app was done with Senior Specialist Track Research/Development Fund (SSTRF) research titled “ETD_2021_05 Learning Tools Interoperability (LTI) Exploratory Learning Environment (ELE) Data Analytics” at a cost of $52,000.
CPDD1 has given in-principle approval to fund the bi-annual recurring cost of estimated $2,500 for web hosting and web domain name until December 2026.
5. Funding, Sustainability and Implementation Plan
Funding and Sustainability Plan
The developers of EJSS authoring toolkit are scheduled to further develop their toolkit in 2024 to run on the internet browser3 to increase its accessibility and usefulness.
Considerations for follow up by existing users and supporting new users from MOEHQ and Schools.
For existing EJSS in SLS, efforts will be made to update selected EJSS in MOE library and CG with the learning analytics through the EJSS app.
For creating new EJSS, new users should be familiar with coding in EJSS authoring toolkit to be able to tap on the capability of the EJSS app. CPDD is planning for a professional development workshop for HQ officers in 2024, to be facilitated by the developers of EJSS authoring toolkit on the use and creation of high quality simulations.
3 Current EJSS authoring toolkit requires Java Runtime Environment (JRE) version 8 which make EJSS authoring toolkit less accessible to non-technical users. The future toolkit will only need a modern internet browser to author EJSS resources.
5. Funding, Sustainability and implementation Plan
Estimated Timeline if Approved
Annex with Other Details
Annex A: Teacher Flow 1: Add an EJSS App
Annex B: Teacher Flow 2: Assign Lesson to Class
Annex C: Student Flow: Use an EJSS App in an Assignment
Annex D: Teacher Flow 3: Analyze Students in the Class Assignment using EJSS App
Annex A
Teacher Flow 1: Add an EJSS App
There can be 2 usual entry points in adding the EJSS app.
“My Lessons” in “My Drive”
“Assignments”
Teacher can start to add EJSS app from a new or existing lesson in “My Drive” or edit an existing “Assignments”.
Annex A
Teacher Flow 1: Add an EJSS App
Starting from “My Lessons” in “My Drive”.
The Teacher can start to add EJSS app from a new or existing lesson in “My Drive”. For this example, we use an existing lesson to add the EJSS app to illustrate.
Annex A
Teacher Flow 1: Add an EJSS App
To add an EJSS App, click on the “</>” icon in the Text/Media component.
Alternatively, teacher can also click on “Text/Media” icon.
Annex A
Teacher Flow 1: Add an EJSS App
Select “Embed App” from the drop down list.
Annex A
Teacher Flow 1: Add an EJSS App
Click on the “EjSS LTI App (Manual)” to add the app.
In the event there is a lot of Apps available, there will be a need to search for the App using the search field and type in “ejss” and press “Enter” on the keyboard.
Annex A
Teacher Flow 1: Add an EJSS App
Browse for the suitable EJSS to add, say “Mathematics Eight Point Compass Start from Origin”.
Once found, click on the “Resource URL” and click the button “Select Text” and copy the text using keyboard CTRL+C.
Annex A
Teacher Flow 1: Add an EJSS App
Navigate down and locate the “Resource URL” input field and paste in the copied text.
Next click “SAVE” to confirm adding of this “Resource URL”.
Annex A
Teacher Flow 1: Add an EJSS App
Click away to save the change made automatically.
Notice now the EJSS app is embedded in the lesson.
Annex B
Teacher Flow 2: Assign Lesson to Class
Now that the EJSS app is added to a lesson in My Drive and let us assume the lesson is fully constructed and ready.
Continue to “Save and Assign” the lesson, select the “Class” radio button and click the “ASSIGN” button.
Annex C
Student Flow: Use an EJSS App in an Assignment
On the students’ SLS account, students in the same class of the teacher will need to locate the assignment and click on it to work on the assignment with the EJSS App, previously added by the teacher in Flow 1.
Annex C
Student Flow: Use an EJSS App in an Assignment
At the EJSS App, notice student do not see the “See Analytics” button due to insufficient privileges via LTI.
The students will receive instructions to utilize an interactive interface. For instance, they will be prompted with question 1, which requires them to perform an action such as moving the mouse two squares north starting from the green square. Once the students drag the mouse and release it, the corresponding data will be captured.
Annex C
Student Flow: Use an EJSS App in an Assignment
Upon answering correctly, students will be required to click on the "OK" button, triggering the generation of a new question by the EJSS. New questions will consist of random values and directions.
Annex C
Student Flow: Use an EJSS App in an Assignment
In question 2, the task is to move the cow 4 squares south. All the interactions involving the cow by the students will be recorded as the history for this particular question. In the given example, the cow ended up landing on 5 squares south after the student's actions.
Annex C
Student Flow: Use an EJSS App in an Assignment
As the click and drop interaction is incorrect, student is to click on “OK” to reattempt as prompted by the EJSS.
Annex C
Student Flow: Use an EJSS App in an Assignment
In this retry, the student attempts to move 3 squares south but once again does it incorrectly. Based on the data, it appears that the student may be experiencing difficulty in accurately judging large distances.
Annex C
Student Flow: Use an EJSS App in an Assignment
As the click and drop interaction is incorrect again, student is to click on “OK” to reattempt as prompted by the EJSS.
Annex C
Student Flow: Use an EJSS App in an Assignment
After two additional attempts, the student successfully moved 4 squares south. Consequently, the data for Question 2 will show the following: the coordinates for the first attempt are recorded as (0, -5), for the second attempt as (0, -3), and for the third attempt as (0, -4).
Annex C
Student Flow: Use an EJSS App in an Assignment
Let’s progress ahead to the student's final question, Question 10, which involves moving the "turtle 5 squares southeast." At this point, the student has attempted all the questions provided by EJSS.
Next, let's shift our focus to the teacher's account to examine the information presented there.
Annex D
Teacher Flow 3: How to analyze Students in the Class Assignment using EJSS App
Returning to the teacher's account and accessing the assignment, the teacher will click on the "See Analytics" button within the EJSS teacher interface. This action will grant the teacher access to the student's responses and interactions through the teacher’s dashboard.
Annex D
Teacher Flow 3: How to analyze Students in the Class Assignment using EJSS App
The EJSS launches “EJSS Teacher’s Dashboard.
This dashboard will display the interactions of each student in the class. For instance, if only one student, "WANG X WX," attempted the EJSS, only her name will be visible initially. As the student progresses through the EJSS, the corresponding data will be captured and showcased on the teacher's dashboard. As more students join the EJSS, their names and data will be presented accordingly.
Annex D
Teacher Flow 3: How to analyze Students in the Class Assignment using EJSS App
For instance, if only student "WANG X WX" attempted Question 1, the teacher's dashboard, while viewing the assignment, will display the real-time data of their attempt. In this case, the successful completion of moving the mouse 2 squares north will be accurately captured in the coordinate system as (0,2), indicated by a checkmark symbol (✅).
Annex D
Teacher Flow 3: Analyze Students in the Class Assignment using EJSS App
Student “WANG X WX” attempted Question 2, the teacher’s dashboard viewing the assignment will see “real-time” data of the question 2 attempt of “moving the cow 4 squares south” in the order of attempts.
They are
(0,-5) ❌ incorrectly
(0,-3) ❌ incorrectly
(0,-4) ✅ correctly
Only 1 mark is awarded as the attempt is correct after re-attempts.
Note that, 2 marks will be awarded for 1st attempt correct.
Annex D
Teacher Flow 3: Analyze Students in the Class Assignment using EJSS App
Student “WANG X WX” attempted all Question 1 to 10 are captured with a score.
0 for incorrect (no such attempts)
1 for correct after reattempts (twice)
2 for correct after 1 attempt (8 times)
It is evident that the student successfully answered Question 2 and Question 3 after multiple attempts. As a result, the student achieved a total score of 18 out of 20 marks for this EJSS activity.
To gain deeper insights into the student's interaction and identify any performance difficulties or misconceptions, the teacher can hover over the score to access detailed analytics regarding the history of attempts. This allows the teacher to obtain a glimpse into the student's interactions and gain a better understanding of their progress.
Annex D
Teacher Flow 3: Analyze Students in the Class Assignment using EJSS App
In summary, the teacher has the ability to monitor the students' interactions on the EJSS platform in real-time and provide feedback using various tools such as SLS Interactive Thinking Tool. Additionally, the teacher can facilitate whole-class discussions in a face-to-face setting, taking into account the data collected from the EJSS activities.
The teacher can create EJSS lessons, assign them to the class, and track the students' progress with certainty. This eliminates the need for guessing where students might have gone wrong and enables a more informed approach to teaching and supporting their learning journey in EJSS.
No comments:
Post a Comment