Note: You are currently viewing documentation for Moodle 3.2. Up-to-date documentation for the latest stable version of Moodle is probably available here: Learning analytics.

Learning analytics: Difference between revisions

From MoodleDocs
(Adding learning analytics dimensions image)
m (Text replacement - "class="nicetable"" to "class="wikitable"")
 
(28 intermediate revisions by 7 users not shown)
Line 1: Line 1:
{{Tracking progress}}
Learning Analytics are any piece of information that can help an LMS user improve learning outcomes. Users include students, teachers, administrators and decision-makers.
Learning Analytics are any piece of information that can help an LMS user improve learning outcomes. Users include students, teachers, administrators and decision-makers.


Line 5: Line 6:
There are a number of reports, blocks and other plugins for Moodle that provide learning analytics.
There are a number of reports, blocks and other plugins for Moodle that provide learning analytics.


{| class="nicetable"
{| class="wikitable"
|-
|-
! Plugin  
! Plugin  
Line 11: Line 12:
! Standard / Additional
! Standard / Additional
! Useful for
! Useful for
! Description
! Reported usage*
! Reported usage*
|-
|-
Line 17: Line 19:
| Standard
| Standard
| Teachers, Admins, Decision-makers
| Teachers, Admins, Decision-makers
| Filterable log of events
| style="text-align:center;" | 71.4%
| style="text-align:center;" | 71.4%
|-
|-
Line 23: Line 26:
| Standard
| Standard
| Teachers
| Teachers
| View count of activities in course
| style="text-align:center;" | 69.1%
| style="text-align:center;" | 69.1%
|-
|-
| [[:en:Using_Activity_completion|Activity completion]]
| [[:en:Using_Activity_completion|Activity completion]], see also [[:en:Using_Course_completion|Course completion]]
| Report
| Report
| Standard
| Standard
| Teachers
| Teachers
| Completion matrix of students and activities
| style="text-align:center;" | 66.3%
| style="text-align:center;" | 66.3%
|-
|-
Line 35: Line 40:
| Standard
| Standard
| Teachers, Admins
| Teachers, Admins
| Automatically refreshing log of events
| style="text-align:center;" | 55.2%  
| style="text-align:center;" | 55.2%  
|-
| [[:en:Feedback_activity|Feedback]]
| Activity
| Standard
| Teachers, Researchers
| Configurable survey tool
| style="text-align:center;" | 59.5%
|-
|-
| [[:en:Quiz_statistics_report|(Quiz) Statistics]]
| [[:en:Quiz_statistics_report|(Quiz) Statistics]]
Line 41: Line 54:
| Standard
| Standard
| Teachers
| Teachers
| Student quiz performance report
| style="text-align:center;" | 53.0%
| style="text-align:center;" | 53.0%
|-
|-
Line 47: Line 61:
| Standard
| Standard
| Teachers
| Teachers
| Single student's participation in course
| style="text-align:center;" | 49.9%
| style="text-align:center;" | 49.9%
|-
|-
Line 52: Line 67:
| Activity
| Activity
| Standard
| Standard
| Teachers
| Teachers, Researchers
| Set of standardised educational surveys
| style="text-align:center;" | 45.6%
| style="text-align:center;" | 45.6%
|-
| [http://moodle.org/plugins/view.php?plugin=mod_questionnaire Questionnaire]
| Activity
| Additional
| Teachers, Researchers
| Configurable survey tool
| style="text-align:center;" | 45.3%
|-
|-
| [[:en:Course_overview_report|Course overview]]
| [[:en:Course_overview_report|Course overview]]
Line 59: Line 82:
| Standard
| Standard
| Admins, Decision-makers
| Admins, Decision-makers
| Comparison of participation across multiple courses
| style="text-align:center;" | 45.0%
| style="text-align:center;" | 45.0%
|-
|-
Line 65: Line 89:
| Standard
| Standard
| Students
| Students
| View of student's own completion of activities
| style="text-align:center;" | 41.4%
| style="text-align:center;" | 41.4%
|-
|-
Line 71: Line 96:
| Additional
| Additional
| Students, Teachers
| Students, Teachers
| Time management tool for students with overview for teachers
| style="text-align:center;" | 32.0%
| style="text-align:center;" | 32.0%
|-
|-
Line 77: Line 103:
| Standard
| Standard
| Teachers, Admins
| Teachers, Admins
| Events that can be monitored/searched in logs
| style="text-align:center;" | 28.6%
| style="text-align:center;" | 28.6%
|-
|-
Line 83: Line 110:
| Standard
| Standard
| Students
| Students
| Leader-board of results in single activity
| style="text-align:center;" | 26.1%
| style="text-align:center;" | 26.1%
|-
|-
| [http://moodle.org/plugins/view.php?id=82 Configurable Reports]  
| [http://moodle.org/plugins/view.php?id=82 Configurable Reports]  
([https://docs.moodle.org/29/en/ad-hoc_contributed_reports A list of contributed reports])
([https://docs.moodle.org/29/en/ad-hoc_contributed_reports A list of contributed reports])
| Block ([https://github.com/nadavkav/moodle-report_configurablereports Report])
| Block ([https://github.com/nadavkav/moodle-report_configurablereports Report] [https://github.com/nadavkav/moodle-filter_crgraph Graphs filter])
| Additional
| Additional
| Teachers, Admins, Decision-makers
| Teachers, Admins, Decision-makers
| Report generation and viewing
| style="text-align:center;" | 22.7%
| style="text-align:center;" | 22.7%
|-
|-
Line 96: Line 125:
| Standard
| Standard
| Teachers, Students
| Teachers, Students
| View of student grades across activites
| style="text-align:center;" | N/A
|-
| [[Statistics]]
| Report
| Standard
| Admins, Decision-makers
| Daily activity across site
| style="text-align:center;" | N/A
|-
| [[:en:Event_monitoring|Event monitor]]
| Report
| Standard
| Teachers, Admins, Decision-makers
| Proactive, focussed monitor tool
| style="text-align:center;" | N/A
| style="text-align:center;" | N/A
|-
|-
Line 102: Line 146:
| Additional
| Additional
| Teachers, Admins, Decision-makers
| Teachers, Admins, Decision-makers
| SQL-based report generation and viewing
| style="text-align:center;" | N/A
| style="text-align:center;" | N/A
|-
|-
Line 108: Line 153:
| Additional
| Additional
| Teachers
| Teachers
| Configurable engagement measurement report and block
| style="text-align:center;" | N/A
| style="text-align:center;" | N/A
|-
|-
Line 114: Line 160:
| Additional
| Additional
| Students, Teachers
| Students, Teachers
| Estimated time online for students
| style="text-align:center;" | N/A
| style="text-align:center;" | N/A
|-
|-
Line 120: Line 167:
| Additional
| Additional
| Teachers, Admins
| Teachers, Admins
| Daily visits to site or course
| style="text-align:center;" | N/A
|-
| [http://moodle.org/plugins/view/block_gismo GISMO]
| Block
| Additional
| Teachers
| Numerous charts of student activity participation
| style="text-align:center;" | N/A
|-
| [http://moodle.org/plugins/view/block_xp Level Up!]
| Block
| Additional
| Students, Teachers
| Incentive-drive participation meter
| style="text-align:center;" | N/A
|-
| [http://moodle.org/plugins/report_forumgraph Forum Graph]
| Report
| Additional
| Teachers
| Graph of forum interactions
| style="text-align:center;" | N/A
|-
| [https://moodle.org/plugins/block_analytics_graphs Analytics Graphs]
| Block
| Additional
| Teachers
| Visualisation of student participation
| style="text-align:center;" | N/A
| style="text-align:center;" | N/A
|-
|-
| [http://moodle.org/plugins/view/block_gismo GISMO, a graphical interactive student monitoring]
| [https://moodle.org/plugins/block_heatmap Heatmap]
| Block
| Block
| Additional
| Additional
| Teachers
| Teachers
| Colour-coded indication of activity views on course page
| style="text-align:center;" | N/A
|-
| [https://moodle.org/plugins/local_analytics Analytics]
| Local
| Additional
| Admins, Decision-makers
| Enriched feed to Google Analytics and Pywick
| style="text-align:center;" | N/A
|-
| [https://moodle.org/plugins/logstore_xapi Logstore xAPI]
| Logstore
| Additional
| Admins, Decision-makers, Researchers
| xAPI event stream output
| style="text-align:center;" | N/A
| style="text-align:center;" | N/A
|}
|}
Line 133: Line 224:
== Integrations with Moodle ==
== Integrations with Moodle ==


A number of systems integrate with Moodle to provide learning analytics information.
A number of systems integrate with Moodle to provide learning analytics information externally.


* [http://damos.world/2013/08/30/the-moodle-activity-viewer-mav-heatmaps-of-student-activity/ Moodle Activity Viewer] (MAV) ([https://github.com/damoclark/mav-enterprise Git])
* [http://damos.world/2013/08/30/the-moodle-activity-viewer-mav-heatmaps-of-student-activity/ Moodle Activity Viewer] (MAV) ([https://github.com/damoclark/mav-enterprise Git]), consider [https://moodle.org/plugins/block_heatmap Heatmap] as an alternative
* [http://www.intelliboard.net/ Intelliboard]
* [http://www.intelliboard.net/ Intelliboard]
* [http://www.lambdasolutions.net/products/lmsreporting/ Zoola (was Analytika)]
* [https://learninglocker.net/ Learning Locker], can be used with [https://moodle.org/plugins/logstore_xapi Logstore xAPI]
* [http://klassdata.com/smartklass-learning-analytics-plugin/learning-analytics-moodle-smartklass/ SmartKlass]
* [http://www.blackboard.com/education-analytics/blackboard-predict.aspx Blackboard Predict]
* [http://melbourne-cshe.unimelb.edu.au/research/edutech/completing-the-loop Completing the loop]
* [https://www.iadlearning.com/ IADlearning] offers institutions and educators a rich set of analytics allowing them to understand the quality of their training content, as well as the quality of the ongoing learning processes.


== Dimensions of Analytics ==
== Dimensions of Analytics ==


Learning analytics are a concept that has been emerging under a number of different names through the past decades. Its origins lie in research in data mining and intelligent tutoring systems. LA tools can be categorised in a number of ways. The diagram below describes such tools by how deeply they are integrated with other systems ([http://www.netdimensions.com/downloads-2015/others/lms-evolution-or-extinction.pdf?mkt_tok=3RkMMJWWfF9wsRokuKjMZKXonjHpfsX56OQtW6CwlMI%2F0ER3fOvrPUfGjI4DTsdlI%2BSLDwEYGJlv6SgFS7fAMaFl3bgIWBY%3D source]).
Learning analytics are a concept that has been emerging under a number of different names through the past decades. Its origins lie in research in data mining and intelligent tutoring systems. LA tools can be categorised in a number of ways:


[[File:Learning-analytics.png]]
* Descriptive
* Predictive
* Diagnostic
* Prescriptive


== See also... ==
== See also... ==
* [https://moodle.org/mod/forum/view.php?id=8044 Analytics and reporting forum]
* [https://moodle.org/mod/forum/view.php?id=8205 Moodle Research forum]
* [[:dev:Moodle_research|Moodle research page]]
* [[Logging]]
* [[Logging]]
* [[:en:Events_list_report|Events list]]
* [[:dev:Learning_Analytics_Specification|Learning Analytics API specification]]
* [[:dev:Learning_Analytics_Specification|Learning Analytics API specification]]
* [[:dev:Events_2|Events specification]]
* [[:dev:Working_Groups#Assessment_Analytics|Assessment Analytics working group details and issues]]
* [[:dev:Event_2|Events specification]]
* [[:dev:Logging_2|Logging specification]]
* [[:dev:Logging_2|Logging specification]]
* [[:dev:reportbuilder/API|Report Builder API specification]]
* [[:dev:reportbuilder/API|Report Builder API specification]]
* Use [https://moodle.org/plugins/filter_generico Generico filter] to display custom DB reports with graphs [https://moodle.org/mod/forum/discuss.php?d=324771#p1334032 Demo / Forums]
* [https://www.jisc.ac.uk/blog/solving-the-ethical-and-legal-issues-around-learning-analytics-a-series-of-podcasts-11-mar-2016 Solving the ethical and legal issues around learning analytics: a series of podcasts]
* [http://plugins.moodlebites.com A number of free Moodle analytics plugins you can try] available on http://plugins.moodlebites.com
== Presentations ==
* [https://www.youtube.com/watch?v=MHv4vp1hxQc&index=5&list=TLGCVIc9g1-qUMUxOTEwMjAxNg Moodle Analytics Plans I Elizabeth Dalton at MoodleMoot Australia 2016] (video 24m)
* [https://moodle.org/mod/data/view.php?id=8327 List of Learning Analytics related presentation, from project Inspire]
== Project Inspire ==
[https://moodle.org/course/view.php?id=17233 Project Inspire] is an open source, transparent next-generation learning analytics that go beyond simple descriptive analytics to provide predictions of learner success, and ultimately diagnosis and prescriptions (advisements) to learners and teachers.  Moodle’s Project Inspire is essentially Moodle’s Analytics Plan. The project aims to identify and validate, indicators of student, teacher and institutional engagement in educational activities.
Information from this will be used to develop learning analytics software features, which will have these functions:
* Description of learning engagement and progress,
* Diagnosis of learning engagement and progress,
* Prediction of learning progress, and
* Prescription (recommendations) for improvement of learning progress.
==== Anonymized "ready for research" Data ====
* [http://research.moodle.net/158/ "Learn Moodle August 2016" anonymized data set]


[[Category:Report]]
[[Category:Report]]


[[es:Análisis del aprendizaje]]
[[es:Análisis del aprendizaje]]

Latest revision as of 15:15, 10 August 2021

Learning Analytics are any piece of information that can help an LMS user improve learning outcomes. Users include students, teachers, administrators and decision-makers.

Moodle Plugins

There are a number of reports, blocks and other plugins for Moodle that provide learning analytics.

Plugin Plugin type Standard / Additional Useful for Description Reported usage*
Logs Report Standard Teachers, Admins, Decision-makers Filterable log of events 71.4%
Activity Report Standard Teachers View count of activities in course 69.1%
Activity completion, see also Course completion Report Standard Teachers Completion matrix of students and activities 66.3%
Live logs Report Standard Teachers, Admins Automatically refreshing log of events 55.2%
Feedback Activity Standard Teachers, Researchers Configurable survey tool 59.5%
(Quiz) Statistics Report Standard Teachers Student quiz performance report 53.0%
(Course) Participation Report Standard Teachers Single student's participation in course 49.9%
Survey Activity Standard Teachers, Researchers Set of standardised educational surveys 45.6%
Questionnaire Activity Additional Teachers, Researchers Configurable survey tool 45.3%
Course overview Report Standard Admins, Decision-makers Comparison of participation across multiple courses 45.0%
Course completion status Block Standard Students View of student's own completion of activities 41.4%
Progress Bar Block Additional Students, Teachers Time management tool for students with overview for teachers 32.0%
Events list Report Standard Teachers, Admins Events that can be monitored/searched in logs 28.6%
Activity results block Block Standard Students Leader-board of results in single activity 26.1%
Configurable Reports

(A list of contributed reports)

Block (Report Graphs filter) Additional Teachers, Admins, Decision-makers Report generation and viewing 22.7%
(Gradebook) Overview Report Standard Teachers, Students View of student grades across activites N/A
Statistics Report Standard Admins, Decision-makers Daily activity across site N/A
Event monitor Report Standard Teachers, Admins, Decision-makers Proactive, focussed monitor tool N/A
Ad-hoc database queries Report Additional Teachers, Admins, Decision-makers SQL-based report generation and viewing N/A
Engagement Analytics Block, Report, Activity module Additional Teachers Configurable engagement measurement report and block N/A
Course Dedication Block Additional Students, Teachers Estimated time online for students N/A
Graph Stats Block Additional Teachers, Admins Daily visits to site or course N/A
GISMO Block Additional Teachers Numerous charts of student activity participation N/A
Level Up! Block Additional Students, Teachers Incentive-drive participation meter N/A
Forum Graph Report Additional Teachers Graph of forum interactions N/A
Analytics Graphs Block Additional Teachers Visualisation of student participation N/A
Heatmap Block Additional Teachers Colour-coded indication of activity views on course page N/A
Analytics Local Additional Admins, Decision-makers Enriched feed to Google Analytics and Pywick N/A
Logstore xAPI Logstore Additional Admins, Decision-makers, Researchers xAPI event stream output N/A

* Reported usage is drawn from the Plugins Usage Survey from 2015.

Integrations with Moodle

A number of systems integrate with Moodle to provide learning analytics information externally.

Dimensions of Analytics

Learning analytics are a concept that has been emerging under a number of different names through the past decades. Its origins lie in research in data mining and intelligent tutoring systems. LA tools can be categorised in a number of ways:

  • Descriptive
  • Predictive
  • Diagnostic
  • Prescriptive

See also...

Presentations

Project Inspire

Project Inspire is an open source, transparent next-generation learning analytics that go beyond simple descriptive analytics to provide predictions of learner success, and ultimately diagnosis and prescriptions (advisements) to learners and teachers. Moodle’s Project Inspire is essentially Moodle’s Analytics Plan. The project aims to identify and validate, indicators of student, teacher and institutional engagement in educational activities. Information from this will be used to develop learning analytics software features, which will have these functions:

  • Description of learning engagement and progress,
  • Diagnosis of learning engagement and progress,
  • Prediction of learning progress, and
  • Prescription (recommendations) for improvement of learning progress.

Anonymized "ready for research" Data