Learning analytics: Difference between revisions
(Adding learning analytics dimensions image) |
m (Text replacement - "class="nicetable"" to "class="wikitable"") |
||
(28 intermediate revisions by 7 users not shown) | |||
Line 1: | Line 1: | ||
{{Tracking progress}} | |||
Learning Analytics are any piece of information that can help an LMS user improve learning outcomes. Users include students, teachers, administrators and decision-makers. | Learning Analytics are any piece of information that can help an LMS user improve learning outcomes. Users include students, teachers, administrators and decision-makers. | ||
Line 5: | Line 6: | ||
There are a number of reports, blocks and other plugins for Moodle that provide learning analytics. | There are a number of reports, blocks and other plugins for Moodle that provide learning analytics. | ||
{| class=" | {| class="wikitable" | ||
|- | |- | ||
! Plugin | ! Plugin | ||
Line 11: | Line 12: | ||
! Standard / Additional | ! Standard / Additional | ||
! Useful for | ! Useful for | ||
! Description | |||
! Reported usage* | ! Reported usage* | ||
|- | |- | ||
Line 17: | Line 19: | ||
| Standard | | Standard | ||
| Teachers, Admins, Decision-makers | | Teachers, Admins, Decision-makers | ||
| Filterable log of events | |||
| style="text-align:center;" | 71.4% | | style="text-align:center;" | 71.4% | ||
|- | |- | ||
Line 23: | Line 26: | ||
| Standard | | Standard | ||
| Teachers | | Teachers | ||
| View count of activities in course | |||
| style="text-align:center;" | 69.1% | | style="text-align:center;" | 69.1% | ||
|- | |- | ||
| [[:en:Using_Activity_completion|Activity completion]] | | [[:en:Using_Activity_completion|Activity completion]], see also [[:en:Using_Course_completion|Course completion]] | ||
| Report | | Report | ||
| Standard | | Standard | ||
| Teachers | | Teachers | ||
| Completion matrix of students and activities | |||
| style="text-align:center;" | 66.3% | | style="text-align:center;" | 66.3% | ||
|- | |- | ||
Line 35: | Line 40: | ||
| Standard | | Standard | ||
| Teachers, Admins | | Teachers, Admins | ||
| Automatically refreshing log of events | |||
| style="text-align:center;" | 55.2% | | style="text-align:center;" | 55.2% | ||
|- | |||
| [[:en:Feedback_activity|Feedback]] | |||
| Activity | |||
| Standard | |||
| Teachers, Researchers | |||
| Configurable survey tool | |||
| style="text-align:center;" | 59.5% | |||
|- | |- | ||
| [[:en:Quiz_statistics_report|(Quiz) Statistics]] | | [[:en:Quiz_statistics_report|(Quiz) Statistics]] | ||
Line 41: | Line 54: | ||
| Standard | | Standard | ||
| Teachers | | Teachers | ||
| Student quiz performance report | |||
| style="text-align:center;" | 53.0% | | style="text-align:center;" | 53.0% | ||
|- | |- | ||
Line 47: | Line 61: | ||
| Standard | | Standard | ||
| Teachers | | Teachers | ||
| Single student's participation in course | |||
| style="text-align:center;" | 49.9% | | style="text-align:center;" | 49.9% | ||
|- | |- | ||
Line 52: | Line 67: | ||
| Activity | | Activity | ||
| Standard | | Standard | ||
| Teachers | | Teachers, Researchers | ||
| Set of standardised educational surveys | |||
| style="text-align:center;" | 45.6% | | style="text-align:center;" | 45.6% | ||
|- | |||
| [http://moodle.org/plugins/view.php?plugin=mod_questionnaire Questionnaire] | |||
| Activity | |||
| Additional | |||
| Teachers, Researchers | |||
| Configurable survey tool | |||
| style="text-align:center;" | 45.3% | |||
|- | |- | ||
| [[:en:Course_overview_report|Course overview]] | | [[:en:Course_overview_report|Course overview]] | ||
Line 59: | Line 82: | ||
| Standard | | Standard | ||
| Admins, Decision-makers | | Admins, Decision-makers | ||
| Comparison of participation across multiple courses | |||
| style="text-align:center;" | 45.0% | | style="text-align:center;" | 45.0% | ||
|- | |- | ||
Line 65: | Line 89: | ||
| Standard | | Standard | ||
| Students | | Students | ||
| View of student's own completion of activities | |||
| style="text-align:center;" | 41.4% | | style="text-align:center;" | 41.4% | ||
|- | |- | ||
Line 71: | Line 96: | ||
| Additional | | Additional | ||
| Students, Teachers | | Students, Teachers | ||
| Time management tool for students with overview for teachers | |||
| style="text-align:center;" | 32.0% | | style="text-align:center;" | 32.0% | ||
|- | |- | ||
Line 77: | Line 103: | ||
| Standard | | Standard | ||
| Teachers, Admins | | Teachers, Admins | ||
| Events that can be monitored/searched in logs | |||
| style="text-align:center;" | 28.6% | | style="text-align:center;" | 28.6% | ||
|- | |- | ||
Line 83: | Line 110: | ||
| Standard | | Standard | ||
| Students | | Students | ||
| Leader-board of results in single activity | |||
| style="text-align:center;" | 26.1% | | style="text-align:center;" | 26.1% | ||
|- | |- | ||
| [http://moodle.org/plugins/view.php?id=82 Configurable Reports] | | [http://moodle.org/plugins/view.php?id=82 Configurable Reports] | ||
([https://docs.moodle.org/29/en/ad-hoc_contributed_reports A list of contributed reports]) | ([https://docs.moodle.org/29/en/ad-hoc_contributed_reports A list of contributed reports]) | ||
| Block ([https://github.com/nadavkav/moodle-report_configurablereports Report]) | | Block ([https://github.com/nadavkav/moodle-report_configurablereports Report] [https://github.com/nadavkav/moodle-filter_crgraph Graphs filter]) | ||
| Additional | | Additional | ||
| Teachers, Admins, Decision-makers | | Teachers, Admins, Decision-makers | ||
| Report generation and viewing | |||
| style="text-align:center;" | 22.7% | | style="text-align:center;" | 22.7% | ||
|- | |- | ||
Line 96: | Line 125: | ||
| Standard | | Standard | ||
| Teachers, Students | | Teachers, Students | ||
| View of student grades across activites | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [[Statistics]] | |||
| Report | |||
| Standard | |||
| Admins, Decision-makers | |||
| Daily activity across site | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [[:en:Event_monitoring|Event monitor]] | |||
| Report | |||
| Standard | |||
| Teachers, Admins, Decision-makers | |||
| Proactive, focussed monitor tool | |||
| style="text-align:center;" | N/A | | style="text-align:center;" | N/A | ||
|- | |- | ||
Line 102: | Line 146: | ||
| Additional | | Additional | ||
| Teachers, Admins, Decision-makers | | Teachers, Admins, Decision-makers | ||
| SQL-based report generation and viewing | |||
| style="text-align:center;" | N/A | | style="text-align:center;" | N/A | ||
|- | |- | ||
Line 108: | Line 153: | ||
| Additional | | Additional | ||
| Teachers | | Teachers | ||
| Configurable engagement measurement report and block | |||
| style="text-align:center;" | N/A | | style="text-align:center;" | N/A | ||
|- | |- | ||
Line 114: | Line 160: | ||
| Additional | | Additional | ||
| Students, Teachers | | Students, Teachers | ||
| Estimated time online for students | |||
| style="text-align:center;" | N/A | | style="text-align:center;" | N/A | ||
|- | |- | ||
Line 120: | Line 167: | ||
| Additional | | Additional | ||
| Teachers, Admins | | Teachers, Admins | ||
| Daily visits to site or course | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [http://moodle.org/plugins/view/block_gismo GISMO] | |||
| Block | |||
| Additional | |||
| Teachers | |||
| Numerous charts of student activity participation | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [http://moodle.org/plugins/view/block_xp Level Up!] | |||
| Block | |||
| Additional | |||
| Students, Teachers | |||
| Incentive-drive participation meter | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [http://moodle.org/plugins/report_forumgraph Forum Graph] | |||
| Report | |||
| Additional | |||
| Teachers | |||
| Graph of forum interactions | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [https://moodle.org/plugins/block_analytics_graphs Analytics Graphs] | |||
| Block | |||
| Additional | |||
| Teachers | |||
| Visualisation of student participation | |||
| style="text-align:center;" | N/A | | style="text-align:center;" | N/A | ||
|- | |- | ||
| [ | | [https://moodle.org/plugins/block_heatmap Heatmap] | ||
| Block | | Block | ||
| Additional | | Additional | ||
| Teachers | | Teachers | ||
| Colour-coded indication of activity views on course page | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [https://moodle.org/plugins/local_analytics Analytics] | |||
| Local | |||
| Additional | |||
| Admins, Decision-makers | |||
| Enriched feed to Google Analytics and Pywick | |||
| style="text-align:center;" | N/A | |||
|- | |||
| [https://moodle.org/plugins/logstore_xapi Logstore xAPI] | |||
| Logstore | |||
| Additional | |||
| Admins, Decision-makers, Researchers | |||
| xAPI event stream output | |||
| style="text-align:center;" | N/A | | style="text-align:center;" | N/A | ||
|} | |} | ||
Line 133: | Line 224: | ||
== Integrations with Moodle == | == Integrations with Moodle == | ||
A number of systems integrate with Moodle to provide learning analytics information. | A number of systems integrate with Moodle to provide learning analytics information externally. | ||
* [http://damos.world/2013/08/30/the-moodle-activity-viewer-mav-heatmaps-of-student-activity/ Moodle Activity Viewer] (MAV) ([https://github.com/damoclark/mav-enterprise Git]) | * [http://damos.world/2013/08/30/the-moodle-activity-viewer-mav-heatmaps-of-student-activity/ Moodle Activity Viewer] (MAV) ([https://github.com/damoclark/mav-enterprise Git]), consider [https://moodle.org/plugins/block_heatmap Heatmap] as an alternative | ||
* [http://www.intelliboard.net/ Intelliboard] | * [http://www.intelliboard.net/ Intelliboard] | ||
* [http://www.lambdasolutions.net/products/lmsreporting/ Zoola (was Analytika)] | |||
* [https://learninglocker.net/ Learning Locker], can be used with [https://moodle.org/plugins/logstore_xapi Logstore xAPI] | |||
* [http://klassdata.com/smartklass-learning-analytics-plugin/learning-analytics-moodle-smartklass/ SmartKlass] | |||
* [http://www.blackboard.com/education-analytics/blackboard-predict.aspx Blackboard Predict] | |||
* [http://melbourne-cshe.unimelb.edu.au/research/edutech/completing-the-loop Completing the loop] | |||
* [https://www.iadlearning.com/ IADlearning] offers institutions and educators a rich set of analytics allowing them to understand the quality of their training content, as well as the quality of the ongoing learning processes. | |||
== Dimensions of Analytics == | == Dimensions of Analytics == | ||
Learning analytics are a concept that has been emerging under a number of different names through the past decades. Its origins lie in research in data mining and intelligent tutoring systems. LA tools can be categorised in a number of ways | Learning analytics are a concept that has been emerging under a number of different names through the past decades. Its origins lie in research in data mining and intelligent tutoring systems. LA tools can be categorised in a number of ways: | ||
* Descriptive | |||
* Predictive | |||
* Diagnostic | |||
* Prescriptive | |||
== See also... == | == See also... == | ||
* [https://moodle.org/mod/forum/view.php?id=8044 Analytics and reporting forum] | |||
* [https://moodle.org/mod/forum/view.php?id=8205 Moodle Research forum] | |||
* [[:dev:Moodle_research|Moodle research page]] | |||
* [[Logging]] | * [[Logging]] | ||
* [[:en:Events_list_report|Events list]] | |||
* [[:dev:Learning_Analytics_Specification|Learning Analytics API specification]] | * [[:dev:Learning_Analytics_Specification|Learning Analytics API specification]] | ||
* [[:dev: | * [[:dev:Working_Groups#Assessment_Analytics|Assessment Analytics working group details and issues]] | ||
* [[:dev:Event_2|Events specification]] | |||
* [[:dev:Logging_2|Logging specification]] | * [[:dev:Logging_2|Logging specification]] | ||
* [[:dev:reportbuilder/API|Report Builder API specification]] | * [[:dev:reportbuilder/API|Report Builder API specification]] | ||
* Use [https://moodle.org/plugins/filter_generico Generico filter] to display custom DB reports with graphs [https://moodle.org/mod/forum/discuss.php?d=324771#p1334032 Demo / Forums] | |||
* [https://www.jisc.ac.uk/blog/solving-the-ethical-and-legal-issues-around-learning-analytics-a-series-of-podcasts-11-mar-2016 Solving the ethical and legal issues around learning analytics: a series of podcasts] | |||
* [http://plugins.moodlebites.com A number of free Moodle analytics plugins you can try] available on http://plugins.moodlebites.com | |||
== Presentations == | |||
* [https://www.youtube.com/watch?v=MHv4vp1hxQc&index=5&list=TLGCVIc9g1-qUMUxOTEwMjAxNg Moodle Analytics Plans I Elizabeth Dalton at MoodleMoot Australia 2016] (video 24m) | |||
* [https://moodle.org/mod/data/view.php?id=8327 List of Learning Analytics related presentation, from project Inspire] | |||
== Project Inspire == | |||
[https://moodle.org/course/view.php?id=17233 Project Inspire] is an open source, transparent next-generation learning analytics that go beyond simple descriptive analytics to provide predictions of learner success, and ultimately diagnosis and prescriptions (advisements) to learners and teachers. Moodle’s Project Inspire is essentially Moodle’s Analytics Plan. The project aims to identify and validate, indicators of student, teacher and institutional engagement in educational activities. | |||
Information from this will be used to develop learning analytics software features, which will have these functions: | |||
* Description of learning engagement and progress, | |||
* Diagnosis of learning engagement and progress, | |||
* Prediction of learning progress, and | |||
* Prescription (recommendations) for improvement of learning progress. | |||
==== Anonymized "ready for research" Data ==== | |||
* [http://research.moodle.net/158/ "Learn Moodle August 2016" anonymized data set] | |||
[[Category:Report]] | [[Category:Report]] | ||
[[es:Análisis del aprendizaje]] | [[es:Análisis del aprendizaje]] |
Latest revision as of 15:15, 10 August 2021
Learning Analytics are any piece of information that can help an LMS user improve learning outcomes. Users include students, teachers, administrators and decision-makers.
Moodle Plugins
There are a number of reports, blocks and other plugins for Moodle that provide learning analytics.
Plugin | Plugin type | Standard / Additional | Useful for | Description | Reported usage* |
---|---|---|---|---|---|
Logs | Report | Standard | Teachers, Admins, Decision-makers | Filterable log of events | 71.4% |
Activity | Report | Standard | Teachers | View count of activities in course | 69.1% |
Activity completion, see also Course completion | Report | Standard | Teachers | Completion matrix of students and activities | 66.3% |
Live logs | Report | Standard | Teachers, Admins | Automatically refreshing log of events | 55.2% |
Feedback | Activity | Standard | Teachers, Researchers | Configurable survey tool | 59.5% |
(Quiz) Statistics | Report | Standard | Teachers | Student quiz performance report | 53.0% |
(Course) Participation | Report | Standard | Teachers | Single student's participation in course | 49.9% |
Survey | Activity | Standard | Teachers, Researchers | Set of standardised educational surveys | 45.6% |
Questionnaire | Activity | Additional | Teachers, Researchers | Configurable survey tool | 45.3% |
Course overview | Report | Standard | Admins, Decision-makers | Comparison of participation across multiple courses | 45.0% |
Course completion status | Block | Standard | Students | View of student's own completion of activities | 41.4% |
Progress Bar | Block | Additional | Students, Teachers | Time management tool for students with overview for teachers | 32.0% |
Events list | Report | Standard | Teachers, Admins | Events that can be monitored/searched in logs | 28.6% |
Activity results block | Block | Standard | Students | Leader-board of results in single activity | 26.1% |
Configurable Reports | Block (Report Graphs filter) | Additional | Teachers, Admins, Decision-makers | Report generation and viewing | 22.7% |
(Gradebook) Overview | Report | Standard | Teachers, Students | View of student grades across activites | N/A |
Statistics | Report | Standard | Admins, Decision-makers | Daily activity across site | N/A |
Event monitor | Report | Standard | Teachers, Admins, Decision-makers | Proactive, focussed monitor tool | N/A |
Ad-hoc database queries | Report | Additional | Teachers, Admins, Decision-makers | SQL-based report generation and viewing | N/A |
Engagement Analytics | Block, Report, Activity module | Additional | Teachers | Configurable engagement measurement report and block | N/A |
Course Dedication | Block | Additional | Students, Teachers | Estimated time online for students | N/A |
Graph Stats | Block | Additional | Teachers, Admins | Daily visits to site or course | N/A |
GISMO | Block | Additional | Teachers | Numerous charts of student activity participation | N/A |
Level Up! | Block | Additional | Students, Teachers | Incentive-drive participation meter | N/A |
Forum Graph | Report | Additional | Teachers | Graph of forum interactions | N/A |
Analytics Graphs | Block | Additional | Teachers | Visualisation of student participation | N/A |
Heatmap | Block | Additional | Teachers | Colour-coded indication of activity views on course page | N/A |
Analytics | Local | Additional | Admins, Decision-makers | Enriched feed to Google Analytics and Pywick | N/A |
Logstore xAPI | Logstore | Additional | Admins, Decision-makers, Researchers | xAPI event stream output | N/A |
* Reported usage is drawn from the Plugins Usage Survey from 2015.
Integrations with Moodle
A number of systems integrate with Moodle to provide learning analytics information externally.
- Moodle Activity Viewer (MAV) (Git), consider Heatmap as an alternative
- Intelliboard
- Zoola (was Analytika)
- Learning Locker, can be used with Logstore xAPI
- SmartKlass
- Blackboard Predict
- Completing the loop
- IADlearning offers institutions and educators a rich set of analytics allowing them to understand the quality of their training content, as well as the quality of the ongoing learning processes.
Dimensions of Analytics
Learning analytics are a concept that has been emerging under a number of different names through the past decades. Its origins lie in research in data mining and intelligent tutoring systems. LA tools can be categorised in a number of ways:
- Descriptive
- Predictive
- Diagnostic
- Prescriptive
See also...
- Analytics and reporting forum
- Moodle Research forum
- Moodle research page
- Logging
- Events list
- Learning Analytics API specification
- Assessment Analytics working group details and issues
- Events specification
- Logging specification
- Report Builder API specification
- Use Generico filter to display custom DB reports with graphs Demo / Forums
- Solving the ethical and legal issues around learning analytics: a series of podcasts
- A number of free Moodle analytics plugins you can try available on http://plugins.moodlebites.com
Presentations
- Moodle Analytics Plans I Elizabeth Dalton at MoodleMoot Australia 2016 (video 24m)
- List of Learning Analytics related presentation, from project Inspire
Project Inspire
Project Inspire is an open source, transparent next-generation learning analytics that go beyond simple descriptive analytics to provide predictions of learner success, and ultimately diagnosis and prescriptions (advisements) to learners and teachers. Moodle’s Project Inspire is essentially Moodle’s Analytics Plan. The project aims to identify and validate, indicators of student, teacher and institutional engagement in educational activities. Information from this will be used to develop learning analytics software features, which will have these functions:
- Description of learning engagement and progress,
- Diagnosis of learning engagement and progress,
- Prediction of learning progress, and
- Prescription (recommendations) for improvement of learning progress.