Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs. A related field is educational data mining.
- 1 Definition
- 1.1 Learning Analytics defined as a prediction model
- 1.2 Learning Analytics defined as a generic design framework
- 1.3 The "What – Who – Why – How" Approach
- 1.4 Learning Analytics as a data-driven decision making
- 1.5 Learning Analytics as a process based on educational data and statistical model
- 1.6 Learning Analytics definition to integrate computational and educational aspects
- 1.7 Learning analytics at intersection of data science, theory, and design
- 1.8 Learning Analytics as an application of Web Analytics
- 2 Differentiating learning analytics and educational data mining
- 3 History
- 3.1 Social Network Analysis: historical contributions
- 3.2 User modelling: historical contributions
- 3.3 Education/cognitive modelling: historical contributions
- 3.4 Data Mining: historical contributions
- 3.5 E-learning: historical contributions
- 3.6 Epistemic Frame Theory: historical contributions
- 3.7 Other contributions
- 3.8 History of learning analytics in higher education
- 4 Analytic methods
- 5 Applications
- 6 Software
- 7 Ethics and privacy
- 8 Open learning analytics
- 9 See also
- 10 Further reading
- 11 Notes
- 12 References
- 13 External links
Although a majority of Learning Analytics literature has started to adopt the aforementioned definition, the definition and aims of Learning Analytics are still contested.
Learning Analytics defined as a prediction modelEdit
One earlier definition discussed by the community suggested that Learning Analytics is the use of intelligent data, learner-produced data, and analysis models to discover information and social connections for predicting and advising people's learning. But this definition has been criticised by George Siemens[non-primary source needed] and Mike Sharkey.[non-primary source needed]
Learning Analytics defined as a generic design frameworkEdit
Dr. Wolfgang Greller and Dr. Hendrik Drachsler defined learning analytics holistically as a framework. They proposed that it is a generic design framework that can act as a useful guide for setting up analytics services in support of educational practice and learner guidance, in quality assurance, curriculum development, and in improving teacher effectiveness and efficiency. It uses a general morphological analysis (GMA) to divide the domain into six "critical dimensions".
The "What – Who – Why – How" ApproachEdit
In 2012, a systematic overview on learning analytics and its key concepts was provided by Professor Mohamed Chatti and colleagues through a reference model based on four dimensions, namely:
- data, environments, context (what?),
- stakeholders (who?),
- objectives (why?), and
- methods (how?).
Learning Analytics as a data-driven decision makingEdit
The broader term "Analytics" has been defined as the science of examining data to draw conclusions and, when used in decision making, to present paths or courses of action. From this perspective, Learning Analytics has been defined as a particular case of Analytics, in which decision making aims to improve learning and education.
During the decade of 2010, this definition of analytics has gone further to incorporate elements of operations research such as decision trees and strategy maps to establish predictive models and to determine probabilities for certain courses of action.
Learning Analytics as a process based on educational data and statistical modelEdit
Another approach for defining Learning Analytics is based on the concept of Analytics interpreted as the process of developing actionable insights through problem definition and the application of statistical models and analysis against existing and/or simulated future data. From this point of view, Learning Analytics emerges as a type of Analytics (as a process), in which the data, the problem definition and the insights are learning-related.
Learning Analytics definition to integrate computational and educational aspectsEdit
In 2015, Gašević, Dawson, and Siemens argued that computational aspects of learning analytics need to be linked with the existing educational research in order for Learning Analytics to deliver its promise to understand and optimize learning.
Learning analytics at intersection of data science, theory, and designEdit
In 2017, Gašević, Коvanović, and Joksimović proposed a consolidated model of learning analytics  . The model posits that learning analytics is defined at the intersection of three disciplines: data science, theory, and design. Data science offers computational methods and techniques for data collection, pre-processing, analysis, and presentation. Theory is typically drawn from the literature in the learning sciences, education, psychology, sociology, and philosophy. The design dimension of the model includes: learning design, interaction design, and study design.
Learning Analytics as an application of Web AnalyticsEdit
In 2016, a research jointly conducted by the New Media Consortium (NMC) and the EDUCAUSE Learning Initiative (ELI) -an EDUCAUSE Program- describes six areas of emerging technology that will have had significant impact on higher education and creative expression by the end of 2020. As a result of this research, Learning analytics was defined as an educational application of web analytics aimed at learner profiling, a process of gathering and analyzing details of individual student interactions in online learning activities.
Differentiating learning analytics and educational data miningEdit
Differentiating the fields of educational data mining (EDM) and learning analytics (LA) has been a concern of several researchers. George Siemens takes the position that educational data mining encompasses both learning analytics and academic analytics, the former of which is aimed at governments, funding agencies, and administrators instead of learners and faculty. Baepler and Murdoch define academic analytics as an area that "...combines select institutional data, statistical analysis, and predictive modeling to create intelligence upon which learners, instructors, or administrators can change academic behavior". They go on to attempt to disambiguate educational data mining from academic analytics based on whether the process is hypothesis driven or not, though Brooks questions whether this distinction exists in the literature. Brooks instead proposes that a better distinction between the EDM and LA communities is in the roots of where each community originated, with authorship at the EDM community being dominated by researchers coming from intelligent tutoring paradigms, and learning anaytics researchers being more focused on enterprise learning systems (e.g. learning content management systems).
Regardless of the differences between the LA and EDM communities, the two areas have significant overlap both in the objectives of investigators as well as in the methods and techniques that are used in the investigation. In the MS program offering in learning analytics at Teachers College, Columbia University, students are taught both EDM and LA methods.
Learning Analytics, as a field, has multiple disciplinary roots. While the fields of artificial intelligence (AI), statistical analysis, machine learning, and business intelligence offer an additional narrative, the main historical roots of analytics are the ones directly related to human interaction and the education system. More in particular, the history of Learning Analytics is tightly linked to the development of four Social Sciences’ fields that have converged throughout time. These fields pursued, and still do, four goals:
- Definition of Learner, in order to cover the need of defining and understanding a learner.
- Knowledge trace, addressing how to trace or map the knowledge that occurs during the learning process.
- Learning efficiency and personalization, which refers to how to make learning more efficient and personal by means of technology.
- Learner – content comparison, in order to improve learning by comparing the learner’s level of knowledge with the actual content that needs to master.(Siemens, George (2013-03-17). Intro to Learning Analytics. LAK13 open online course for University of Texas at Austin & Edx. 11 minutes in. Retrieved 2018-11-01.)
A diversity of disciplines and research activities have influenced in these 4 aspects throughout the last decades, contributing to the gradual development of learning analytics. Some of most determinant disciplines are Social Network Analysis, User Modelling, Cognitive modelling, Data Mining and E-Learning. The history of Learning Analytics can be understood by the rise and development of these fields.
Social Network Analysis: historical contributionsEdit
Social network analysis (SNA) is the process of investigating social structures through the use of networks and graph theory. It characterizes networked structures in terms of nodes (individual actors, people, or things within the network) and the ties, edges, or links (relationships or interactions) that connect them. Social network analysis is prominent in Sociology, and its development has had a key role in the emergence of Learning Analytics.
The relevance of interactionsEdit
One of the first examples or attempts to provide a deeper understanding of interactions is by Austrian-American Sociologist Paul Lazarsfeld. In 1944, Lazarsfeld made the statement of “who talks to whom about what and to what effect". That statement forms what today is still the area of interest or the target within social network analysis, which tries to understand how people are connected and what insights can be derived as a result of their interactions, a core idea of Learning Analytics.
American linguist Eugene Garfield was an early pioneer in analytics in science. In 1955, Garfield led the first attempt to analyse the structure of science regarding how developments in science can be better understood by tracking the associations (citations) between articles (how they reference one another, the importance of the resources that they include, citation frequency, etc). Through tracking citations, scientists can observe how research is disseminated and validated. This was the basic idea of what eventually became a “page rank”, which in the early days of Google (beginning of the 21st century) was one of the key ways of understanding the structure of a field by looking at page connections and the importance of those connections. The algorithm PageRank -the first search algorithm used by Google- was based on this principle. American computer scientist Larry Page, Google's co-founder, defined PageRank as “an approximation of the importance” of a particular resource. Educationally, citation or link analysis is important for mapping knowledge domains.
The essential idea behind these attempts is the realization that, as data increases, individuals, researchers or business analysts need to understand how to track the underlying patterns behind the data and how to gain insight from them. And this is also a core idea in Learning Analytics.
Digitalization of Social network analysis
- Milgram's 6 degrees experiment. In 1967, American social psychologist Stanley Milgram and other researchers examined the average path length for social networks of people in the United States, suggesting that human society is a small-world-type network characterized by short path-lengths.
- Weak ties. American Sociologist Mark Granovetter's work on the strength of what is known as weak ties; his 1973 article “The Strength of Weak Ties” is one of the most influential and most cited articles in Social Sciences.
- Networked individualism. Towards the end of the 20th century, Sociologist Barry Wellman’s research extensively contributed the theory of social network analysis. In particular, Wellman observed and described the rise of “networked individualism" – the transformation from group-based networks to individualized networks.
During the first decade of the century, Professor Caroline Haythornthwaite explored the impact of media type on the development of social ties, observing that human interactions can be analyzed to gain novel insight not from strong interactions (i.e. people that are strongly related to the subject) but, rather, from weak ties. This provides Learning Analytics with a central idea: apparently un-related data may hide crucial information. As an example of this phenomenon, an individual looking for a job will have a better chance of finding new information through weak connections rather than strong ones. (Siemens, George (2013-03-17). Intro to Learning Analytics. LAK13 open online course for University of Texas at Austin & Edx. 11 minutes in. Retrieved 2018-11-01.)
Her research also focused on the way that different types of media can impact the formation of networks. Her work highly contributed to the development of social network analysis as a field. Important ideas were inherited by Learning Analytics, such that a range of metrics and approaches can define the importance of a particular node, the value of information exchange, the way that clusters are connected to one another, structural gaps that might exist within those networks, etc.
User modelling: historical contributionsEdit
The main goal of user modelling is the customization and adaptation of systems to the user's specific needs, especially in their interaction with computing systems. The importance of computers being able to respond individually to into people was starting to be understood in the decade of 1970s. Dr Elaine Rich in 1979 predicted that "computers are going to treat their users as individuals with distinct personalities, goals, and so forth". This is a central idea not only educationally but also in general web use activity, in which personalization is an important goal.
User modelling has become important in research in human-computer interactions as it helps researchers to design better systems by understanding how users interact with software. Recognizing unique traits, goals, and motivations of individuals remains an important activity in learning analytics.
Personalization and adaptation of learning content is an important present and future direction of learning sciences, and its history within education has contributed to the development of learning analytics.
Hypermedia is a nonlinear medium of information that includes graphics, audio, video, plain text and hyperlinks. The term was first used in a 1965 article written by American Sociologist Ted Nelson. Adaptive hypermedia builds on user modelling by increasing personalization of content and interaction. In particular, adaptive hypermedia systems build a model of the goals, preferences and knowledge of each user, in order to adapt to the needs of that user. From the end of the 20th century onwards, the field grew rapidly, mainly due to that the internet boosted research into adaptivity and, secondly, the accumulation and consolidation of research experience in the field. In turn, Learning Analytics has been influenced by this strong development.
Education/cognitive modelling: historical contributionsEdit
Education/cognitive modelling has been applied to tracing how learners develop knowledge. Since the end of the 1980s and early 1990s, computers have been used in education as learning tools for decades. In 1989, Hugh Burns argued for the adoption and development of intelligent tutor systems that ultimately would pass three levels of “intelligence”: domain knowledge, learner knowledge evaluation, and pedagogical intervention. During the 21st century, these three levels have remained relevant for researchers and educators.
In the decade of 1990s, the academic activity around cognitive models focused on attempting to develop systems that possess a computational model capable of solving the problems that are given to students in the ways students are expected to solve the problems. Cognitive modelling has contributed to the rise in popularity of intelligent or cognitive tutors. Once cognitive processes can be modelled, software (tutors) can be developed to support learners in the learning process. The research base on this field became, eventually, significantly relevant for learning analytics during the 21st century.
Data Mining: historical contributionsEdit
Data Mining, in particular Knowledge Discovery in Databases (KDD) has been a research interest since at least the early 1990s. As with analytics today, KDD was concerned with the development of methods and techniques for making sense of data. The EDM community has been heavily influenced by the vision of early KDD.
E-learning: historical contributionsEdit
The growth of online learning during the 1990s, 2000s y 2010s, particularly in higher education, has contributed to the advancement of Learning Analytics as student data can be captured and made available for analysis. When learners use an LMS, social media, or similar online tools, their clicks, navigation patterns, time on task, social networks, information flow, and concept development through discussions can be tracked. The rapid development of massive open online courses (MOOCs) offers additional data for researchers to evaluate teaching and learning in online environments.
Epistemic Frame Theory: historical contributionsEdit
While big data analytics has been more and more widely applied in education, Wise and Shaffer addressed the importance of theory-based approach in the analysis. Epistemic Frame Theory conceptualized the "ways of thinking, acting, and being in the world" in a collaborative learning environment. Specifically, the framework is based on the context of Community of Practice (CoP), which is a group of learners, with common goals, standards and prior knowledge and skills, to solve a complex problem. Due to the essence of CoP, it is important to study the connections between elements (learners, knowledge, concepts, skills and so on). To identify the connections, the co-occurrences of elements in learners' data are identified and analyzed.
Shaffer and Ruis pointed out the concept of closing the interpretive loop, by emphasizing the transparency and validation of model, interpretation and the original data. The loop can be closed by a good theoretical sound analytics approaches, Epistemic Network Analysis.
In a discussion of the history of analytics, Adam Cooper highlights a number of communities from which learning analytics has drawn techniques, mainly during the first decades of the 21st century, including:
- Statistics, which are a well established means to address hypothesis testing.
- Business intelligence, which has similarities with learning analytics, although it has historically been targeted at making the production of reports more efficient through enabling data access and summarising performance indicators.
- Web analytics, tools such as Google Analytics report on web page visits and references to websites, brands and other key terms across the internet. The more "fine grain" of these techniques can be adopted in learning analytics for the exploration of student trajectories through learning resources (courses, materials, etc.).
- Operational research, which aims at highlighting design optimisation for maximising objectives through the use of mathematical models and statistical methods. Such techniques are implicated in learning analytics which seek to create models of real world behaviour for practical application.
- Artificial intelligence methods (combined with machine learning techniques built on data mining) are capable of detecting patterns in data. In learning analytics such techniques can be used for intelligent tutoring systems, classification of students in more dynamic ways than simple demographic factors, and resources such as "suggested course" systems modelled on collaborative filtering techniques.
- Information visualization, which is an important step in many analytics for sensemaking around the data provided, and is used across most techniques (including those above).
History of learning analytics in higher educationEdit
The first graduate program focused specifically on learning analytics was created by Ryan S. Baker and launched in the Fall 2015 semester at Teachers College, Columbia University. The program description states that
"(...)data about learning and learners are being generated today on an unprecedented scale. The fields of learning analytics (LA) and educational data mining (EDM) have emerged with the aim of transforming this data into new insights that can benefit students, teachers, and administrators. As one of world's leading teaching and research institutions in education, psychology, and health, we are proud to offer an innovative graduate curriculum dedicated to improving education through technology and data analysis."
Methods for learning analytics include:
- Content analysis, particularly of resources which students create (such as essays).
- Discourse analytics, which aims to capture meaningful data on student interactions which (unlike social network analytics) aims to explore the properties of the language used, as opposed to just the network of interactions, or forum-post counts, etc.
- Social learning analytics, which is aimed at exploring the role of social interaction in learning, the importance of learning networks, discourse used to sensemake, etc.
- Disposition analytics, which seeks to capture data regarding student's dispositions to their own learning, and the relationship of these to their learning. For example, "curious" learners may be more inclined to ask questions, and this data can be captured and analysed for learning analytics.
- Epistemic Network Analysis, which is an analytics technique that models the co-occurrence of different concepts and elements in the learning process. For example, the online discourse data can be segmented as turn of talk. By coding students' different behaviors of collaborative learning, we could apply ENA to identify and quantify the co-occurrence of different behaviors for any individual in the group.
Learning Applications can be and has been applied in a noticeable number of contexts.
Types of applications per organisational business objectivesEdit
- for individual learners to reflect on their achievements and patterns of behaviour in relation to others. Particularly, the following areas can be set out for measuring, monitoring, analyzing and changing to optimize student performance:
- Monitoring individual student performance
- Disaggregating student performance by selected characteristics such as major, year of study, ethnicity, etc.
- Identifying outliers for early intervention
- Predicting potential so that all students achieve optimally
- Preventing attrition from a course or program
- Identifying and developing effective instructional techniques
- Analyzing standard assessment techniques and instruments (i.e. departmental and licensing exams)
- Testing and evaluation of curricula.
- as predictors of students requiring extra support and attention;
- to help teachers and support staff plan supporting interventions with individuals and groups;
- for functional groups such as course teams seeking to improve current courses or develop new curriculum offerings; and
- for institutional administrators taking decisions on matters such as marketing and recruitment or efficiency and effectiveness measures.
Some motivations and implementations of analytics may come into conflict with others, for example highlighting potential conflict between analytics for individual learners and organisational stakeholders.
Analytics have been used for:
- Prediction purposes, for example to identify "at risk" students in terms of drop out or course failure.
- Personalization & adaptation, to provide students with tailored learning pathways, or assessment materials.
- Intervention purposes, providing educators with information to intervene to support students.
- Information visualization, typically in the form of so-called learning dashboards which provide overview learning data through data visualisation tools.
Much of the software that is currently used for learning analytics duplicates functionality of web analytics software, but applies it to learner interactions with content. Social network analysis tools are commonly used to map social connections and discussions. Some examples of learning analytics software tools include:
- BEESTAR INSIGHT: a real-time system that automatically collects student engagement and attendance, and provides analytics tools and dashboards for students, teachers and management[non-primary source needed]
- LOCO-Analyst: a context-aware learning tool for analytics of learning processes taking place in a web-based learning environment
- SAM: a Student Activity Monitor intended for personal learning environments[non-primary source needed]
- SNAPP: a learning analytics tool that visualizes the network of interactions resulting from discussion forum posts and replies[non-primary source needed]
- Solutionpath StREAM: A leading UK based real-time system that leverage predictive models to determine all facets of student engagement using structured and unstructured sources for all institutional roles[non-primary source needed]
- Student Success System: a predictive learning analytics tool that predicts student performance and plots learners into risk quadrants based upon engagement and performance predictions, and provides indicators to develop understanding as to why a learner is not on track through visualizations such as the network of interactions resulting from social engagement (e.g. discussion posts and replies), performance on assessments, engagement with content, and other indicators[non-primary source needed]
- Epistemic Network Analysis (ENA) web tool: An interactive online tool that allow researchers to upload the coded dataset and create the model by specifying units, conversations and codes.  Useful functions within the online tool includes mean rotation for comparison between two groups, specifying the sliding window size for connection accumulation, weighed or unweighted models, and parametric and non-parametric statistical testings with suggested write-up and so on. The web tool is stable and open source.
Ethics and privacyEdit
- Data ownership
- Communications around the scope and role of learning analytics
- The necessary role of human feedback and error-correction in learning analytics systems
- Data sharing between systems, organisations, and stakeholders
- Trust in data clients
As Kay, Kom and Oppenheim point out, the range of data is wide, potentially derived from:
- Recorded activity: student records, attendance, assignments, researcher information (CRIS)
- Systems interactions: VLE, library / repository search, card transactions
- Feedback mechanisms: surveys, customer care
- External systems that offer reliable identification such as sector and shared services and social networks
Thus the legal and ethical situation is challenging and different from country to country, raising implications for:
- Variety of data: principles for collection, retention and exploitation
- Education mission: underlying issues of learning management, including social and performance engineering
- Motivation for development of analytics: mutuality, a combination of corporate, individual and general good
- Customer expectation: effective business practice, social data expectations, cultural considerations of a global customer base.
- Obligation to act: duty of care arising from knowledge and the consequent challenges of student and employee performance management
In some prominent cases like the inBloom disaster, even full functional systems have been shut down due to lack of trust in the data collection by governments, stakeholders and civil rights groups. Since then, the learning analytics community has extensively studied legal conditions in a series of experts workshops on "Ethics & Privacy 4 Learning Analytics" that constitute the use of trusted learning analytics.[non-primary source needed] Drachsler & Greller released an 8-point checklist named DELICATE that is based on the intensive studies in this area to demystify the ethics and privacy discussions around learning analytics.
- D-etermination: Decide on the purpose of learning analytics for your institution.
- E-xplain: Define the scope of data collection and usage.
- L-egitimate: Explain how you operate within the legal frameworks, refer to the essential legislation.
- I-nvolve: Talk to stakeholders and give assurances about the data distribution and use.
- C-onsent: Seek consent through clear consent questions.
- A-nonymise: De-identify individuals as much as possible
- T-echnical aspects: Monitor who has access to data, especially in areas with high staff turn-over.
- E-xternal partners: Make sure externals provide highest data security standards
It shows ways to design and provide privacy conform learning analytics that can benefit all stakeholders. The full DELICATE checklist is publicly available.
Open learning analyticsEdit
Chatti, Muslim and Schroeder note that the aim of open learning analytics (OLA) is to improve learning effectiveness in lifelong learning environments. The authors refer to OLA as an ongoing analytics process that encompasses diversity at all four dimensions of the learning analytics reference model.
For general audience introductions, see:
- "Call for Papers of the 1st International Conference on Learning Analytics & Knowledge (LAK 2011)". Retrieved 12 February 2014.
- Siemens, G., Connectivism: A learning theory for the digital age, International Journal of Instructional Technology and Distance Learning 2 (10), 2005.
- George., Siemens (2006). Knowing knowledge. [Place of publication not identified]: [publisher not identified]. ISBN 978-1-4303-0230-8. OCLC 123536429.
- Siemens, George. "What Are Learning Analytics?" Elearnspace, August 25, 2010. 
- "I somewhat disagree with this definition—it serves well as an introductory concept if we use analytics as a support structure for existing education models. I think learning analytics—at an advanced and integrated implementation—can do away with pre-fab curriculum models." George Siemens in the Learning Analytics Google Group discussion, August 2010
- "In the descriptions of learning analytics we talk about using data to "predict success". I've struggled with that as I pore over our databases. I've come to realize there are different views/levels of success." Mike Sharkey, Director of Academic Analytics, University of Phoenix, in the Learning Analytics Google Group discussion, August 2010
- Greller, Wolfgang; Drachsler, Hendrik (2012). "Translating Learning into Numbers: Toward a Generic Framework for Learning Analytics" (PDF). Educational Technology and Society. 15 (3): 42–57. Retrieved 2018-11-01.
- Mohamed Amine Chatti, Anna Lea Dyckhoff, Ulrik Schroeder and Hendrik Thüs (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning (IJTEL), 4(5/6), pp. 318-331.
- Chatti, M. A., Lukarov, V., Thüs, H., Muslim, A., Yousef, A. M. F., Wahid, U., Greven, C., Chakrabarti, A., Schroeder, U. (2014). Learning Analytics: Challenges and Future Research Directions. eleed, Iss. 10. http://eleed.campussource.de/archive/10/4035
- Picciano, Anthony G. (2012). "The Evolution of Big Data and Learning Analytics in American Higher Education" (pdf). Journal of Asynchronous Learning Networks. 16: 9–20.
- Elias, Tanya (January 2011). "Learning Analytics: Definitions, Processes and Potential" (PDF). Unpublished Paper: 19. Retrieved 2018-11-02. Lay summary.
- Cooper, Adam (November 2012). "What is Analytics? Definition and Essential Characteristics" (PDF). The University of Bolton. ISSN 2051-9214. Retrieved 2018-11-01.
- Powell, Stephen, and Sheila MacNeill. Institutional Readiness for Analytics A Briefing Paper. CETIS Analytics Series. JISC CETIS, December 2012. "Archived copy" (PDF). Archived from the original (PDF) on 2013-05-02. Retrieved 2018-11-01.CS1 maint: archived copy as title (link).
- Gašević, D.; Dawson, S.; Siemens, G. (2015). "Let's not forget: Learning analytics are about learning" (PDF). TechTrends. 59 (1): 64–71. doi:10.1007/s11528-014-0822-x. hdl:20.500.11820/037bd57b-858f-4d21-bd29-2c6ad4788b42.
- Gašević, D.; Kovanović, V.; Joksimović, S. (2017). "Piecing the learning analytics puzzle: a consolidated model of a field of research and practice" (PDF). Learning: Research and Practice. 3 (1): 63–78. doi:10.1080/23735082.2017.1286142.
- Johnson, Larry; Adams Becker, Samantha; Cummins, Michele (2016). NMC Horizon Report: 2016 Higher Education Edition (PDF). The New Media Consortium. Texas, Austin, USA. p. 38. ISBN 978-0-9968527-5-3. Retrieved 2018-10-30.
- G. Siemens, D. Gasevic, C. Haythornthwaite, S. Dawson, S. B. Shum, R. Ferguson, E. Duval, K. Verbert, and R. S. J. D. Baker. Open Learning Analytics: an integrated & modularized platform. 2011.
- Baepler, P.; Murdoch, C. J. (2010). "Academic Analytics and Data Mining in Higher Education". International Journal for the Scholarship of Teaching and Learning. 4 (2). doi:10.20429/ijsotl.2010.040217.
- C. Brooks. A Data-Assisted Approach to Supporting Instructional Interventions in Technology Enhanced Learning Environments. PhD Dissertation. University of Saskatchewan, Saskatoon, Canada 2012.
- "Learning Analytics | Teachers College Columbia University". www.tc.columbia.edu. Retrieved 2015-10-13.
- Siemens, George (2013-08-20). "Learning Analytics: The Emergence of a Discipline". American Behavioral Scientist. 57 (10): 1380–1400. doi:10.1177/0002764213498851. ISSN 0002-7642.
- Otte, Evelien; Rousseau, Ronald (2002). "Social network analysis: a powerful strategy, also for the information sciences". Journal of Information Science. 28 (6): 441–453. doi:10.1177/016555150202800601. Retrieved 2015-03-23.
- Lazarsfeld, Paul F. (January 1944). "The Election Is Over". Public Opinion Quarterly. 8 (3): 317. doi:10.1086/265692.
- Sullivan, Danny (2007-04-26). "What Is Google PageRank? A Guide For Searchers & Webmasters". Search Engine Land. Archived from the original on 2016-07-03.
- Cutts, Matt. "Algorithms Rank Relevant Results Higher". Archived from the original on July 2, 2013. Retrieved 19 October 2015.
- Page, Lawrence; Brin, Sergey; Motwani, Rajeev; Winograd, Terry (1999). "The PageRank Citation Ranking: Bringing Order to the Web" (PDF). Stanford InfoLab.
- Milgram, Stanley (May 1967). "The Small World Problem". Psychology Today.
- Granovetter, Mark S. (May 1973). "The Strength of Weak Ties" (PDF). The American Journal of Sociology. 78 (6): 1360–1380. doi:10.1086/225469. JSTOR 2776392.
- Networks in the global village : life in contemporary communities. Wellman, Barry. Boulder, Colo: Westview Press. 1999. ISBN 978-0-8133-1150-0. OCLC 39498470.CS1 maint: others (link)
- Wellman, Barry; Hampton, Keith (November 1999). "Living Networked in a Wired World" (PDF). Contemporary Sociology. 28 (6). Retrieved 2018-11-02.
- Barry Wellman, "Physical Place and Cyber Place: The Rise of Networked Individualism." International Journal of Urban and Regional Research 25,2 (June, 2001): 227-52.
- Rapoport, Anatol (1957). "Contributions to the Theory of Random and Biased Nets". Bulletin of Mathematical Biophysics. 19 (4): 257–277. doi:10.1007/BF02478417.
- Haythornthwaite, Caroline; Andrews, Richard (2011). E-learning theory and practice. London, UK: Sage. doi:10.4135/9781446288566. ISBN 978-1-84920-471-2.
- Rich, Elaine (1979). "User modeling via stereotypes" (PDF). Cognitive Science. 3 (4): 329–354. doi:10.1207/s15516709cog0304_3.
- Fischer, Gerhard (2001). "User Modeling in Human^Computer Interaction" (PDF). User Modeling and User-Adapted Interaction. 11: 65–86. doi:10.1023/A:1011145532042.
- Nelson, T. H. (1965-08-24). "Complex information processing". Complex information processing: a file structure for the complex, the changing and the indeterminate. ACM. pp. 84–100. doi:10.1145/800197.806036.
- Brusilovsky, Peter (2001). "Adaptive Hypermedia". User Modeling and User-Adapted Interaction. 11 (1/2): 87–110. doi:10.1023/a:1011143116306. ISSN 0924-1868.
- Burns, Hugh (1989). Richardson, J. Jeffrey; Polson, Martha C. (eds.). "Foundations of intelligent tutoring systems: An introduction". Proceedings of the Air Force Forum for Intelligent Tutoring Systems.
- Anderson, John R.; Corbett, Albert T.; Koedinger, Kenneth R.; Pelletier, Ray (1995). "Cognitive tutors: Lessons learned" (PDF). Journal of the Learning Sciences. 4 (2): 167–207. doi:10.1207/s15327809jls0402_2.
- Koedinger, Kenneth; Osborne, David; Gaebler, Ted (2018). Forbus, K.D.; Feltovich, P.J. (eds.). "Intelligent Cognitive Tutors as Modeling Tool and Instructional Model" (PDF). Smart Machines in Education: The Coming Revolution in Educational Technology: 145–168.
- Koedinger, Kenneth (2003). "Toward a Rapid Development Environment for Cognitive Tutors Interactive Event during AIED-03" (PDF). Artificial Intelligent in Education.
- Fayyad, Usama; Piatetsky-Shapiro, Gregory; Smyth, Padhraic (1996). "From data mining to knowledge discovery in databases". AI Magazine. 17 (30): 37–54.
- Andrews, R.; Haythornthwaite, Caroline (2007). Handbook of e-learning research. London, UK: Sage.
- Anderson, T. (2008). The theory and practice of online learning. Athabasca, Canada: Athabasca University Press.
- Haythornthwaite, Caroline; Andrews, R. (2011). E-learning theory and practice. London, UK: Sage.
- "What You Need to Know About MOOCs". The Chronicle of Higher Education. 2012-08-08. Retrieved 2018-11-03.
- Shaffer, David Williamson; Collier, Wesley; Ruis, A. R. (2016). "A Tutorial on Epistemic Network Analysis: Analyzing the Structure of Connections in Cognitive, Social, and Interaction Data". Journal of Learning Analytics. 3 (3): 9–45. doi:10.18608/jla.2016.33.3. ISSN 1929-7750.
- Shaffer, David Williamson; Ruis, A. R. (2017), "Epistemic Network Analysis: A Worked Example of Theory-Based Learning Analytics", Handbook of Learning Analytics, Society for Learning Analytics Research (SoLAR), pp. 175–187, ISBN 9780995240803, retrieved 2019-10-10
- Cooper, Adam. A Brief History of Analytics A Briefing Paper. CETIS Analytics Series. JISC CETIS, November 2012. http://publications.cetis.ac.uk/wp-content/uploads/2012/12/Analytics-Brief-History-Vol-1-No9.pdf.
- "Learning Analytics". www.tc.columbia.edu. Retrieved 2015-11-03.
- Buckingham Shum, S. and Ferguson, R., Social Learning Analytics. Educational Technology & Society (Special Issue on Learning & Knowledge Analytics, Eds. G. Siemens & D. Gašević), 15, 3, (2012), 3-26. http://www.ifets.info Open Access Eprint: http://oro.open.ac.uk/34092
- Brown, M., Learning Analytics: Moving from Concept to Practice. EDUCAUSE Learning Initiative Briefing, 2012. http://www.educause.edu/library/resources/learning-analytics-moving-concept-practice
- Buckingham Shum, S. and Deakin Crick, R., Learning Dispositions and Transferable Competencies: Pedagogy, Modelling and Learning Analytics. In: Proc. 2nd International Conference on Learning Analytics & Knowledge (Vancouver, 29 Apr-2 May 2012). ACM: New York. pp.92-101. doi:10.1145/2330601.2330629 Eprint: http://oro.open.ac.uk/32823
- "Analytics for Achievement" (PDF). Ibm, S.a.: 4. February 2011. Retrieved 2018-11-01.
- Ali, L.; Hatala, M.; Gaševic, D.; Jovanovic, J. (2012). "A qualitative evaluation of evolution of a learning analytics tool". Computers & Education. 58 (1): 470–489. CiteSeerX 10.1.1.462.4375. doi:10.1016/j.compedu.2011.08.030.
- Ali, L.; Asadi, M.; Gaševic, D.; Jovanovic, J.; Hatala, M. (2013). "Factors influencing beliefs for adoption of a learning analytics tool: An empirical study" (PDF). Computers & Education. 62: 130–148. doi:10.1016/j.compedu.2012.10.023.
- "Billets pour le parc d'attraction disneyland Paris".
- "Social Networks in Action – Learning Networks @ UOW".
- "Brightspace Performance Plus for Higher Education | Learning Analytics Features | Brightspace by D2L".
- Arastoopour, Golnaz; Chesler, Naomi; Shaffer, David; Swiecki, Zachari. "Epistemic Network Analysis as a Tool for Engineering Design Assessment". 2015 ASEE Annual Conference and Exposition Proceedings. ASEE Conferences. doi:10.18260/p.24016.
- Slade, Sharon and Prinsloo, Paul "Learning analytics: ethical issues and dilemmas" in American Behavioral Scientist (2013), 57(10), pp. 1509–1528. http://oro.open.ac.uk/36594
- Siemens, G. "Learning Analytics: Envisioning a Research Discipline and a Domain of Practice." In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, 4–8, 2012. http://dl.acm.org/citation.cfm?id=2330605.
- Kristy Kitto, Towards a Manifesto for Data Ownership http://www.laceproject.eu/blog/towards-a-manifesto-for-data-ownership/
- Kay, David, Naomi Kom, and Charles Oppenheim. Legal, Risk and Ethical Aspects of Analytics in Higher Education. Analytics Series. Accessed January 3, 2013. "Archived copy" (PDF). Archived from the original (PDF) on 2013-05-02. Retrieved 2013-08-10.CS1 maint: archived copy as title (link)
- "Bloomberg – Are you a robot?".
- "Ethics and Privacy in Learning Analytics (#EP4LA)".
- Drachsler, H. & Greller, W. (2016). Privacy and Analytics – it's a DELICATE issue. A Checklist to establish trusted Learning Analytics. 6th Learning Analytics and Knowledge Conference 2016, April 25–29, 2016, Edinburgh, UK.
- "DELICATE checklist – to establish trusted Learning Analytics". 2016-01-25.
- Mohamed Amine Chatti, Arham Muslim, and Ulrik Schroeder (2017). Toward an Open Learning Analytics Ecosystem. In Big Data and Learning Analytics in Higher Education (pp. 195-219). Springer International Publishing.
- Eli (2011). "Seven Things You Should Know About First Generation Learning Analytics". EDUCAUSE Learning Initiative Briefing.
- Long, P.; Siemens, G. (2011). "Penetrating the fog: analytics in learning and education". Educause Review Online. 46 (5): 31–40.
- Buckingham Shum, Simon (2012). Learning Analytics Policy Brief (PDF). UNESCO.
- Johnson, Larry; Adams Becker, Samantha; Cummins, Michele (2016). NMC Horizon Report: 2016 Higher Education Edition (PDF). The New Media Consortium. Texas, Austin, USA. ISBN 978-0-9968527-5-3. Retrieved 2018-10-28.
- Society for Learning Analytics Research (SoLAR) – a research network for learning analytics
- US Department of Education report on Learning Analytics. 2012
- Learning Analytics Google Group with discussions from researchers and individuals interested in the topic.
- International Conference Learning Analytics & Knowledge
- Learning Analytics and Educational Data Mining conferences and people
- Next Gen Learning definition
- Microsoft Education Analytics with information on how to use data to support improved educational outcomes.
- Educational Data mining
- Educause resources on learning analytics
- Learning analytics infographic
- New Media Consortium (NMC)