Automatic detection of accommodation steps as an indicator of knowledge maturing

Jointly working on shared digital artifacts - such as wikis - is a well-tried method of developing knowledge collectively within a group or organization. Our assumption is that such knowledge maturing is an accommodation process that can be measured by taking the writing process itself into account. This paper describes the development of a tool that detects accommodation automatically with the help of machine learning algorithms. We applied a software framework for task detection to the automatic identification of accommodation processes within a wiki. To set up the learning algorithms and test its performance, we conducted an empirical study, in which participants had to contribute to a wiki and, at the same time, identify their own tasks. Two domain experts evaluated the participants' micro-tasks with regard to accommodation. We then applied an ontology-based task detection approach that identified accommodation with a rate of 79.12%. The potential use of our tool for measuring knowledge maturing online is discussed.

[1]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[2]  Gijsbert Erkens,et al.  Coordination processes in computer supported collaborative writing , 2005, Comput. Hum. Behav..

[3]  N. Luhmann,et al.  System as Difference , 2006 .

[4]  H. Maibom Social Systems , 2007 .

[5]  Clemens H. Cap,et al.  Paving the Path to Automatic User Task Identification , 2008, CSKGOI.

[6]  Andreas S. Rath,et al.  Machine Learning based Work Task Classification , 2009, J. Digit. Inf. Manag..

[7]  Ulrike Cress,et al.  A systems theoretical approach to online knowledge building , 2011, AI & SOCIETY.

[8]  Stefanie N. Lindstaedt,et al.  Sustaining TEL: From Innovation to Learning and Practice , 2010, Lecture Notes in Computer Science.

[9]  Andreas S. Rath,et al.  Studying the Factors Influencing Automatic User Task Detection on the Computer Desktop , 2010, EC-TEL.

[10]  Ulrike Cress,et al.  An interactional perspective on group awareness: Alleviating the information-exchange dilemma (for everybody?) , 2007, Int. J. Hum. Comput. Stud..

[11]  Amy Bruckman,et al.  Writing, Citing, and Participatory Media: Wikis as Learning Environments in the High School Classroom , 2009 .

[12]  Ulrike Cress,et al.  A systemic and cognitive view on collaborative knowledge building with wikis , 2008, Int. J. Comput. Support. Collab. Learn..

[13]  Ulrike Cress,et al.  Social software and knowledge building: supporting co-evolution of individual and collective knowledge , 2010, ICLS.

[14]  Andreas S. Rath,et al.  Detecting Real User Tasks by Training on Laboratory Contextual Attention Metadata , 2009, GI Jahrestagung.

[15]  R. Sawyer The Cambridge Handbook of the Learning Sciences: Index , 2014 .

[16]  Jean Piaget,et al.  Problems of Equilibration , 1977 .

[17]  Ee-Peng Lim,et al.  Measuring article quality in wikipedia: models and evaluation , 2007, CIKM '07.

[18]  Ulrike Cress,et al.  Using Wikis for Learning and Knowledge Building: Results of an Experimental Study , 2011, J. Educ. Technol. Soc..

[19]  Ulrike Cress,et al.  Wiki-supported learning and knowledge building: effects of incongruity between knowledge and information , 2009, J. Comput. Assist. Learn..

[20]  Stefanie N. Lindstaedt,et al.  Knowledge Maturing Services: Supporting Knowledge Maturing in Organisational Environments , 2009, KSEM.

[21]  Wanlei Zhou,et al.  Employing Wikis for Online Collaboration in the E-Learning Environment: Case Study , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[22]  Nuria Oliver,et al.  SWISH: semantic analysis of window titles and switching history , 2006, IUI '06.

[23]  U. Cress,et al.  The interplay between individual and collective knowledge: technologies for organisational learning and knowledge building , 2010 .

[24]  J. Piaget The Development of Thought: Equilibration of Cognitive Structures , 1977 .

[25]  Man Lung Yiu,et al.  Group-by skyline query processing in relational engines , 2009, CIKM.

[26]  Steven Johnson,et al.  Emergence: The Connected Lives of Ants, Brains, Cities, and Software , 2001 .

[27]  Thomas G. Dietterich,et al.  Detecting and correcting user activity switches: algorithms and interfaces , 2009, IUI.

[28]  Silvan Reinhold WikiTrails: augmenting Wiki structure for collaborative, interdisciplinary learning , 2006, WikiSym '06.

[29]  Andreas S. Rath,et al.  Context-Aware Knowledge Services , 2008 .

[30]  U. Cress,et al.  The social psychology of knowledge management , 2008 .

[31]  Guglielmo Trentin,et al.  Using a wiki to evaluate individual contribution to a collaborative learning project , 2009, J. Comput. Assist. Learn..

[32]  J. Hayes,et al.  Writing Research and the Writer. , 1986 .

[33]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[34]  Mark Kramer,et al.  Wiki trust metrics based on phrasal analysis , 2008, Int. Sym. Wikis.

[35]  Thomas G. Dietterich,et al.  TaskTracer: a desktop environment to support multi-tasking knowledge workers , 2005, IUI.

[36]  Susan T. Dumais,et al.  The latent semantic analysis theory of knowledge , 1997 .

[37]  David Garlan,et al.  Context is key , 2005, CACM.

[38]  Luo Si,et al.  A statistical model for scientific readability , 2001, CIKM '01.

[39]  Claudia Linnhoff-Popien,et al.  A Context Modeling Survey , 2004 .

[40]  Andreas S. Rath,et al.  UICO: an ontology-based user interaction context model for automatic task detection on the computer desktop , 2009, CIAO '09.

[41]  Joachim Kimmerle,et al.  Using wikis for organizational learning: functional and psycho‐social principles , 2009 .

[42]  M. Scardamalia,et al.  Knowledge Building: Theory, Pedagogy, and Technology , 2006 .

[43]  Ulrike Cress,et al.  VISUALIZING CO-EVOLUTION OF INDIVIDUAL AND COLLECTIVE KNOWLEDGE , 2010 .

[44]  Simone Braun,et al.  Wikis as a Technology Fostering Knowledge Maturing: What We Can Learn from Wikipedia , 2008 .

[45]  Thomas Wöhner,et al.  Assessing the quality of Wikipedia articles with lifecycle based metrics , 2009, Int. Sym. Wikis.

[46]  Andreas P. Schmidt,et al.  Knowledge Maturing and the Continuity of Context as a Unifying Concept for Knowledge Management and E-Learning , 2005 .

[47]  L. S. Vygotksy Mind in society: the development of higher psychological processes , 1978 .

[48]  Linda C. Smith,et al.  INFORMATION QUALITY IN A COMMUNITY-BASED ENCYCLOPEDIA , 2005 .

[49]  Matthias Baldauf,et al.  A survey on context-aware systems , 2007, Int. J. Ad Hoc Ubiquitous Comput..

[50]  R. Flesch A new readability yardstick. , 1948, The Journal of applied psychology.

[51]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[52]  M. Appel,et al.  Topics in Cognitive Development , 1977 .