Evaluation of Social Media Collaboration Using Task-Detection Methods

Collaboration using social media is a good way of jointly constructing knowledge. This study aims at better understanding collaborative knowledge construction processes by applying innovative (micro-)task detection approaches. We take a closer look at the interactions of a user with a shared digital artifact by analyzing the captured interaction data. The goal is to identify domain-independent interaction patterns, which can serve as indicators for knowledge development (operationalized as accommodation). We designed an empirical study under laboratory conditions that used our method. The applied task detection approach identified accommodation with a rate of 77.63% without resorting to textual features. This result instantiates an improvement as compared to a previous study in which the text in focus was identified as the feature with best discriminative power. We discuss our hypothesis that our method is independent from the used knowledge domain.

[1]  Thomas G. Dietterich,et al.  Detecting and correcting user activity switches: algorithms and interfaces , 2009, IUI.

[2]  Silvan Reinhold.  WikiTrails: augmenting Wiki structure for collaborative, interdisciplinary learning , 2006, WikiSym '06.

[3]  N. Luhmann,et al.  System as Difference , 2006 .

[4]  Claudia Linnhoff-Popien,et al.  A Context Modeling Survey , 2004 .

[5]  U. Cress,et al.  The interplay between individual and collective knowledge: technologies for organisational learning and knowledge building , 2010 .

[6]  Clemens H. Cap,et al.  Paving the Path to Automatic User Task Identification , 2008, CSKGOI.

[7]  David Garlan,et al.  Context is key , 2005, CACM.

[8]  Steven Johnson,et al.  Emergence: The Connected Lives of Ants, Brains, Cities, and Software , 2001 .

[9]  Andreas S. Rath,et al.  UICO: an ontology-based user interaction context model for automatic task detection on the computer desktop , 2009, CIAO '09.

[10]  Andreas S. Rath,et al.  Context-Aware Knowledge Services , 2008 .

[11]  Joachim Kimmerle,et al.  Using wikis for organizational learning: functional and psycho‐social principles , 2009 .

[12]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[13]  Linda C. Smith,et al.  INFORMATION QUALITY IN A COMMUNITY-BASED ENCYCLOPEDIA , 2005 .

[14]  Andreas S. Rath,et al.  Automatic detection of accommodation steps as an indicator of knowledge maturing , 2011, Interact. Comput..

[15]  Ian Witten,et al.  Data Mining , 2000 .

[16]  Simone Braun,et al.  Wikis as a Technology Fostering Knowledge Maturing: What We Can Learn from Wikipedia , 2008 .

[17]  Jean Piaget,et al.  Problems of Equilibration , 1977 .

[18]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[19]  Thomas Wöhner,et al.  Assessing the quality of Wikipedia articles with lifecycle based metrics , 2009, Int. Sym. Wikis.

[20]  Ee-Peng Lim,et al.  Measuring article quality in wikipedia: models and evaluation , 2007, CIKM '07.

[21]  Les Gasser,et al.  Assessing Information Quality of a Community-Based Encyclopedia , 2005, ICIQ.

[22]  Ulrike Cress,et al.  Using Wikis for Learning and Knowledge Building: Results of an Experimental Study , 2011, J. Educ. Technol. Soc..

[23]  Andreas S. Rath,et al.  Detecting Real User Tasks by Training on Laboratory Contextual Attention Metadata , 2009, GI Jahrestagung.

[24]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[25]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[26]  Wanlei Zhou,et al.  Security in the online e-learning environment , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[27]  Ulrike Cress,et al.  VISUALIZING CO-EVOLUTION OF INDIVIDUAL AND COLLECTIVE KNOWLEDGE , 2010 .

[28]  J. Piaget.  The Development of Thought: Equilibration of Cognitive Structures , 1977 .

[29]  Ulrike Cress,et al.  Wiki-supported learning and knowledge building: effects of incongruity between knowledge and information , 2009, J. Comput. Assist. Learn..

[30]  M. Appel,et al.  Topics in Cognitive Development , 1977 .

[31]  F. Geyer,et al.  Sociocybernetic paradoxes : observation, control and evolution of self-steering systems , 1988 .

[32]  Ulrike Cress,et al.  A systemic and cognitive view on collaborative knowledge building with wikis , 2008, Int. J. Comput. Support. Collab. Learn..

[33]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[34]  Gijsbert Erkens,et al.  Coordination processes in computer supported collaborative writing , 2005, Comput. Hum. Behav..

[35]  Jean Lave,et al.  Situating learning in communities of practice , 1991, Perspectives on socially shared cognition.

[36]  R. Flesch.  A new readability yardstick. , 1948, The Journal of applied psychology.

[37]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[38]  Matthias Baldauf,et al.  A survey on context-aware systems , 2007, Int. J. Ad Hoc Ubiquitous Comput..

[39]  Catherine E. Snow,et al.  Rethinking reading comprehension , 2003 .

[40]  Thomas G. Dietterich,et al.  A hybrid learning system for recognizing user tasks from desktop activities and email messages , 2006, IUI '06.

[41]  Wanlei Zhou,et al.  Employing Wikis for Online Collaboration in the E-Learning Environment: Case Study , 2005, Third International Conference on Information Technology and Applications (ICITA'05).