The search for a research method for studying OSS process innovation

Medium-sized, open-participation Open Source Software (OSS) projects do not usually perform explicit software process improvement on any routine basis. It would be useful to understand how to get such a project to accept a process improvement proposal and hence to perform process innovation. We want to determine an effective and feasible qualitative research method for studying the above question. We present (narratively) a case study of how we worked towards and eventually found such a research method. The case involves four attempts at collecting suitable data about innovation episodes (direct participation (twice), polling developers for episodes, manually finding episodes in mailing list archives) and the adaptation of the Grounded Theory data analysis methodology. Direct participation allows gathering rather rich data, but does not allow for observing a sufficiently large number of innovation episodes. Polling developers for episodes did not prove to be useful. Using mailing list archives to find data to be analyzed is both feasible and effective. We also describe how the data thus found can be analyzed based on the Grounded Theory Method with suitable adjustments. By-and-large, our findings ought to apply to studying various phenomena in OSS development processes that are similarly heavyweight and infrequent. However, specific details may block this possibility and we cannot predict which details that might be. The amount of effort involved in direct participation approaches to qualitative research can easily be underestimated. Also, survey approaches are not well-suited for many process issues in OSS, because too few developers are sufficiently process-conscious. An approach based on passive observation is a viable alternative in the OSS context due to the availability of large amounts of fairly complete archival data.

[1]  P. David.  Clio and the Economics of QWERTY , 1985 .

[2]  Arnold Windeler,et al.  Unternehmungsnetzwerke : Konstitution und Strukturation , 2001 .

[3]  Linus Torvalds,et al.  Just for Fun: The Story of an Accidental Revolutionary , 2001 .

[4]  Robert M. Davison,et al.  Principles of canonical action research , 2004, Inf. Syst. J..

[5]  Brian Fitzgerald,et al.  Taking stock of the bazaar: the third workshop on open source software engineering , 2003, SOEN.

[6]  J. Gosby.  MEDIA REVIEWS: Basics of Qualitative Research - Techniques and Procedures for Developing Grounded Theory 2nd Edition by A. Strauss and J. Corbin. Sage Publications, , 2000 .

[7]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[8]  G. Hedlund.  The hypermodern MNC—A heterarchy? , 1986 .

[9]  Lawrence Lessig,et al.  Code and Other Laws of Cyberspace , 1999 .

[10]  James A. Whittaker,et al.  What is software testing? And why is it so hard? , 2000 .

[11]  Lutz Prechelt,et al.  Information management as an explicit role in OSS projects , 2008 .

[12]  K. Charmaz,et al.  Constructing Grounded Theory: A practical guide through qualitative analysis Kathy Charmaz Constructing Grounded Theory: A practical guide through qualitative analysis Sage 224 £19.99 0761973532 0761973532 [Formula: see text]. , 2006, Nurse researcher.

[13]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[14]  E. Rogers.  Diffusion of Innovations , 1962 .

[15]  Christopher Oezbek,et al.  Introducing Automated Regression Testing in Open Source Projects , 2010, ArXiv.

[16]  A. Langley.  Strategies for Theorizing from Process Data , 1999 .

[17]  Lutz Prechelt,et al.  What Happens During Pair Programming , 2008, PPIG.

[18]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[19]  Charles S. Peirce,et al.  A theory of probable inference. , 1883 .

[20]  Alistair Cockburn,et al.  Agile Software Development , 2001 .

[21]  Françoise Détienne,et al.  A socio-cognitive analysis of online design discussions in an Open Source Software community , 2008, Interact. Comput..

[22]  Karim R. huff,et al.  Nonprofit Foundations and Their Role in Community-Firm Software Collaboration , 2007 .

[23]  T. Muhr.  ATLAS/ti — A prototype for the support of text interpretation , 1991 .

[24]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[25]  Alistair Cockburn,et al.  Agile Software Development: The Business of Innovation , 2001, Computer.

[26]  Siobhan O’Mahony.  Guarding the commons: how community managed software projects protect their work , 2003 .

[27]  Christopher Oezbek,et al.  Introducing innovations into open source projects , 2010 .

[28]  Christopher Oezbek,et al.  Introducing Automated Unit Testing into Open Source Projects , 2010, OSS.

[29]  Cmmi Product Team.  CMMI for Development, Version 1.2 , 2010 .

[30]  Tom A. B. Snijders,et al.  Social Network Analysis , 2011, International Encyclopedia of Statistical Science.

[31]  Eric S. Raymond,et al.  Homesteading the Noosphere , 1998, First Monday.

[32]  C. Mckenzie.  The mind map book. , 2008, Nursing management.

[33]  Martin F. Krafft.  A Delphi study of the influences on innovation adoption and process evolution in a large open source project: the case of Debian , 2010 .

[34]  D. Jorgensen.  Participant Observation: A Methodology for Human Studies , 1989 .

[35]  P. Farrand,et al.  The efficacy of the `mind map' study technique , 2002, Medical education.

[36]  K. Hambridge.  Action research. , 2000, Professional nurse.

[37]  Peter J. Denning,et al.  Innovation as language action , 2006, CACM.

[38]  R. Suddaby.  From the Editors: What Grounded Theory is Not , 2006 .

[39]  Kevin Crowston,et al.  Decision Making Paths in Self-Organizing Technology-Mediated Distributed Teams , 2008, ICIS.

[40]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[41]  Stefan Dietze.  Modell und Optimierungsansatz für Open-source-Softwareentwicklungsprozesse , 2004 .

[42]  N. Luhmann.  Soziale Systeme : Grundriß einer allgemeinen Theorie , 1984 .

[43]  Joel West,et al.  The Role of Participation Architecture in Growing Sponsored Open Source Communities , 2008 .

[44]  Karim R. Lakhani,et al.  Perspectives on Free and Open Source Software , 2005 .

[45]  Tony Cornford,et al.  Version management tools: CVS to BK in the Linux kernel , 2003 .

[46]  Alberto J. Cañas,et al.  A TEORIA SUBJACENTE AOS MAPAS CONCEITUAIS E COMO ELABORÁ-LOS E USÁ-LOS * THE THEORY UNDERLYING CONCEPT MAPS AND HOW TO CONSTRUCT AND USE THEM , 2010 .

[47]  Christian Siefkes,et al.  An incrementally trainable statistical approach to information extraction based on token classification and rich context models , 2008 .

[48]  L. Prechelt,et al.  On Understanding How to Introduce an Innovation to an Open Source Project , 2007, First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007).

[49]  C A Nelson,et al.  Learning to Learn , 2017, Encyclopedia of Machine Learning and Data Mining.

[50]  Philipp Mayring.  Einführung in die qualitative Sozialforschung , 2006 .

[51]  D. North.  Competing Technologies , Increasing Returns , and Lock-In by Historical Events , 1994 .

[52]  A. Kellerman,et al.  The Constitution of Society : Outline of the Theory of Structuration , 2015 .

[53]  J. Novak.  The Theory Underlying Concept Maps and How To Construct Them , 2004 .

[54]  Joel West,et al.  Contrasting Community Building in Sponsored and Community Founded Open Source Projects , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[55]  John Law,et al.  Notes on the theory of the actor-network: Ordering, strategy, and heterogeneity , 1992 .

[56]  Mary Lynn Manns,et al.  Fearless Change: Patterns for Introducing New Ideas , 2004 .

[57]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[58]  Grigori Melnik,et al.  Guest Editors' Introduction: TDD--The Art of Fearless Programming , 2007, IEEE Software.

[59]  Magnus Bergquist,et al.  The power of gifts: organizing social relationships in open source communities , 2001, Inf. Syst. J..

[60]  Anita Sarma,et al.  Tesseract: Interactive visual exploration of socio-technical relationships in software development , 2009, 2009 IEEE 31st International Conference on Software Engineering.

[61]  Yutaka Yamauchi,et al.  Collaboration with Lean Media: how open-source software succeeds , 2000, CSCW '00.

[62]  Michael X Cohen,et al.  A Garbage Can Model of Organizational Choice. , 1972 .