Volltext-Downloads (blau) und Frontdoor-Views (grau)

Raising the odds of success : the current state of experimentation in product development

  • Context: An experiment-driven approach to software product and service development is gaining increasing attention as a way to channel limited resources to the efficient creation of customer value. In this approach, software capabilities are developed incrementally and validated in continuous experiments with stakeholders such as customers and users. The experiments provide factual feedback for guiding subsequent development. Objective: This paper explores the state of the practice of experimentation in the software industry. It also identifies the key challenges and success factors that practitioners associate with the approach. Method: A qualitative survey based on semi-structured interviews and thematic coding analysis was conducted. Ten Finnish software development companies, represented by thirteen interviewees, participated in the study. Results: The study found that although the principles of continuous experimentation resonated with industry practitioners, the state of the practice is not yet mature. In particular, experimentation is rarely systematic and continuous. Key challenges relate to changing the organizational culture, accelerating the development cycle speed, and finding the right measures for customer value and product success. Success factors include a supportive organizational culture, deep customer and domain knowledge, and the availability of the relevant skills and tools to conduct experiments. Conclusions: It is concluded that the major issues in moving towards continuous experimentation are on an organizational level; most significant technical challenges have been solved. An evolutionary approach is proposed as a way to transition towards experiment-driven development.

Download full text files

  • 1184.pdf

Export metadata

Additional Services

Search Google Scholar


Author of HS ReutlingenMünch, Jürgen
Erschienen in:Information & software technology
Place of publication:Amsterdam
Document Type:Journal article
Publication year:2016
Tag:continuous experimentation; experiment-driven software development; hypothesis-driven software development; lean UX; lean startup; product management
Page Number:12
First Page:80
Last Page:91
DDC classes:330 Wirtschaft
Open access?:Nein
Licence (German):License Logo  In Copyright - Urheberrechtlich geschützt