Estublier et al (2005) suggested that Software Configuration Management research should be measured by (1) publications, and (2) incorporation into actual SCM products. I can agree with the latter more than the former. Sciences have values when they are meaningful to our society. Publications, while implied that progressive ideas were being built on one another (Shaw, 2002), does not guarantee societal meaningfulness. At the same time, publications were reviewed by those who publishes. This internal validation is problematic, as Shaw (2002) pointed out that “large fraction (43%) of computer science design and modeling papers lacked any experimental evaluation.”

The value of science is dependent on its meaning to the society; broad truths about scientific relevance are tied to this meaning. Meaningfulness, on the other hand, is identified in the process of adoption and integration of the technology into social fabrics. Thus, scientific values are progressively integrated into the society. The process is socially involving, and members of the corporation and public play a role in its successes as well as adaptation (Tuomi, 2002; Kow and Nardi, 2009). In Estublier (2005), the word “adopt” was used 13 times, “make/found their way” 4 times, vastly simplified this process of adoption. Studies like Estublier (2005) assumed research to be research driven, and placed too much emphasis on the scientific community alone as generators of knowledge. The focus on publications likely misunderstood research relevance is a mystical jump between “birth” of an idea and it “adoption,” thus left the connection of the two – the idea of relevance, in vagueness. In order to understand technological impact and future values, we need to study the problem using a more social-involved approach.

========
References
Impact of software engineering research on the practice of software configuration management --- Estublier, et al

Tuomi, 2002. Networks of Innovation.

October 2009