Large companies often find it difficult to innovate, but not for lack of trying. Most major corporations have regular means by which new product or product line ideas are vetted. Unfortunately, such processes are designed to select incremental improvements to existing products and services, rather than to introduce radically new offerings. One significant reason for this is that when senior management considers a new idea, they often look at the revenue stream, and compare it, implicitly, with revenue streams from existing (successful) products. Proposed products that are not immediately comparable in their revenue streams with existing product lines are often not approved.<\/p>\n
This is the trap of success. A company learns how to do something well, and then gets stuck in that rut. When the market changes, few companies are able to systematically get out of that rut and regain their past levels of success in new areas. IBM’s reliance on mainframe computing, Xerox’s on xerography patents, and Microsoft’s ignoring the Internet for a long time are examples of companies that actually managed to survive these painful transitions; many other companies did not.<\/p>\n
This analogy applies to research as well.<\/p>\n
<\/p>\n
In particular, I am thinking of a comment<\/a> made by Abdur Chowdhury about\u00a0 SIGIR 2010:<\/p>\n Interesting, no research on real-time search, the largest new form of search in the last decade. #sigir<\/p><\/blockquote>\n This prompted a discussion about relative rigor of evaluation and of other conferences, about the lack of test collections, etc.<\/p>\n My sense, however, is that the problem is deeper than that. The SIGIR community is trapped by a very successful paradigm. People can do complex work, the quality of that work can be measured, and progress made. (Of course sometimes progress isn’t cumulative<\/a>, but that’s a different tangent.)<\/p>\n The bigger problem is that a successful paradigm stifles innovation as much as a large revenue stream. The system works; why change it?<\/p>\n One reason for change is to adapt to changes in the real world to avoid losing touch with it unintentionally. The Hypertext community, for example, ignored the web (for a host of good reasons), and was nearly killed by it.<\/p>\n To be successful, corporations need to incubate new ideas to give them time to grow and mature before deciding whether they are truly useful. The opportunity costs of nurturing a few “startup” level ideas are much lower than the opportunity cost of not being able to react to the market in a timely manner.<\/p>\n The opportunity costs for an academic discipline can be significant as well. Communities such as SIGIR need to intentionally broaden their scope to avoid being trapped in a local maximum, no matter how successful it seems at the time. We need to balance innovation (with its attendant imperfections) with more methodologically-mature work.<\/p>\n While orthodoxy has its place, if left unchecked, it can limit the long-term viability of the endeavor. We need to establish processes to foster alternative approaches and alternative methodologies, to recognize promising (if uncertain) steps in interesting directions. We should intentionally try things we haven’t tried before, and not be afraid that the initial attempts are incomplete, seem inconsistent with respect to established practices, or are even plain wrong. The signal (in Chen and Konstan<\/a>‘s sense) we send to the community should make it clear that while we value rigor and sound methodology, we also value novelty and innovation in their less well-formed manifestations.<\/p>\n SIGIR should look to start-ups for inspiration about process, rather that to established corporations if it is concerned about its long-term relevance.<\/p>\n","protected":false},"excerpt":{"rendered":" Large companies often find it difficult to innovate, but not for lack of trying. Most major corporations have regular means by which new product or product line ideas are vetted. Unfortunately, such processes are designed to select incremental improvements to existing products and services, rather than to introduce radically new offerings. One significant reason for […]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[15],"tags":[220],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts\/4283"}],"collection":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4283"}],"version-history":[{"count":9,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts\/4283\/revisions"}],"predecessor-version":[{"id":4305,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts\/4283\/revisions\/4305"}],"wp:attachment":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4283"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4283"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4283"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}