Archive for July, 2010
The Summer 2010 issue of American Educator (a publication of the American Federation of Teachers) ably illustrates one of the lessons we teach in Conquering Innovation Fatigue: metrics to drive performance can have unintended consequences that may actually hurt rather than help. Indeed, unintended consequences are a major theme of our book, as we explore the problems arising from metrics, corporate and government policies, corporate innovation initiatives, laws, taxation policies, and other factors, all of which can contribute to innovation fatigue.
In terms of education and the danger of improper metrics, Linda Perlstein’s article, “Unintended Consequences; High Stakes Can Result in Low Standards,” examines a highly celebrated school in Annapolis, Maryland that received media attention and praise for seemingly miraculous success in education. The new principal arrived in 2000 to find Tyler Heights Elementary School in a dismal state with only 17% of its students getting satisfactory scores on the state test. She began redirecting efforts in the school to address this problem. Eventually her laser-focus efforts paid off, delivering the stunning success of 90% of third-graders performing well on the Maryland State Assessment, when only 35% of third-graders did so two years before. Several newspapers recognized the amazing turn-around and people at the school celebrated the success. But was it real success?
To achieve good performance on the Maryland State Assessment, education for the children was largely focused on how to do well on the test. Students learned how to write BCR’s (“Brief Constructed Response”) to deal with expected questions about poems and plays, and practiced writing these short answers for many hours, without actually studying poems or plays. “What gets tested is what gets taught,” the principal told the teachers, even if that meant leaving behind the material that was supposed to be taught according to state standards. Bins of equipment for studying science were largely unused.
Tyler Heights’ third-graders got only the most cursory introduction to economics and Native Americans, and much of the curriculum was skipped altogether. The students were geographically ignorant. . . . The third-graders had heard Africa mentioned a lot but were not sure if it was a city, country, or state. (They never suggested “continent.”) At the end of the year, the children in Johnson’s class were asked to name all the states they could. Cyrus knew the most: three. He couldn’t name any countries, though, and when asked about cities, he thrust his finger in the air triumphantly. “Howard County!”
The state standards required a broad curriculum, but the metrics for assessing that were based on one particular test and all the incentives were for helping students pass that test. In spite of the praise for the miracle at Tyler Heights, had the children really been helped?
The problem with unintended consequences from metrics such as tests is hardly unique to Tyler Heights. Daniel Koretz, also writing in the same issue of American Educator (see page 3 of the PDF file on unintended consequences), explains that in education and other fields, score inflation is a common and well known but widely overlooked problem. In the social sciences, a phenomenon that leads to score inflation is known as Campbell’s Law. While widely applied to education, it was developed while looking at business. Donald Campbell, a prominent social scientist, examined the role of corporate incentives on the performance of employees. His research led to this general formulation: “The more any quantitative social indicator is used for social decision making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.” (Donald T. Campbell, “Assessing the Impact of Planned Social Change,” in Social Research and Public Policies: The Dartmouth/OECD Conference, ed. Gene M. Lyons, Hanover, NH: Public Affairs Center, Dartmouth College, 1975, p. 35. See also Can New York Clean Up the Testing Mess? by Sol Stern.)
Campbell’s Law is at work when schools game tests to get better scores, at the expense of education. It is at work when cardiologists choose not to operate on patients who might need surgery rather than risk hurting their own published statistics on mortality rates among their patients (Koretz refers to a 2005 story from the New York Times reporting the shocking results of a survey of cardiologists). It is at work when a company tries to boost innovation with metrics or incentives that result in game playing, while leaving the real problems from culture, systems, and vision unaddressed.
In our experience, metrics and incentives can play a valuable role in driving innovation, but only when the corporation has a culture that genuinely encourages innovation, when there is a shared vision of innovation and success, and when sound systems are in place to advance innovation. Without those, you can not only waste a lot of resources in attempting to drive innovation with metrics and incentives, you can actually make a weak culture become pathological and lethal, sometimes exacerbating fatigue factors like the Not Invented Here syndrome, theft of credit for innovation, and breaking the will to share. Adding incentives linked to metrics without the right culture and systems can be sort of like throwing raw meat into a school of sharks or piranhas. You can generate a lot of activity, a lot of exciting thrashing and splashing, but in the end there will just be a lot of blood in the water and fewer thinkers and producers in your school.
As always, innovation success requires that you carefully monitor for harmful unintended consequences from the policies, programs, and incentives you have in place. Innovation metrics, incentives of all kinds, and employee performance evaluation systems and other tools associated with metrics can backfire. Unless you are tuned to the voice of the innovator and understand the impact of unintended consequences, you can be like the company we treat in Chapter 8 of our book that felt like it was a rock star of innovation while they were actually squelching it. Don’t let the unintended consequences of well-intended policies and metrics crush your innovation success.
The recently published Berkeley Patent Survey is one of the most comprehensive studies to date on the use of patents by startups and entrepreneurs. PatentlyO discusses the study and offers some helpful insights. The study shows that startups are using patents more than was previously recognized, for past analysis based was limited by incomplete USPTO data on patent assignments. Search results for patents owned by a particular startup may miss the patents owned by founders and others that are being used by the startup but may not yet be listed in the USPTO database as being assigned to the company. By interviewing entrepreneurs, the authors were able to determine that:
[A]bout 40% of our respondents hold patents or applications, with the figure rising to about 80% for startups funded by venture capital firms.
As expected, this figure varies widely by industry—for example, 97% of venture-backed biotechnology companies hold patents or applications, while only 67% of venture-backed software startups do. And among the general population of software startups responding, the rate was only about 25%.
–From Robert Merges and Pamela Samuelson, UC Berkeley School of Law and Ted Sichelman, University of San Diego School of Law, in “Patenting by Entrepreneurs: The Berkeley Patent Survey (Part I of III),” PatentlyO.com, July 19, 2010.
In our experience, many of the best startups take IP seriously and seek to file patents when they have something potentially patentable. In our experience, Venture Capitalists look for patents as a way to increase the chances of meaningful returns. Patents are an important part of the recipe for success and long-term profits for a startup. Don’t neglect them!
Ethanol as a biofuel may soon reach practical limits in the US and frankly is clouded with questions about its economic and environmental utility. However, the fermentation systems for producing ethanol can be adapted to produce much more valuable products using special microbes developed at some of the most promising green energy and biotech companies. The result is enticing, as we read in “Brazil: The Bossa Nova of Biofuels” from Biofuels Digest:
Another wave of next-generation renewable drop-in fuel companies, Amyris, LS9, Gevo and Dupont, are also investing in and partnering with Brazil’s sugarcane fermentation bioreﬁneries. Why? Because their emerging technologies from cellulosic microbes (yeast, algae, fungus and bacteria) can use the same ethanol fermentation facilities in the US corn belt and in Brazil’s sugarcane belt to produce bio-crude, green diesel, petrol and biojet.
The simplicity is astounding. Here’s the big idea. Take an existing, stranded ethanol factory or conglomerate. Buy it for a substantial discount. Start with cheap sugar. Drop in a new Amyris, LS9, Gevo, or Cobalt microbe/ bug in the same fermentation vat and what do you get? An integrated biorefinery that can use cheap, sustainable sugars to produce renewable diesel, aviation fuel, and biobutanol – fuels that are compatible with existing petroleum pipelines, storage, petrol stations, and vehicle engines today.
In the near future, these fermentation-based bioreﬁneries will be able to convert multiple inputs from cellulosic sugars–bagasse, switchgrass, wood chips, municipal solid waste, and glycerin–into a diverse set Of outputs, including renewable diesel, aviation fuel, bio-crude oil, biochemicals and biopolymers with significant GHG reductions and carbon emissions compared to petrochemical hydrocarbons.
This is an important lesson in innovation. Don’t live with current assumptions. Look at existing technologies, processes, and products as simply a stepping stone to something more valuable, and then ask what is next. If I have raw materials and processing stations that can use microbes to convert sugars into a biofuel, why be satisfied with the least valuable biofuel around? Why not look at the higher-value products that similar technology could produce? That’s the genius behind some of these rising bioproducts companies.
Speaking about bioproducts, let me encourage any chemical engineers out there to join me at the AIChE Annual Meeting, where the Division that I chair, the Forest Bioproducts Division, is hosting numerous sessions dealing with the exciting developments in biorefineries and value-added products from cellulosic biomass. That’s where some of the best potential is: energy and chemical products from something besides the food that people need to eat.