In terms of education and the danger of improper metrics, Linda Perlstein’s article, “Unintended Consequences; High Stakes Can Result in Low Standards,” examines a highly celebrated school in Annapolis, Maryland that received media attention and praise for seemingly miraculous success in education. The new principal arrived in 2000 to find Tyler Heights Elementary School in a dismal state with only 17% of its students getting satisfactory scores on the state test. She began redirecting efforts in the school to address this problem. Eventually her laser-focus efforts paid off, delivering the stunning success of 90% of third-graders performing well on the Maryland State Assessment, when only 35% of third-graders did so two years before. Several newspapers recognized the amazing turn-around and people at the school celebrated the success. But was it real success?

To achieve good performance on the Maryland State Assessment, education for the children was largely focused on how to do well on the test. Students learned how to write BCR’s (“Brief Constructed Response”) to deal with expected questions about poems and plays, and practiced writing these short answers for many hours, without actually studying poems or plays. “What gets tested is what gets taught,” the principal told the teachers, even if that meant leaving behind the material that was supposed to be taught according to state standards. Bins of equipment for studying science were largely unused.

Tyler Heights’ third-graders got only the most cursory introduction to economics and Native Americans, and much of the curriculum was skipped altogether. The students were geographically ignorant. . . . The third-graders had heard Africa mentioned a lot but were not sure if it was a city, country, or state. (They never suggested “continent.”) At the end of the year, the children in Johnson’s class were asked to name all the states they could. Cyrus knew the most: three. He couldn’t name any countries, though, and when asked about cities, he thrust his finger in the air triumphantly. “Howard County!”

The state standards required a broad curriculum, but the metrics for assessing that were based on one particular test and all the incentives were for helping students pass that test. In spite of the praise for the miracle at Tyler Heights, had the children really been helped?

Campbell’s Law

The problem with unintended consequences from metrics such as tests is hardly unique to Tyler Heights. Daniel Koretz, also writing in the same issue of American Educator (see page 3 of the PDF file on unintended consequences), explains that in education and other fields, score inflation is a common and well known but widely overlooked problem. In the social sciences, a phenomenon that leads to score inflation is known as Campbell’s Law. While widely applied to education, it was developed while looking at business. Donald Campbell, a prominent social scientist, examined the role of corporate incentives on the performance of employees. His research led to this general formulation: “The more any quantitative social indicator is used for social decision making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.” (Donald T. Campbell, “Assessing the Impact of Planned Social Change,” in Social Research and Public Policies: The Dartmouth/OECD Conference, ed. Gene M. Lyons, Hanover, NH: Public Affairs Center, Dartmouth College, 1975, p. 35. See also Can New York Clean Up the Testing Mess? by Sol Stern.)

Campbell’s Law is at work when schools game tests to get better scores, at the expense of education. It is at work when cardiologists choose not to operate on patients who might need surgery rather than risk hurting their own published statistics on mortality rates among their patients (Koretz refers to a 2005 story from the New York Times reporting the shocking results of a survey of cardiologists). It is at work when a company tries to boost innovation with metrics or incentives that result in game playing, while leaving the real problems from culture, systems, and vision unaddressed.

In our experience, metrics and incentives can play a valuable role in driving innovation, but only when the corporation has a culture that genuinely encourages innovation, when there is a shared vision of innovation and success, and when sound systems are in place to advance innovation. Without those, you can not only waste a lot of resources in attempting to drive innovation with metrics and incentives, you can actually make a weak culture become pathological and lethal, sometimes exacerbating fatigue factors like the Not Invented Here syndrome, theft of credit for innovation, and breaking the will to share. Adding incentives linked to metrics without the right culture and systems can be sort of like throwing raw meat into a school of sharks or piranhas. You can generate a lot of activity, a lot of exciting thrashing and splashing, but in the end there will just be a lot of blood in the water and fewer thinkers and producers in your school.

As always, innovation success requires that you carefully monitor for harmful unintended consequences from the policies, programs, and incentives you have in place. Innovation metrics, incentives of all kinds, and employee performance evaluation systems and other tools associated with metrics can backfire. Unless you are tuned to the voice of the innovator and understand the impact of unintended consequences, you can be like the company we treat in Chapter 8 of our book that felt like it was a rock star of innovation while they were actually squelching it. Don’t let the unintended consequences of well-intended policies and metrics crush your innovation success.

However, as with all metrics, the details of how IPM is calculated come into play and may bring unintended consequences. For IPM, the clock doesn’t tick when a lane is closed or, more specifically, when the cashier’s terminal is in “secure” mode. Shut down the terminal to the “terminal secure” state and the clock stops, something that some cashiers use to their advantage while checking out a customer. A new manager at one store is pushing for IPM scores of at least 30 for all cashiers, but as one cashier explained, the only way that you can achieve that high of a score is to routinely go to “terminal secure.” If the cashier has to help with the bagging or do other tasks that reduce IPM, they can secure the terminal and then reactivate it before they continue scanning goods. That gives a higher IPM score, but the back and forth of securing and reactivating the terminals actually SLOWS DOWN the real work because it involves extra steps that eat up valuable time. By focusing on IPM as a proxy for productivity, productivity can actually decline.

A further consequence of securing a terminal is that the customer may need to swipe his or her credit card a second time. The card readers in each checkout lane allow customers to swipe their credit card during the scanning of goods, but when the cashier switches to terminal secure mode, the swiped credit card information is discarded and the customer will have the annoyance of having to swipe a second time. By focusing on IPM as a proxy for customer satisfaction, the annoyances to the customer and the time to check out actually increase.

Unintended consequences of metrics can easily follow similar patterns when it comes to innovation, intellectual assets, and new product development. Leaders need to step back and observe the impact of their metrics on those in the ranks and on the actual performance of the company. A carefully selected basket of metrics with frequent reality checks are needed to avoid hindering real productivity and innovation with your good intentions.

Innovation is often more about execution and planning than idea generation. A weak idea, implemented ITERATIVELY with the right talent, can be adjusted based on feedback from the system (e.g., the market) and become successful. Even mediocre ideas can beat good ideas if there are great skills, good leaders, and good execution. But add an occasional great idea to the mix and the success can be remarkable, if the dream isn’t cluttered with lots of distracting good ideas along the way.

Innovation requires discipline. One has to focus and learn iteratively in the process, and not let unrestrained good ideas shut down your innovation engines with “idea cancer.”

Special thanks to Adriano Amaral, Secretary of State for the State Department of Economic Development in Brasília for meeting with me and sharing his insights and experiences. Like many of the leaders in Brasília, Adriano is not a career politician, but an experienced business leader who has led successful startups, stepped in to bring struggling businesses to life, advised large and small companies, and taught some of the best MBA students in the world. The success of the Federal District of Brasília demands further attention, and will be covered in our next book. We continue to look for further experts to interview as we explore the many stories and lessons from this region and from Brazil in general. Let us know if you have experiences and expertise to share! Email me at jlindsay at innovationedge.com, or use the contact page on this blog.

The Pixetell below is set to 640 x 480 pixels). To see the full-sized presentation in higher resolution, click on the full-screen icon in the lower right-hand corner, or to view this in a new window, use this Pixetell link. Pixetell, by the way, is an incredibly easy and extremely innovative tool for sharing information from your computer.

Related resources include the Brazilian Studies Association, AboutBrasilia.com, and CETEB.

One of the great tragedies of human decision making is the pernicious inability to consider far-reaching implications of an action. To avoid harmful unintended consequences of a decision, there are two possible solutions: 1) get assistance from experts providing guidance from many difference perspectives and do the best to consider new areas and issues that were previously overlooked, and 2) follow proven principles and strategies that increase the odds of success in spite of the impossibility of calculating everything. Both of these principles can be and probably should be used.

Innovation, for all the voices hyping it, is one of the least considered factors when policy makers start shaking things up. Whether it’s a new law, a tax policy, a regulation, or corporate policies, decision makers easily overlook innovation–real innovation, not just money spent in the name of innovation–because they tend to overlook the individuals who are the source of innovation. Real innovation begins in the minds of individuals with a vision and must be nurtured to succeed. The voice of innovators, including the voice of entrepreneurs, inventors, university professors post-docs, corporate R&D staff, etc., is rarely heard. The voices of CEOs or other top leaders from big companies may be heard. The voices of direct reports to a CEO may be heard. The voices of celebrities and activists may be heard, but who actually seeks out and listens to the real innovators or prospective innovators in our economy? Who considers what impact a law or policy will have on those individuals and their incentives to innovate or their ability to succeed? They are among the voices that should be carefully considered when making policies to avoid unintended consequences that might crush innovation and economic growth.

There are several general principles that should also be considered by policy makers. Innovation at the personal level, which is one of the themes of Conquering Innovation Fatigue, requires personal liberty. It requires a system in which individuals and companies are motivated to take on the high risks of innovation because there are incentives to succeed. These incentives for many require a form of government in which intellectual property rights are respected as well as property rights in general. When property can be seized capriciously, or when the fruits of one’s innovative labors can be taken on a whim or taxed to death, why bother innovating?

Every law, every policy, every act of government should be constrained by general principles, such as those espoused in the US Constitution, and done with care to avoid harming the economy with unintended consequences that trample on the delicate flower of innovation.

The Wall Street Journal from Dec. 4 offers two columns with examples of innovation fatigue factors that can be introduced by well-intended actions. The first article I wish to mention is “Near-Zero Rates are Hurting the Economy,” an opinion column from David Malpass, president of Encima Global, LLC. He argues that the artificially low interest rates created by the Federal Reserve Bank in the name of rescuing the US economy have actually been driving capital overseas and starving small companies–the leading sources of most innovation, economic growth and job creation, as studies from the Kaufmann Foundation and others have shown. Here is an excerpt:

[M]ore than a year after the heart of the panic, the Fed is still promising near-zero interest rates for an extended period and buying over $3 billion per day of expensive mortgage securities as part of a $1.25 trillion purchase plan. Capital is being rationed not on price but on availability and connections. The government gets the most, foreigners second, Wall Street and big companies third, with not much left over.

The irony of the zero-rate policy, coupled with Washington’s preference for a weak dollar, is a glut of American capital in Asia (as corporations and investors shun the weakening U.S. currency) and a shortage at home. For gold and oil, the low-rate policy works, weakening the dollar so commodity prices go up and providing traders with ample funds to buy into the expanding bubble. Those markets are almost daring the Fed to try to break out of its zero-rate box.

But for small businesses and new workers, capital rationing is devastating, spelling business failures and painful layoffs. Thousands of start-ups won’t launch due to credit shortages, in part because the government and corporations took more credit than they needed (because it was so cheap).

Already countries with higher interest rates, Australia for one, are viewed as less risky because they have room to cut rates if there’s another emergency. This wins them capital and jobs that might otherwise be ours.

According to International Monetary Fund data, U.S. GDP has fallen to 24% of world GDP from 32% in 2001. And as U.S. capital escapes the weak dollar and high tax rates, the U.S. share of world equity market capitalization has fallen to 30% from 45%. This leaves the U.S. alone with Japan at the bottom of the monetary heap, with rate expectations so low they repel investment.

When single individuals or organizations make policies that affect millions, it is far too easy for good intentions to translate into new problems, unless the decision maker is essentially omniscience. Failing ominiscience, perhaps market forces should be given a try, allowing the invisible hand mediated by the mechanism of price to determine the right allocation of resources. But even with a reluctance to use market forces to set interest rates and allocate capital, wiser decisions could be made by policy makers if they understood the personal side of innovation and the barriers faced by the innovators seeking to propel our economy forward. Unfortunately, the real innovation engines of the future aren’t likely to be powerful, highly connected people today, but may be a lone entrepreneur or president of a small company today that could grow and create many thousands of jobs, if only given a chance. Giving credit and bailouts to well-connected dinosaurs can be based on good intentions, but it may be a misallocation of resources that only makes things worse for the most important prospective innovators and job creators out there.

A second article in the Dec. 4 Journal is “Sarbanes-Oxley on Trial” (p. A24), an op-ed piece that briefly mentions the economic burdens this 2002 law has imposed, and urges government to modify its implementation to be more accountable. There is much more that could be said, some of which we discuss in our book. Sarbanex-Oxley is especially burdensome on small, innovative companies and has driven many innovators to look outside the United States in launching a start-up. Intended to make businesses safer and more accontable, it has slowed job creation and economic growth, in the eyes of some experts. Unintended consequences. It’s something every policy maker and business leader needs to be worried about. Are you listening to the voice of the innovators who have to live with your decisions? That could be the difference between success and innovation fatigue.

Is Your Company on the Cutting Edge of Innovation? Your IP Review Board May Be.

Death panels have been a hot topic for speculation from some folks worried about health care reform, but in the world of innovation, genuine death panels have long been in place in corporations. Innovation death panels, disguised as intellectual property review committees or IP review boards, have been sending great inventions and great business concepts to an early death for decades. Further, the ways these panels operate can kill innovation at a broader level by discouraging inventors, keeping them out of the loop, and ensuring that whatever is left of their drive is unlikely to bear fruit.

Rationing has to be a reality when it comes to IP because only a small fraction of potentially valuable concepts justify the expense of filing a patent. But failure to pursue a patent need not be an innovation killing event. It can, in fact, be a valuable opportunity. When operated properly, the IP review board can provide a tremendous opportunity to educate, motivate, guide, and inspire corporate inventors, even when the current invention they have brought forward is not right for patenting.

One key is treating the inventors with respect and giving them a chance to be heard, as well as a chance to hear and learn from the review board. Many inventions are not properly understood before a decision is made, and inventors facing that can become cynical. Many inventors in corporations also don’t fully grasp how decisions are made and what the review board is looking for. Use the review process as a way to help the inventor understand the process and the criteria for decision making. ideally, you have a written strategy statement that provides guidelines and specifies where innovation is needed, helping the inventors know what to invent. You can also use the review board experience to recognize the contributions of inventors, treat them with respect, and help them feel motivated and connected, even if their first few tries don’t go anywhere.

The culture engendered by your IP review board or committee can be a matter of life or death for innovation in your company. Don’t let it become a death panel. Watch the process through the eyes of the inventors–listen to the voice of the innovator–and make sure you have a healthy and wholesome system that strengthens innovation, not  decapitates it.

In Conquering Innovation Fatigue, we discuss the importance of understanding innovation from the perspective of innovators, and make recommendations for managing and motivating prospective innovators in the corporation, including suggestions for running IP review boards and guidelines on building trust, aligning innovation efforts with corporate needs, and creating cultures of innovation. Sections on corporate innovation are written for both employees seeking to develop innovations and for leaders seeking to encourage it. You must understand and conquer or work around the many innovation fatigue factors that impede innovation in so many corporations.

Singapore is an example of what can be achieved in a nation with a bold vision of economic progress and long-term growth. One consistently gets the impression that officials there, whether university leaders, team leaders, or high-ranking politicians, have a strong desire to advance the welfare of the nation and its people by giving people the resources and opportunities to work hard and succeed through innovation and entrepreneurial activity. There is a culture of cooperation and vision that seems to permeate the activities of leaders and influencers far more than you might see in other parts of the world. The nation is not without its problems, and no individual is without human flaws, but what I saw impressed and surprised me.

The nation decided years ago that it wanted to be a place for world-class research and development. They boldly recruited leading talent and ramped up education for its own citizens. They crafted beautiful complexes for interdisciplinary research to pursue targeted areas. This resulted in a large science park, and then the One North complex with Biopolis, a collection of large buildings for R&D in the life sciences, and Fusionopolis, a massive edifice intended to bring together numerous disciplines in other areas. They invested huge amounts of money to support R&D. While other companies and nations are cutting back, they are increasing their R&D spending from what was about 2.5% of the GDP recently to 3% in 2010. Many billions of dollars are being committed to achieve their vision.

One cannot explore Singapore without realizing that its leaders are serious about making Singapore an attractive place for business, for research, and for innovation. They understand the importance of location and co-location. They have worked hard to make Singapore a center for business for many multinational corporations. Currently over 7,000 MNCs have a presence in Singapore. They have worked to bring many disciplines together for targeted purposes by co-locating disciplines in research at One North, which is also near to the National University of Singapore, the Ministry of Education, and other key facilities, not to mention integrating industrial centers such as the Lilly Center for Drug Discovery on the Biopolis campus. Bringing people and institutions together physically creates opportunities for synergy and cross-fertilization that can’t be matched by remote online interactions.

The synergy between business and state-funded R&D is further strengthened by sending researchers into industry for internships or limited engagements to provide firsthand experience into the realities of a start-up or other business.

The planning behind A*STAR has resulted in many fruits. There have been nearly 30 spin-off companies from these recent efforts. A patent estate of over 3,000 applications and patents exists (this number from A*STAR apparently includes filings in multiple nations, so the number of patent families is considerably less, but still healthy). Significant growth in licensing revenues is coming through the efforts of Exploit Technologies, the licensing and commercialization arm of A*STAR. International recognition is being earned for the accomplishments of A*STAR.

How a small nation of four million people has transformed itself into a powerhouse of R&D and excellence in science and business shows what can be done with strong leadership and a commitment to the future. Of course, you can’t overlook one of their secret weapons that help attract and retain so much great talent: some of the best food in the world. Check out the food courts at Biopolis and across this island nation. This is a land that understands the importance of great food. After all, isn’t food ultimately the fuel behind human innovation?

Here is a gallery with a few photos I took while in Singapore. Click on a thumbnail to see more of the respective photo. The first photo shows the famous mascot of Singapore, the mythical Merlion. The building in the 2nd and 3rd photos is Fusionopolis, showing two different views (north and south sides). Then there are some downtown shots and a Buddha in Chinatown.

Harvest Efficiency: Sudden Huge Gains!

Harvest Costs Show Dramatic Drop!

But what is the cause of the gains? If management is remote and not in tune with what is happening on the ground, they might rely on the metrics or key performance indicators to conclude that the business is healthier than ever and issue huge bonuses to the geniuses who transformed the apple business. In reality, the short-term gains might have come at a surprisingly high cost, namely, the future of the business, as shown below.

Real Reason for the Short-Term Gains Revealed

Innovators in your company are the source of your future crops. Cutting innovation staff will always look attractive for the short-term, but can your future afford it?

Make sure you are using wise metrics in making decisions about innovation, research, and new product development. It’s a topic we address in Conquering Innovation Fatigue, and one of the important reasons why you and your team need to be familiar with this book.

I never lost faith in the end of the story, I never doubted not only that I would get out, but also that I would prevail in the end and turn the experience into the defining event of my life, which, in retrospect, I would not trade.

Then he asked Stockdale about the other POWs who didn’t survive. What made the difference? Who were they?

Oh, that’s easy, the optimists. Oh, they were the ones who said, “We’re going to be out by Christmas.” And Christmas would come, and Christmas would go. Then they’d say, “We’re going to be out by Easter.” And Easter would come, and Easter would go. And then Thanksgiving, and then it would be Christmas again. And they died of a broken heart.

This is a very important lesson. You must never confuse faith that you will prevail in the end—which you can never afford to lose—with the discipline to confront the most brutal facts of your current reality, whatever they might be.

The need to confront brutal facts applies to all of us, and especially to those involved in innovation and business development. Foolish optimism leads businesses to neglect competitive threats, to ignore key information from early market studies that challenges expectations, or to make terrible mistakes with intellectual assets.

One small company with a terrific innovation recently told me not to worry about their intellectual property, for they were sure it was rock solid and didn’t need any further attention. I said, “OK, but every time I’ve heard that kind of talk in the past, it was a sure indicator of trouble.” Turns out their intellectual property estate was in shambles, and when I gently pointed out the gaps, they ended up asking me to prepare a new application, which we were able to do quickly just days before it would have been too late. Near disaster!

Innovation is always a high-risk activity. Those who do not recognize the risks and think everything is secure and sure to succeed are inevitable disappointed and often poorly prepared for the real risks they face. Those who practice “healthy paranoia” and recognize that there are risks and unknowns at every stage are much more likely to pay attention to those threats and mitigate them.

Mere paranoia and fear of the unknown is unhealthy, as it causes people to abandon the dream unnecessarily. The gloom-and-doom anti-innovation crowd lacks the faith that inspired Stockdale with the vision that he would prevail in the end. Successful innovation requires that faith, for it drives people to keep trying, to learn from their mistakes and learn from the market to iterate and find new approaches to succeed. A combination of faith in the end but a willingness to face and respond to the many brutal facts of reality – a “healthy paranoia” rather than blinding optimism – is what it takes to succeed.

The brutal facts of reality include inevitable failure in initial efforts. This is what separates the innovators from the rest. You are going to fail: the patent will receive a rejection, the initial launch may be a disaster, the partnership may go sour, the funding source may fall through, or the focus group will turn up their nose at your product. Success will go to those who learn from that, and iterate to improve and come back again. “Iterate to innovate.”

Keep the end vision intact while applying healthy paranoia to face and overcome the many innovation fatigue factors that will stand in your way.