Skip to main content

Capital One: benchmark in experimentation based management

Capital One is a diversified financial services company offering a broad array of credit, savings and loan products to customers in the United States, UK, and Canada. It ranks #115 on the S&P 500 and #4 in Diversified Financials (BusinessWeek, 2005). Its stock has outperformed the S&P index since 1999. Founded by Richard Fairbank in 1988 based on his belief that the power of information, technology, testing and great people could be combined to bring highly customized financial products directly to consumers, Capital One has emerged as one of the America's largest consumer franchises with almost 50 million customer accounts and one of the nation's most recognized brands.

In an interview for Fast Company Magazine Nigel Morris, Cap One’s president thus defined the reason behind their success: “Very few companies have the ability to test and learn.” Testing and learning form the foundation on which Capital One is built. The company tests every product offering, every procedural change, every job applicant. It keeps records on every customer interaction and on every card purchase. It runs experiment after experiment.

Capital One has conducted hundreds of thousands of experiments of new products, new advertising approaches, new markets, new business models. It tests to determine who reacts most favorably to slight adjustments in interest rates, maximum balances, or fees; who prefers to sign up via the Internet; and who responds to telephone solicitations. When it figures out how to sell to the small group of targeted test customers, it looks for similar customers throughout the United States. "We're creating a massive scientific lab where everything can be tested," Fairbank told U.S. Banker.

At Capital One, the essence of innovation is experimentation. Every idea for a new product starts with a test, or a series of tests. If a test succeeds, the company ramps up fast. But testing doesn’t apply only to products. For instance Capital One doesn’t conduct routine job interviews for hiring. Applicants take tests, sit through guided interviews, and do role-playing exercises. In many cases supervisors never even meet candidates; they meet only the people who get hired. That's because the HR function discovered through experimentation that interviews by line managers didn’t predict job performance at all. That discovery was made, of course, through follow-up testing — through comparing actual performance of employees with what their supervisors had predicted when they were first hired.

Popular posts from this blog

Super Crunchers: Why Thinking-by-Numbers Is the New Way to Be Smart

This book by Ian Ayres provides a very readable summary of what can be done to improve performance using the incredible volumes of data accumulated in business, government, health care, and education. The chapters about randomized testing are particularly interesting to experimentation based management. Randomized tests are also increasingly being used to evaluate various government programs, finding eg. that additional job location assistance more than paid for itself for those receiving unemployment benefits, guiding HeadStart programs to target those most likely to benefit. Capital One has been running randomized tests since at least 1995 - tests include page layout, and type and size of offers.

What is experimentation based management?

Experimentation-based-management (XBM) is a branch or variant of evidence-based-management (EBM). EBM is an emerging movement to explicitly use the current, best evidence in management decision-making. It was first presented by Jeffrey Pfeffer and Robert I. Sutton in a seminal Harvard Business Review article published in 2006 in which they invited managers to ground decisions in the latest and best knowledge of what actually works. Pfeffer and Sutton were inspired by evidence-based medicine, a movement that has taken the medical establishment by storm over the 90’s. EBM developed as a response to a set of emerging factors in health care: concerns about practice variation; the rapid growth of medical technology, leading to a proliferation of diagnostic and treatment options; the patient empowerment movement; and psychological research that raised questions about the quality of human judgment and decision making. Research uncovered that physicians did not use much of the research which w...