​​​​Design of Experiments to Speed-up New Product Development-2

Innovation and R&D 

Design of Experiments to Speed-up New Product Development-2

Article 10

Here is a relatively simple tool that can be used on most product development problems by R&D scientists and engineers.

If you have a limited budget or resources this one tool that can give you the biggest bang for the buck.

But be careful, your scientists and engineers will become very good in using this tool, and their market value will go up significantly too!

Are you a Practicing R&D Scientist or an Engineer? Do you work in R&D, Manufacturing or Engineering?

Do you wish that there was a proven scientific method and a tool for solving technical problems in (a) product development and (b) process improvement that can be applied again and again, on different types of problems, in different industries, and with high success rate? The tool is called Design of Experiments, DOE for short. Using DOE scientists can predict product and process performance quantitatively in one minute or less. More importantly, it permits efficient knowledge transfer from product/process R&D to Manufacturing and from Application R&D to Customers.

Why Use Design of Experiments in R&D for Product/Process Development/Improvement?

Using Statistical Methods in the design of experiments and data analysis, you, an R&D scientist, can readily attain benefits like these:

  • A 20 to 70% reduction in problem-solving time
  • A 50% reduction in R&D costs related to testing, machine time, labor, and materials, and,
  • A 200 to 300% increase in the value, quality, and reliability of the information generated.

If you can achieve these types of results on your research projects you will be a hero in your R&D manager’s eyes. And that is a significant achievement.

Why use Design of Experiments for Manufacturing?

Being a hero in R&D may not be enough. You also need to and want to develop high credibility with your peers in Manufacturing. For that you need to package your know-how with know-why to make their jobs in manufacturing easier.

Here is what they need:

  •  What is an optimum formulation?
  •  How does the optimum change if changes are made to the recipe or process variables?
  • Which variable(s) is the machine or process sensitive to?
  • For consistent performance, what are the tolerances for these variables?
  • How does one design an effective troubleshooting guide for this product/process?
  • A 20 to 70% reduction in problem-solving time?
  • A 50% reduction in R&D costs related to testing, machine time, labor, and materials, and,
  • A 200 to 300% increase in the value, quality, and reliability of the information generated.

On any industrial research project, you need answers to all these questions to turn the know-how over to manufacturing in production mode. Where people with less expertise, can produce the same high quality product again and again, easily.

If you can do that, you are liked by R&D, and you are loved by Manufacturing. And, oh yes, you will also get lots of accolades from Senior Executives.

Two DOE Examples from Industry:

Let me illustrate the power of DOE with two examples I worked on.

  • A Fridel-Craft alkylation project involving mono, di and tri alkylated amines with several byproducts. With 9 experiments in a three liter laboratory reactor,  involving Reaction Ratio, Temperature and Catalyst Concentration, we helped Manufacturing improve productivity from 550 lbs/hour to 770 lbs/hour.
  • Scaled up an Oxy-Vent-Recycle Process from an 8-inch laboratory reactor to 18-foot diameter, over 70 feet tall, fluid-bed reactor.  We increased raw material efficiency from 94% to 98% with final optimization at plant scale using 20 well designed DOE and confirmatory experiments.

Here are some questions for R&D scientists:

Are you constantly struggling to answer these questions on your key projects?

  • Which experiments do I run?
  • How do I analyze data?
  • What are the key relationships?
  • What is the optimum?
  • Will quality be consistent from batch to batch?

Is your R&D Manager constantly putting pressure on you to:

  • Reduce time to market by 20 to 50%?
  • Develop custom products quickly?
  • Develop better products faster?
  • Improve R&D productivity?
  • Retain and rapidly reuse knowledge?
  • Ease technology transfer?
  • A 20 to 70% reduction in problem-solving time?

Two more questions:

  • Would you like to learn the basics of a real scientific method that works?
  • Would you like to know how to convert the real scientific method into a simple, effective, systematic formula that quickly helps you discover what works and what doesn’t

Learn statistical science of the Design of Experiments and you can answer these questions quickly and efficiently most of the time.

Sometimes you will quickly find out that the goal is not achievable with the problem as stated, and new breakthrough thinking is needed.

Good news is that you will find that out very quickly and cost effectively using DOE, and you will have saved resources that you can use for breakthrough thinking.

 Design of Experiments (DOE) has been used extensively by DuPont, Dow, BF Goodrich, (where I worked for 15 years), and others for over 40 years.

In early Sixties, Genichi Taguchi introduced a version of DOE, known as Taguchi methods in Japan. They were introduced to the USA in the early Eighties. One key reason for the success of Toyota, Sony, Honda, and Cannon in the world market is the extensive use of these types of statistical methods in both product and process development.

In 1969, while at Graduate School in USA studying Chemical Engineering, two small events occurred that heavily influenced me.  

  1. I read an article by Dorian Shainin, in a Harvard Business Review Paperback book.
  2.  A few months later, I heard about an interesting seminar announcement: “Applied Statistics for Industrial Product Development.” A visiting faculty member was going to talk about a statistical and mathematical approach to product development and optimization. I was intrigued. I attended the seminar and it changed my focus, my career and professional life. The visiting faculty member introduced us to the use of Design of Experiments, empirical modeling, and how to use this approach to reduce laboratory experimental effort by 50% and more. My first reaction was, “Wow, I can apply these methods to most of my chemical technology related problems.” Well, I enrolled and picked up another graduate degree, in applied statistics with a thesis in the D-Optimal Design of Experiments.

Now I have, over 40 years of industrial experience in the use of Design of Experiments (DOE) to solve tough industrial problems, assisted scientists and engineers in applying DOE on more than 750 industrial projects, and trained nearly a thousand scientists, engineers and executives in DOE.   Through these efforts I have developed a simplified framework to learn and use DOE. Just remember the acronym “D.E.P.L.O.Y.  DOE.”

If you use these techniques on five problems within one year, you will easily double your success rate!

D E P L O Y DOE Framework

1. Define problem clearly.

A good problem definition has 5- 8 inputs (X’s), as many outputs(Y’s); identifies minimum, maximum, process/safety constraints and success criteria.

2. Establish experimental reproducibility.

Run 4 or more replicates at center of the experimental region. (see 1) Compute Standard deviations.

3. Plan experiments.

Select and run a DOE design (see 2) or generate an optimal design.

4. build Linear models.

Use Least Squares to estimate parameters bi in equation, Y = b0 +b1X1 + b2X2 +b3X3 + … + b12*X1X2 + … and Test for curvature.

5. Optimize.

Use spreadsheet or other software.

6. plaY what if...

Play what if… Identify interesting use cases, compute inputs/outputs.

Build Quadratic models if needed.

If curvature is indicated, augment designs using edge/face center points (see 3), build quadratic models. Validate.

So, let us get started.

Here is mantra for real success in new product development:  “Fail fast, fail frequently, fail frugally, but fruitfully.”

Type the mantra in big bold letters, like a banner. Hang it on your wall. This is contrary to what you may have heard, but it is the real truth. Edison experimented with the light bulb filament materials over 400 times and failed. His answer, "I know what does not work."

Why do you want to “Fail fast, fail frequently, fail frugally, but fruitfully?”

The answer is simple. Technological problem solving is very difficult; it takes lot of time and effort, more than you realize.

The brute force Edisonian approach won’t work.

You have to be smart.

Design of Experiments, DOE for short, is the smart scientific way to learn.

Still not convinced? Let me explain, with a real example.

Here is a simple industrial problem. We would like to develop an optimum recipe for a cheesecake.

Let's brainstorm and make a list of the recipe and process variables that may be important for baking a cheesecake. Here is a good list to start.

Develop an Optimum Cheesecake Product

Inputs are:

  1. Eggs to Cream cheese Ratio
  2. Sugar to Cream cheese Ratio
  3. Flavoring to Cream cheese Ratio
  4. Mixing Time
  5. Mixing Speed
  6. Ambient Temperature
  7. Baking Time
  8. Baking Temperature

Outputs are:

  1. % Moisture
  2. Particle Size
  3. Color
  4. Height of the cake
  5. Weight
  6. Cost

We have identified eight recipe and process variables. A pastry chef with considerable expertise in baking cakes probably will add a few variables to our list. But, let us assume for now that this list is adequate. Let us assume a scientist wants to consider each input variable at three levels.

Here are a couple of questions:

  1. What is the probability of finding the optimum if you run 100 experiments ad hoc? ____
  2. How many experiments do we need to run to find the optimum recipe? _____

Using DOE we can find an optimum recipe in 20 to 40 experiments, about a month’s work, and answer all the questions that Manufacturing may ask!

So crank up your Product Development engines... Let us speedup new product development and growth rates. And let the fun begin!


Would you like to learn more and become an expert without having to worry about ugly underlying math/stat

Learn the DEPLOY DOE framework in seven easy lessons. Signup here.

Direct Your Visitors to a Clear Action at the Bottom of the Page