Achieving High Reliability with small sample sizes – Is it really possible??

Do you often wonder why you can pass Reliability qualification tests with set sample sizes, but still cannot achieve the Reliability levels customers demand??

If you consider AQL tables where sample sizes for achieving nominated Quality levels are set around Accept and Reject defect numbers, the Quality levels such as 0.65% or 6500 ppm are simply NOT acceptable in today’s commercial and consumer market. Often automotive customers will set failure targets in range of 50 ppm, hence sampling to try and achieve this level is simply NOT possible un less quite ‘ENORMOUS’ sample sizes are taken !!

Using the simple binomial distribution based on Probability of detecting 0 or at least 1 defect from a sample of units to achieve a given Quality target, we can easily calculate the required sample sizes;

If Quality target is say 500 ppm and say 100 pcs are tested;

Probability (detecting 0 defects) = 95.12%

Probability (detecting at least1 defect) = 4.88%  

As target defect levels reduce, then of course the probability of detecting any defects reduces considerably

Take for example some JEDEC tests where standard sample sizes may be only 77 pcs , hence if a customer wants as low as 10 ppm (often even lower !), probability of finding 0 defects is 99.92%, hence even if there is a ‘latent’ defect waiting to happen, the chance of finding this defect within a THB or HAST test, etc will be almost 0 !!

Hence it is HIGHLY LIKELY that a High Reliability batch of devices / products will perform similarly in low volume batch test to that of a much Poorer Reliability batch, so how can we discriminate between such batches, also a major problem when handling ‘Maverick’ Lots

Qualification tests therefore become ‘tick box’ type tests with limited value add to the producer and high risk to the customer

Obviously the modern approach simply has to change quite radically from tradition as we cannot escape from statistics and the very low likelihood of failures being detected.

To purely rely on sample testing and individual tests of different types is simply NOT going to cut-it in today’s electronics and electro mechanical industries.

Reliability Solutions have developed very different approaches to this challenge and are now providing the models and methods to apply across device and product ranges in its 2019 Training Agenda.

Recently the new agenda was given to a large class in Penang, Malaysia with excellent feedback, here is a snippet or two of what our attendees thought:

Company Job Title What do you like best about the course
Flextronics Director Provide an overall idea of how to set up reliability test requirement & quantitites way of ensuring the test is suitable & able to detect defects
Flextronics Senior QE Instructor is very experience and able to give a better insight of reliability
Flextronics QE n/a
Flextronics Engineering Instructor able to emphasize the theory to actual scenario in the manufacturing
Flextronics Design Engineer Case study from real-life examples
Flextronics Process Engineer The in-depth study on product reliability, eliminate assumptions and quantifying reliability
Flextronics System Design & Development Engineer Structural training material and training was condusted in relaxing approach
WD Reliability n/a
Laird Technologies R&D Engineer Case studies
WD QA The experience of the instructor. Able to deliver the knowledge in simple way
Laird Technologies R&D Engineer Case study real life
WD Product Quality Case study and good work
WD QA example os case study
Laird Technologies Engineer Q&A Concept of reliability
Laird Technologies R&D Engineer workshop
WD Reliability Engineer Instructor is able to relate actual casesin today industry to REL assessment
WD Reliability Engineer the simple presentation and easy to understand
WD QA Execellent.


If the new 2019 training agenda may interest you or your company email us on

Or find us on

Managing Process Quality to Drive World Class Customer Performance – 26-27 Oct

Hello Folks, We recently ran a very well received training programme on Quality Control in Shenzhen, China on Oct 26-27. The program is an entirely new education package to help companies drive World Class Quality in their manufacturing processes. In my role as Reliability consultant with many companies over the last 20 yrs, I have helped… Continue Reading

Managing Process Quality to drive World Class Customer Performance

You are normally seeing the marketing of our Reliability Training seminars held worldwide. Today we are announcing an entirely new education package to help companies drive World Class Quality in their manufacturing processes. Martin Shaw of Reliability Solutions has worked with multiple companies over the last 20 yrs as consultant and implemented many different methods… Continue Reading

Now In Partnership With Tangent Engineering

At Reliability Solutions, we are pleased to announce our new partnership with TANGENT Engineering. Tangent Design Engineering is a Calgary, Alberta based product design development and engineering services team. Tangent has a diverse multidisciplinary team of mechanical engineers, electrical engineers, simulation engineers, industrial designers, and firmware engineers. Tangent Design Engineering has been in business for… Continue Reading

Asia Seminars Summer 2017

It has been an incredible summer for Reliability Solutions, most recently with 3 memorable events in Asia, which kicked off with Shenzhen China on the 24,25 July. On July 27-28 we were in Johor Bahru Malaysia and we rounded things off at the end of July/beginning of August with our Flexetronics seminar back in China. As always,… Continue Reading

What our attendees think of Penang Seminar…

To enable me to continually improve the service that I provide, I’m always looking to get feedback from clients and seminar attendees which I use to enhance the training and solutions that I provide. Recently, we had a well attended Seminar in Penang entitled Managing & Improving Reliability Within Electronics Product Design and the feedback… Continue Reading

Holistic Reliability – The Modern Day Solution

Holistic ‘is a belief that the parts of something are intimately interconnected and explicable only by reference to the whole’ The meaning of the term ‘Holistic’ is very appropriate in today’s complex Electronic and Electro Mechanical products as we cannot assume a one off Accelerated Life Test, a small sample HALT test or a suite of… Continue Reading

Why do so many companies make a mess of New Product Introduction and wonder why Warranty Fail Rates are HIGH?

With complex electronics part of almost all new consumer products, especially those with wireless capability, it is becoming more difficult to ensure New Product Introduction runs smoothly and produces a High Reliability product. Most companies struggle to meet new product first shipment deadlines and focus attention on a production pilot run to weed out defects… Continue Reading

Why Reliability Prediction in Today’s World is too Complex to Only Rely on Standards for Test and Evaluation

Understanding what Reliability really is has become very important for manufacturers and designers. Too often, products go to manufacturing when the Reliability Team has missed something rather major. Reliability Prediction may be complex and it’s necessary for more than just evaluation and testing. The reliability engineers must know more about the product than anybody else,… Continue Reading