Our Probiotics Testing Methodology
Probiotics, in their simplest form, are living microorganisms, typically bacteria and yeasts, that are considered beneficial for our health. When introduced into our bodies in adequate amounts, they are believed to offer a range of advantages, from aiding in digestion to bolstering the immune system and even promoting mental wellness. Probiotics are essentially the helpful companions we invite into our inner ecosystem to keep things running smoothly.
Walk into a health food store, browse online, or even just scan the shelves of your local grocery store, and you'll encounter a wide variety of probiotic products—but not all of them are viable or potent. As the popularity of probiotic products grows, it becomes increasingly important to develop robust and reliable testing methodologies to ensure their quality, safety, and efficacy. In this methodology, we aim to break down the different probiotic strains, assess their quality and teach you the science behind how we chose our favorite probiotic supplements.
How We Score Probiotics
There are a lot of high quality probiotic supplements on the market, so to determine which ones stand above the rest, we developed a custom Sports Illustrated Showcase multivitamin testing methodology and scoring algorithm.
Our testing methodology for probiotics branches off of our broader nutrition product and supplement methodology. Each probiotic we review is put through our probiotic scoring methodology, which grades the product on seven primary categories: supplement form, inclusion of live and active bacterial cultures, cultures contained, whether or not the proprietary blends are included, the number of colony forming units (CFUs), the inclusion of a food source (prebiotics) and third-party certifications. We assign each product a score of 1 out of 5 for each of the categories we test in, and these scores are then weighted based on importance and averaged to produce a cumulative score out of 5 for each product, with 1 being the lowest rating and 5 being highest.
Criteria We Evaluate
Form
Probiotic supplements come in various forms, and each form has its advantages and considerations. The choice of which one is "better" depends on individual preferences, needs and factors such as convenience and lifestyle.
- Capsule: Capsules are easy to take and don't require any preparation.
- Tablet: Tablets are similar to capsules in terms of convenience. According to our Nutrition expert, Chris Mohr, “The encapsulation of probiotics is well-studied by many researchers using various methods with different encapsulating materials.”
- Powder: Powders can be mixed into various foods and beverages, making them suitable for people who prefer not to take pills. These earned the same marks as capsules and tablets.
- Enteric coated: Enteric coating is a protective layer applied to certain probiotic supplements. Studies have shown that enteric coating helps the probiotics survive the acidity of the gut better than their non enteric counterparts. These also earned high marks.
- Gummy or chewable: Gummy and chewable probiotics typically contain lower CFU counts compared to other forms like capsules or powders. This can mean you're getting fewer live bacteria per serving, which may not be sufficient to provide the desired health benefits. These types earned the lowest marks.
Live and active bacterial cultures
Probiotics are valued for their ability to introduce live and beneficial microorganisms into the gut. For probiotics to be effective, these microorganisms must be alive and active when consumed. Therefore, probiotics should include this statement on their label to confirm that the probiotic product contains viable microorganisms. Products that did so earned the highest marks.
Cultures contained
The effectiveness of a probiotic product depends on the strains it contains, as different probiotic strains offer various health benefits. For example, some strains are known for their ability to support digestive health, while others may help with immune function or address specific health conditions such as irritable bowel syndrome (IBS). It's important to select probiotic strains that align with your health goals and needs. We’ve identified the specific probiotic strains, including their Genus and Species that have been extensively studied in clinical trials, demonstrating their effectiveness for specific health conditions.
Genus species:
- Lactobacillus rhamnosus
- Lactobacillus rhamnosus
- Lactobacillus rhamnosus
- Lactobacillus acidophilus
- Lactobacillus acidophilus
- Lactobacillus plantarum
- Lactobacillus plantarum
- Lactobacillus plantarum
- Lactobacillus plantarum
- Lactobacillus paracasei
- Lactobacillus paracasei
- Lactobacillus casei
- Lactobacillus casei
- Lactobacillus salivarius
- Lactobacillus fermentum
- Bacillus Subtilis
- Bacillus Coagulans
- Bifidobacterium lactis
- Bifidobacterium lactis
- Bifidobacterium bifidum
- Bifidobacterium bifidum
- Bifidobacterium breve
- Bifidobacterium animalis
- Bifidobacterium longum
- Saccharomyces boulardii
- Streptococcus thermophilus
Proprietary culture blend
To make an informed choice when selecting probiotic supplements we recommend looking for products that provide clear information about the specific strains of probiotics contained in the formulation. Proprietary blends often do not disclose the specific strains and their respective concentrations used in the product. Without knowing the specific strains and their concentrations, consumers cannot make informed decisions about the probiotic supplement. Different probiotic strains have different health benefits, and the effectiveness of a product depends on the specific strains used and their viability.
Therefore, a product that included a proprietary culture blend received no marks, whereas a product that listed out each strain earned higher marks.
Colony Forming Units (CFUs) at end of shelf life date
In the context of probiotics, CFUs represent the number of live microorganisms, typically bacteria, present in a probiotic supplement at the end of its shelf life. This value is an indicator of the product's potency and its ability to deliver a sufficient quantity of live, beneficial microorganisms to exert their intended health effects in the body. In most cases, more strains are better. There are approximately 38 trillion microbes as part of our microbiome; that said, even 20+ billion is a mere drop in the bucket. As a result, in most cases, it is best to have at least 20 billion or more strains.
Encapsulated with food source (i.e inulin)
Encapsulating probiotics with a food source can help protect the beneficial bacteria from harsh stomach acids and bile, increasing their chances of survival as they pass through the digestive system and reaching the intestines where they are needed. The encapsulation with a food source can provide a protective barrier, which may extend the shelf life of the probiotic supplement. Therefore, products that were not encapsulated with a food source earned no marks.
Certifications
The Food & Drug Administration (FDA) regulates dietary supplements and ingredients, but does not test supplements before they’re released to the market (as with drugs), so it’s important to look for products that have certifications for purity and potency from third-party testing labs. These testing certifications show whether a dietary supplement contains what the brand says it contains in the doses advertised (potency). It also tests for harmful toxins (i.e. mold, heavy metals, etc.), and some check for banned substances (purity).
Nearly all reputable supplement companies test their products in-house for safety and label accuracy, but many brands also make the decision to have their products tested by a third party for even further quality and safety assurance.
Smaller, newer supplement companies often can’t afford testing or certifications from high-profile third-party testing labs—regardless of the purity or potency of their products—which is why third-party testing is weighted lower than other categories in our algorithm.
The third-party certifications we look for include:
- NSF: NSF is an independent testing organization founded in 1944.
- U.S. Pharmacopeia (USP): USP is an independent, non-profit, scientific organization that tests medicines and supplements, founded over 200 years ago.
- Labdoor: Labdoor is an independent vitamin and supplement testing lab.
- Informed Choice (ICFS): Informed Choice is a global certification program that offers badges to indicate products have been certified for focus areas (Informed Choice, Informed Sport, Informed Protein, Informed Ingredient and Informed Manufacturer).
- Informed Sport: Informed Sport is the most recognizable Informed Choice badge. This certification is critical for athletes who might get drug tested for their sport.
- Informed Ingredient: Another Informed Choice badge is Informed Ingredient, which indicates that a product has undergone raw material testing and is free of banned substances.
Summary
There are countless probiotic supplements available, and our job at Sports Illustrated Showcase is to determine which products stand above the rest in terms of quality, potency, effectiveness and value. Our probiotic testing methodology involves scoring products across six categories chosen in partnership with nutrition experts. The final weighted score supports our decision to either include or exclude individual products in our “best of” roundups.