IR

M8

Error Analysis

Every (query, relevant document) pair from the real test qrels, classified by each model's real rank for that document. Concrete mechanisms behind the aggregate metrics.

52

BM25 wins / MedCPT loses

244

MedCPT wins / BM25 loses

76

Hybrid fixes a lexical (BM25) failure

17

Hybrid fixes a semantic (MedCPT) failure

926

Reranker improves the result

832

Reranker degrades the result

BM25 wins / MedCPT loses (52 found, showing 5)

PLAIN-2490

relevance = 1

“The Actual Benefit of Diet vs. Drugs”

Updating a 12-year experience with arrest and reversal therapy for coronary heart disease (an overdue requiem for palliative cardiology). (MED-2111)

Coronary artery disease is essentially nonexistent in cultures whose nutrition assures cholesterol levels <150 mg/dl. Patients with advanced coronary artery disease may abolish disease progression through a plant-based...

tfidf=—bm25=1bge=—medcpt=—hybrid_rrf=7hybrid_reranked=20

PLAIN-227

relevance = 1

“Increasing Muscle Strength with Fenugreek”

Pseudo-maple syrup urine disease due to maternal prenatal ingestion of fenugreek. (MED-4150)

Fenugreek, maple syrup and the urine of maple syrup urine disease (MSUD) patients all share a characteristic odour originating from a common component, sotolone. Ingestion of fenugreek by mothers during labour resulted...

tfidf=1bm25=2bge=29medcpt=—hybrid_rrf=12hybrid_reranked=3

PLAIN-2040

relevance = 1

“salmon”

Dietary lipids modulate methylmercury toxicity in Atlantic salmon. (MED-3024)

This experiment aimed to study the molecular toxicity of methylmercury (MeHg) in liver, brain and white muscle of Atlantic salmon fed a diet based on fish oil (FO, high dietary n-3/n-6 ratio) compared to an alternative...

tfidf=3bm25=2bge=2medcpt=—hybrid_rrf=8hybrid_reranked=6

PLAIN-531

relevance = 1

“alternative medicine”

Health food store recommendations for breast cancer patients. (MED-4374)

CONTEXT: Despite cancer patients' widespread and growing use of complementary and alternative medicine, minimal attention has been paid to the role of health food stores in the "supply side" of this phenomenon....

tfidf=11bm25=3bge=13medcpt=—hybrid_rrf=20hybrid_reranked=2

PLAIN-33

relevance = 2

“What’s Driving America’s Obesity Problem?”

Physical activity energy expenditure has not declined since the 1980s and matches energy expenditures of wild mammals. (MED-2715)

OBJECTIVE: Obesity results from protracted energy imbalance. Whether this comprises excessive energy intake, lowered physical activity or both, remains disputed. DESIGN: Physical activity energy expenditure, evaluated...

tfidf=2bm25=4bge=86medcpt=—hybrid_rrf=35hybrid_reranked=20

MedCPT wins / BM25 loses (244 found, showing 5)

PLAIN-12

relevance = 1

“Exploiting Autophagy to Live Longer”

Why human lifespan is rapidly increasing: solving "longevity riddle" with "revealed-slow-aging" hypothesis (MED-2514)

Healthy life span is rapidly increasing and human aging seems to be postponed. As recently exclaimed in Nature, these findings are so perplexing that they can be dubbed the 'longevity riddle'. To explain current...

tfidf=—bm25=—bge=5medcpt=1hybrid_rrf=10hybrid_reranked=3

PLAIN-33

relevance = 1

“What’s Driving America’s Obesity Problem?”

Prevalence of physical activity and obesity in US counties, 2001–2011: a road map for action (MED-2722)

Background Obesity and physical inactivity are associated with several chronic conditions, increased medical care costs, and premature death. Methods We used the Behavioral Risk Factor Surveillance System (BRFSS), a...

tfidf=—bm25=—bge=4medcpt=1hybrid_rrf=27hybrid_reranked=8

PLAIN-133

relevance = 2

“Starving Tumors of Their Blood Supply”

Tumor Angiogenesis as a Target for Dietary Cancer Prevention (MED-3550)

Between 2000 and 2050, the number of new cancer patients diagnosed annually is expected to double, with an accompanying increase in treatment costs of more than $80 billion over just the next decade. Efficacious...

tfidf=—bm25=—bge=9medcpt=1hybrid_rrf=16hybrid_reranked=5

PLAIN-291

relevance = 1

“Stool Size and Breast Cancer Risk”

Cytological abnormalities in nipple aspirates of breast fluid from women with severe constipation. (MED-4641)

The relation between epithelial dysplasia in nipple aspirates of breast fluid and frequency of bowel movements was studied in 1481 white women. There was a significant positive association with dysplasia (risk ratio...

tfidf=—bm25=—bge=5medcpt=1hybrid_rrf=28hybrid_reranked=6

PLAIN-344

relevance = 2

“Dioxins Stored in Our Own Fat May Increase Diabetes Risk”

Molecular Epidemiologic Evidence for Diabetogenic Effects of Dioxin Exposure in U.S. Air Force Veterans of the Vietnam War (MED-2394)

Background One of the outcomes positively associated with dioxin exposure in humans is type 2 diabetes. Objectives This study was conducted in order to find the molecular biological evidence for the diabetogenic action...

tfidf=—bm25=—bge=2medcpt=1hybrid_rrf=22hybrid_reranked=5

Hybrid fixes a lexical (BM25) failure (76 found, showing 5)

PLAIN-551

relevance = 1

“amnesia”

Amnesic shellfish poison. (MED-4381)

Amnesic shellfish poisoning (ASP) is caused by consumption of shellfish that have accumulated domoic acid, a neurotoxin produced by some strains of phytoplankton. The neurotoxic properties of domoic acid result in...

tfidf=—bm25=—bge=2medcpt=1hybrid_rrf=1hybrid_reranked=1

PLAIN-583

relevance = 1

“antinutrients”

The role of phytic acid in legumes: antinutrient or beneficial function? (MED-2988)

This review describes the present state of knowledge about phytic acid (phytate), which is often present in legume seeds. The antinutritional effects of phytic acid primarily relate to the strong chelating associated...

tfidf=—bm25=—bge=9medcpt=1hybrid_rrf=1hybrid_reranked=1

PLAIN-817

relevance = 1

“canker sores”

Humoral immunity to cow's milk proteins and gliadin within the etiology of recurrent aphthous ulcers? (MED-4841)

OBJECTIVES: The goal of this study was to determine the incidence of serum antibodies to gliadin and to cow's milk proteins (CMP) using ELISA test, within patients who have recurrent aphthous ulcers (RAU). SUBJECTS AND...

tfidf=—bm25=—bge=14medcpt=1hybrid_rrf=1hybrid_reranked=21

PLAIN-1214

relevance = 1

“Fosamax”

Bisphosphonate-associated osteonecrosis of the jaw: report of a task force of the American Society for Bone and Mineral Research. (MED-2990)

ONJ has been increasingly suspected to be a potential complication of bisphosphonate therapy in recent years. Thus, the ASBMR leadership appointed a multidisciplinary task force to address key questions related to case...

tfidf=—bm25=—bge=—medcpt=1hybrid_rrf=1hybrid_reranked=12

PLAIN-1867

relevance = 1

“pineapples”

Antioxidant and antiproliferative activities of common fruits. (MED-3744)

Consumption of fruits and vegetables has been associated with reduced risk of chronic diseases such as cardiovascular disease and cancer. Phytochemicals, especially phenolics, in fruits and vegetables are suggested to...

tfidf=—bm25=—bge=2medcpt=1hybrid_rrf=1hybrid_reranked=1

Hybrid fixes a semantic (MedCPT) failure (17 found, showing 5)

PLAIN-2490

relevance = 1

“The Actual Benefit of Diet vs. Drugs”

Updating a 12-year experience with arrest and reversal therapy for coronary heart disease (an overdue requiem for palliative cardiology). (MED-2111)

Coronary artery disease is essentially nonexistent in cultures whose nutrition assures cholesterol levels <150 mg/dl. Patients with advanced coronary artery disease may abolish disease progression through a plant-based...

tfidf=—bm25=1bge=—medcpt=—hybrid_rrf=7hybrid_reranked=20

PLAIN-2040

relevance = 1

“salmon”

Dietary lipids modulate methylmercury toxicity in Atlantic salmon. (MED-3024)

This experiment aimed to study the molecular toxicity of methylmercury (MeHg) in liver, brain and white muscle of Atlantic salmon fed a diet based on fish oil (FO, high dietary n-3/n-6 ratio) compared to an alternative...

tfidf=3bm25=2bge=2medcpt=—hybrid_rrf=8hybrid_reranked=6

PLAIN-1151

relevance = 1

“factory farming practices”

Consumer knowledge of foodborne microbial hazards and food-handling practices. (MED-2742)

A national telephone survey was conducted of 1,620 randomly selected U.S. residents who spoke English, were at least 18 years old, and resided in households with kitchen facilities. Respondents were interviewed about...

tfidf=6bm25=7bge=44medcpt=98hybrid_rrf=7hybrid_reranked=18

PLAIN-196

relevance = 1

“Should We Avoid Titanium Dioxide?”

Red meat and colon cancer: should we become vegetarians, or can we make meat safer? (MED-5326)

The effect of meat consumption on cancer risk is a controversial issue. However, recent meta-analyses show that high consumers of cured meats and red meat are at increased risk of colorectal cancer. This increase is...

tfidf=11bm25=10bge=—medcpt=88hybrid_rrf=10hybrid_reranked=10

PLAIN-2580

relevance = 1

“Academy of Nutrition and Dietetics Conflicts of Interest”

Conflicts of interest in approvals of additives to food determined to be generally recognized as safe: out of balance. (MED-2725)

IMPORTANCE: Food and Drug Administration (FDA) guidance allows food manufacturers to determine whether additives to food are "generally recognized as safe" (GRAS). Manufacturers are not required to notify the FDA of a...

tfidf=3bm25=15bge=2medcpt=85hybrid_rrf=8hybrid_reranked=5

Reranker improves the result (926 found, showing 5)

PLAIN-2850

relevance = 1

“More Antibiotics In White Meat or Dark Meat?”

Influence of water and food consumption on inadvertent antibiotics intake among general population. (MED-4167)

Antibiotic entry into the water environment has been of growing concern. However, few investigations have been performed to examine the potential for indirect human exposure to environmental antibiotic residues. We...

tfidf=31bm25=—bge=14medcpt=10hybrid_rrf=49hybrid_reranked=5

PLAIN-2102

relevance = 1

“smoking”

The aryl hydrocarbon receptor and its xenobiotic ligands: a fundamental trigger for cardiovascular diseases. (MED-3099)

This review reconsiders a major cause of cardiovascular diseases, tobacco smoking, as the activation of the Aryl hydrocarbon Receptor (AhR), also known as the dioxin receptor, by aryl hydrocarbons from the tar fraction...

tfidf=52bm25=47bge=36medcpt=84hybrid_rrf=48hybrid_reranked=6

PLAIN-2720

relevance = 1

“Keeping Your Hands Warm With Citrus”

Postprandial glycemic response to orange juice and nondiet cola: is there a difference? (MED-3469)

The purpose of this study was to compare the effects of unsweetened fruit juice and regular, decaffeinated soda on postprandial serum glucose levels in individuals with non-insulin-dependent diabetes mellitus (NIDDM)...

tfidf=—bm25=—bge=—medcpt=24hybrid_rrf=49hybrid_reranked=8

PLAIN-44

relevance = 1

“Who Should be Careful About Curcumin?”

Dietary turmeric potentially reduces the risk of cancer. (MED-2794)

Turmeric, a plant rhizome that is often dried, ground and used as a cooking spice, has also been used medicinally for several thousand years. Curcumin, the phytochemical that gives turmeric its golden color, is...

tfidf=33bm25=73bge=7medcpt=23hybrid_rrf=46hybrid_reranked=6

PLAIN-33

relevance = 2

“What’s Driving America’s Obesity Problem?”

Health and economic burden of the projected obesity trends in the USA and the UK. (MED-2723)

Rising prevalence of obesity is a worldwide health concern because excess weight gain within populations forecasts an increased burden from several diseases, most notably cardiovascular diseases, diabetes, and cancers....

tfidf=—bm25=—bge=3medcpt=10hybrid_rrf=45hybrid_reranked=6

Reranker degrades the result (832 found, showing 5)

PLAIN-2408

relevance = 1

“Zoloft”

Exercise and Pharmacotherapy in the Treatment of Major Depressive Disorder (MED-1360)

Objective To assess whether patients receiving aerobic exercise training performed either at home or in a supervised group setting achieve reductions in depression comparable to standard antidepressant medication...

tfidf=—bm25=—bge=1medcpt=3hybrid_rrf=3hybrid_reranked=50

PLAIN-1453

relevance = 1

“junk food”

Lack of Awareness among Future Medical Professionals about the Risk of Consuming Hidden Phosphate-Containing Processed Food and Drinks (MED-3091)

Phosphate toxicity is an important determinant of mortality in patients with chronic kidney disease (CKD), particularly those undergoing hemodialysis treatments. CKD patients are advised to take a low...

tfidf=71bm25=43bge=—medcpt=9hybrid_rrf=5hybrid_reranked=50

PLAIN-2408

relevance = 1

“Zoloft”

Effects of exercise training on older patients with major depression. (MED-1357)

BACKGROUND: Previous observational and interventional studies have suggested that regular physical exercise may be associated with reduced symptoms of depression. However, the extent to which exercise training may...

tfidf=—bm25=—bge=8medcpt=5hybrid_rrf=5hybrid_reranked=49

PLAIN-1635

relevance = 1

“milk”

Milk stimulates growth of prostate cancer cells in culture. (MED-2774)

Concern has been expressed about the fact that cows' milk contains estrogens and could stimulate the growth of hormone-sensitive tumors. In this study, organic cows' milk and two commercial substitutes were digested in...

tfidf=1bm25=5bge=1medcpt=12hybrid_rrf=3hybrid_reranked=46

PLAIN-1837

relevance = 1

“pesticides”

Behaviour of some organophosphorus and organochlorine pesticides in potatoes during soaking in different solutions. (MED-1158)

The efficiencies of acidic solutions (radish, citric acid, ascorbic acid, acetic acid and hydrogen peroxide), neutral solutions (sodium chloride) and alkaline solution (sodium carbonate) as well as tap water in the...

tfidf=10bm25=4bge=15medcpt=16hybrid_rrf=6hybrid_reranked=48

Source: results/error-analysis/error_analysis.json — src/biomedical_ir/error_analysis.py. Rank thresholds: good ≤ 10, bad = not retrieved or > 50.