Main Site
Search

Recent Posts
 BioStatistical Blog
 1. Statistic’s Dirty Little Secret
 1.A Another view on testing by Peter Flom, PhD
 1.B Am I a nattering nabob of negativism?
 2. Why do we compute pvalues?
 3. Meaningful ways to determine the adequacy of a treatment effect when you have an intuitive knowledge of the dependent variable
 4. Meaningful ways to determine the adequacy of a treatment effect when you lack an intuitive knowledge of the dependent variable
 5. Accepting the null hypothesis
 6. ‘Lies, Damned Lies, and Statistics’ part 1, and Analysis Plans, an essential tool
 7. Assumptions of Statistical Tests
Categories
Stat comments and Questions
 Allen Fleishman on 12. Significant pvalues in small samples
 Merm on 12. Significant pvalues in small samples
 Allen Fleishman on 12. Significant pvalues in small samples
 Phil Assheton on 12. Significant pvalues in small samples
 Allen Fleishman on 12. Significant pvalues in small samples
 Omar Farooque on 12. Significant pvalues in small samples
 Allen Fleishman on 12. Significant pvalues in small samples
 Mauro on 12. Significant pvalues in small samples
 Allen Fleishman on 12. Significant pvalues in small samples
 Haryanti on 12. Significant pvalues in small samples
RSS Feeds
Author Archives: Allen Fleishman
1. Statistic’s Dirty Little Secret
I can’t believe schools are still teaching kids about the null hypothesis. I remember reading a big study that conclusively disproved it years ago. *** To most scientists, the endpoint of a research study is achieving the mystical ‘p < 0.05’, … Continue reading
1.A Another view on testing by Peter Flom, PhD
The following was written by Peter Flom, PhD dated November 4, 2009 from a Book Review: Statistics as Principled Argument by Robert Abelson. His website is http://www.statisticalanalysisconsulting.com/ His blog is http://www.statisticalanalysisconsulting.com/blog/ I changed the date of publication of 12July2012 to 1Oct2011 … Continue reading
Posted in pvalues, Statistics, Treatment Effect
Leave a comment
1.B Am I a nattering nabob of negativism?
This blog was written on April 23, 2017, but was ‘published on October 2, 2011, so it appears after blog 1.A Another view on testing by Peter Flom, PhD. I wrote my first blog, ‘1. Statistic’s dirty little secret‘, in September … Continue reading
Posted in Uncategorized
Leave a comment
2. Why do we compute pvalues?
In my previous blog I said that the pvalue, which test the null hypothesis, is a near meaningless concept. This was based on: In nature, the likelihood that the difference between two different treatments will be exactly any number (e.g., … Continue reading
3. Meaningful ways to determine the adequacy of a treatment effect when you have an intuitive knowledge of the dependent variable
“A theory has only the alternative of being wrong. A model has a third possibility – it might be right but irrelevant.” Manfred Eigen In my last stats course I was amazed to hear my teacher announce that If we … Continue reading
4. Meaningful ways to determine the adequacy of a treatment effect when you lack an intuitive knowledge of the dependent variable
In previous blogs I discussed how little relevance the pvalue actually has, but explained in a second blog why we still do it. I gave in my last blog a 1to1 alternative for the pvalue, and why we need to … Continue reading
Posted in Uncategorized
Leave a comment
5. Accepting the null hypothesis
“All models are wrong. … But some are useful.” George Box *** In my first blog I stated a truism, that was hopefully taught in your first statistics class: You can’t accept the null hypothesis. You can ONLY reject the … Continue reading
Posted in Biostatistics, Confidence intervals, NonInferiority, noninferiority hypothesis, noninferiority hypothesis, Not worse than
Tagged confidence intervals, inferiority hypothesis, inferiority testing, noninferiority, noninferiority, not worse than, proving the null hypothesis
Leave a comment
6. ‘Lies, Damned Lies, and Statistics’ part 1, and Analysis Plans, an essential tool
Lies, Damn Lies, and Statistics Let me start this blog with one of my pet peeves. I abhor the quote ‘Lies, Damn Lies, and Statistics’. For me, a statistician, it has as much truth as saying that ‘the earth is … Continue reading
7. Assumptions of Statistical Tests
“All models are incorrect. Some are useful.” George Box *** When you do a statistical test, you are, in essence, testing if the assumptions are valid. We are typically only interested in one, the null hypothesis. That is, the assumption … Continue reading
7a. Assumptions of Statistical Tests: Ordinal Data
In my ‘7. Assumptions of Statistical Tests‘, there was a glaring omission (at least glaring for me): no discussion of ordinal data. I felt that I let my readers down, by glossing over this issue. Time to repair my quite … Continue reading
8. What is a Power Analysis?
People who haven’t the time to do things ‘perfectly’, always have time to do them over. Measure once, cut twice. Measure twice, cut once. ‘My god, you’ve conclusively proven it. Time equals Money.’ *** Cost for Failure Every CEO I’ve … Continue reading
9. Dichotomization as the Devils Tool
There are two types of people, those who classify people into two types of people and those who don’t. Never trust anyone over thirty. As Mason said to Dixon, ‘you gotta draw the line somewhere’. *** Don’t get me wrong, … Continue reading
Posted in Biostatistics, Dichotomization, Interval, Nominal, Ordinal, pvalues, Power, Statistics
Leave a comment
10. Parametric or nonparametric analysis – Why one is almost useless
… ‘If you lost your watch in that dark alley, why are we looking here?’ ‘Well, <hic> there’s light here.’ (old chestnut) *** In my last blog, I stated that we should avoid dichotomizing as it throws away a lot … Continue reading
11. pvalues by the Pound
‘Failure is always an option’ – Myth Busters ‘The Statistician is in. 5¢ per pvalue.’ ‘Your statistical report is being delivered by three UPS trucks.’ ‘It takes three weeks to prepare a good adlib speech.’ – Mark Twain *** Let … Continue reading
12. Significant pvalues in small samples
‘Take two, they’re small’ *** Are the results from small, but statistically significant, studies credible? One of the American Statistical Association’s subsections is for Statistical Consultants. A short time ago, there were over fifty comments on the topic of ‘Does … Continue reading
13. Multiple Observations and Statistical ‘Cheapies’
‘Measure once cut twice, measure twice cut once’ ‘A man with one watch knows what time it is, a man with two is never sure’ The three words which get everyone’s attention: Free, Free, Free *** Multiple observations occur in … Continue reading
14. Great and Not so Great Designs
Common Designs to Reduce Error Variance Contralateral Design This is a very sweet type of study design, but it can be seldom used in pharma or biotech. Devices are another story. With only one group (rather than two) and the … Continue reading
15. Variance, and ttests, and ANOVA, oh my!
Statistics – a specialty of mathematics whose basic tenant is ‘Exceptions prove the rule’. Mr. McGuire: I just want to say one word to you. Just one word. Benjamin: Yes, sir. Mr. McGuire: Are you listening? Benjamin: Yes, I am. … Continue reading
Posted in ANOVA, pvalues, ttest, Uncategorized, Variance
Leave a comment
5.A Accepting the NullHypothesis a Bayesian approach
The following blog was written by Randy Gallistel, PhD of Rutgers. It presents a Bayesian approach to hypothesis testing. It was written on April 23, 2012, but will eventually appear to have an earlier date, to sort it immediately after … Continue reading
Posted in Biostatistics, Uncategorized
Leave a comment
16. Comparing many means – Analysis of VARIANCE?
What do you call a numbers cruncher who is creative? An accountant. What do you call a numbers cruncher who is uncreative? A statistician. *** In the last blog, I explored the meaning of variance. I said that variance is … Continue reading
Posted in ANOVA, Treatment Effect, Variance
Leave a comment
17. Statistical Freebies/Cheapies – Multiple Comparisons and Adaptive Trials without selfimmolation
If you shoot enough arrows, everyone can hit a bull’seye Free! Free! Free! BOGO – Buy One Get One Free *** Multiple Comparison Problem: If you shoot at a target once and hit the bull’seye, then you’ve clearly hit your … Continue reading
18. Percentage Change from Baseline – Great or Poor?
Everything should be made as simple as possible, but no simpler. – Attributed to Albert Einstein *** In my third and forth blog I addressed useful ways to present the results of an analysis. Of course, pvalues wasn’t it. I … Continue reading
19. A Reconsideration of My Biases
No virtual observations were harmed in the running of this study. A man with one watch knows what time it is. A man with two is not sure, at least for the Wilcoxon test. And don’t try this at home, … Continue reading
Posted in ANOVA, Effect Size, nonnormality, nonparametric statistics, pvalues, Power, ttest
2 Comments
20. Graphs I: A Picture is Worth a Thousand Words
A picture is worth a thousand words Everything should be made as simple as possible, but no simpler. C’est la Bérézina – French phrase meaning ‘it’s a complete disaster’ *** We’ve all heard it, ‘A picture is worth a thousand … Continue reading
Posted in Graphics
Leave a comment
21. Graphs II: The Worst and Better Graphs
At times, I strive to be an educated Simpleton. *** OK, we know that a great graph can Sing!!! But do we know anything about what conveys information the best? Yes. Many psychology studies have been done to tell us … Continue reading
22. A question on QoL, Percentage Change from Baseline, and CompassionateUsage Protocols
Yesterday was 1 degree Fahrenheit and today is 10. I’m ten times warmer!! Compassion? We statisticians have evolved beyond such petty human affects. I received the following question from Simon Wilkinson from New Zealand: Dear Allen. To set the scene, … Continue reading
23. Small N study to publish or not?
The following question was sent to me, I thought it useful enough for a full elaboration: Submitted on 2014/05/12 at 8:23 am Dr. Fleishman, I am so happy I found your site. I have been trying to decide how to best … Continue reading
24. Simple, but SimpleMinded
Science is organized common sense where many a beautiful theory was killed by an ugly fact. – Thomas Huxley It really is a nice theory. The only defect I can think it has is probably common to all philosophical theories. … Continue reading
25. Psychology I – A Science?
“Psychology is a crock”, Bob Newhart show, Season 4 Episode 8 *** Let me start out with a detail I don’t publicize much. My PhD was in Quantitative Psychology or Psychometrics. Like Biometrics, it is the mathematical end of the … Continue reading
Posted in Psychology
Leave a comment
26. Psychology II: A Totally Different Pardigm
Simple Truths: If you want to study the most complex system in the world, do not rely on the simplest tools/methodology or mathematics a fifth grader could apply. If you want to study an individual, you need to study an individual. If … Continue reading
Posted in Psychology
6 Comments
27. Number of Events from Week x to Week y
What is your right shoe size? What is your left shoe size? How many horses? Simple, you count the number of hooves and divide by four. A man with one watch knows what time it is. A man with two … Continue reading
Posted in Design
Leave a comment
18.1 Percentage Change – Right Way and a Wrong Way
Eat s**t, 300 trillion flies can’t be wrong. [old joke punchline] “No, I dropped them in that dark alley, but I’d never find them there. That’s why we’re looking under the light post.” *** I came across a recent rant … Continue reading
Posted in Effect Size, percentage change from baseline
4 Comments
28. Failure to Reject the null hypothesis
Let me again start with a truism, Failure to reject the null hypothesis is not the same as accepting it. One can ONLY reject the null hypothesis. To many, failure to reject the null hypothesis is equivalent to saying that the difference … Continue reading
Posted in Accepting the Null hypothesis, assumptions, Power
Leave a comment
29. Should you publish a nonsignificant result?
53. If the beautiful princess that I capture says “I’ll never marry you! Never, do you hear me, NEVER!!!”, I will say “Oh well” and kill her. 61. If my advisors ask “Why are you risking everything on such a … Continue reading
Posted in Effect Size, pvalues, Power, Psychology, Statistics, Treatment Effect
Leave a comment
18.2 Percentage Change Revisited
If you hear hoof beats, the first thing you should NOT look for is unicorns. I’d like to thank Rob Musterer, President of ER Squared, for posting a reference to a 2009 paper by Ling Zhang and Han Kun, ‘How … Continue reading
Posted in Uncategorized
Leave a comment
30. ‘Natural’ Herbs and Alternative Medicines
Just b’cause it ain’t science, don’t mean it ‘taint so. Phrenology, Four humors, You were cursed, Leeches, … ************************************ This blog is written for the general public, not for the pharma/device expert who is my typical target for my blog. My … Continue reading
Posted in Design, Uncategorized
Leave a comment
31. Burdon of Proof, Useful Data, Reliability, Radiological Diagnosis, and Iridology
The eyes are the windows to the soul. “If you cannot measure it, it does not exist.” Young psychometrician Hmm, lost an eye? My professional opinion is to cover your good eye with gauze so you can only see light or … Continue reading
Posted in Uncategorized
Leave a comment
31. Case History of a Trial
A colleague asked me to review a trial. I will mask the identity of the trial and obfuscate irrelevant details, like the disease, timing, treatment, and key parameter. The patients had abnormal parathyroid glans, with hypercalcemia. This was a Phase … Continue reading
BioStatistical Blog
I have retired from consulting. However I will post blogs on statistics when I see interesting materials to comment on. Allen I. Fleishman, PhD, PStat® Did you hear the joke about statisticians? … Probably “Professor, do I look like a … Continue reading →