The whole human memory can be, and probably in a short time will be,
made accessible to every individual.
— H. G. Wells in The World
Brain (1938) ‘The Idea of a Permanent World Encyclopaedia’
The things we consider important are often undervalued by other
disciplines … One of the most important concepts in Statistics is that
of missing data. For most people it’s easy to ignore because much of it
is not very visible.
— Cyntha Struthers and Don McLeish in a
workshop in 2015
… in all the sciences, we’ve got to make sure that we are supporting
the idea that they’re not subject to politics, that they’re not skewed
by an agenda, that, as I said before, we make sure that we go where the
evidence leads us.”
— Barack Obama
We can’t just learn what we want to know, but what we should know.
— Joseph R. Biden
Often decisions about interventions must be made, even if based on
limited empirical evidence, and we should help decision-makers make
sensible decisions under clearly stated assumptions so that “consumers”
of the conclusion about the effects of some intervention can honestly
weigh the support for that conclusion.
— Donald Rubin
To teach how to live without certainty, and yet without being
paralysed by hesitation, is perhaps the chief thing that philosophy, in
our age, can still do for those who study it.
— Bertrand
Russell
Human History becomes more and more a race between education and
catastrophe.
— H. G. Wells
Would you rather know the chance of making an assertion of efficacy
when the treatment has no effect, or the chance that the treatment is
effective?
— Frank H. Harrell
Philosophical unification of the Bayesian and frequentist positions
is not likely, nor desirable, since each illuminates a different aspect
of statistical inference. We can hope, however, that we will eventually
have a general methodological unification, with both Bayesians and
frequentists agreeing on a body of standard statistical procedures for
general use.
— M. J. (Susie) Bayarri and James O. Berger
(2004) “The Interplay of Bayesian and Frequentist Analysis.”
Statistical Science v. 19. (thanks to Hugh McCague)
The rubber hits the road where the data hits the code.
—
Janet McDougall
The best thing about being a statistician is that you get to play in
everyone’s backyard.
— John W. Tukey, who, incidentally,
coined the terms ‘software’ and ‘bit’.
Once you know hierarchies exist, you see them everywhere
—
Ita Kreft and Jan de Leeuw (1998) “Introducing Multilevel
Modeling”
Once you tune into ellipses, you will begin to see them everywhere …
— James McMullan
1
I believe that the artist doesn’t know what he does. I attach
even more importance to the spectator than to the artist.
—
Marcel Duchamp
I hate a liar more than I hate a thief. A thief is after my salary –
a liar is after my reality.
— 50 Cent
No amount of experimentation will prove me right; a single experiment
can prove me wrong.
— Albert Einstein
The best thing about being a statistician is that you get a license
to poke your nose into everyone else’s business.
— (??)
The best thing about universities is individual freedom, the worst
thing is collective irresponsibility.
— David Northrup
Humanists believe that the world has a fixed number of mysteries, so
that when one is solved, our sense of wonder is diminished. Scientists
believe that the world has endless mysteries, so that when one is
solved, there are always new ones to ponder.
— D. O. Hebb quoted
by Steven Pinker
Far better an approximate answer to the right question, which is
often vague, than an exact answer to the wrong question, which can
always be made precise.
— John W. Tukey, (1962), “The
future of data analysis.” Annals of Mathematical Statistics 33,
1-67.
A bad answer to a good question may be far better than a good answer
to a bad question.
— a graduate class extrapolating from Tukey’s
dictum.
It is better to know some of the questions than all of the answers.
— James Thurber
I have a lot of questions . . . but I don’t know what they are.
—
overheard at the end of what must have been an inspiring lecture
The worst, i.e., most dangerous, feature of ‘accepting the null
hypothesis’ is the giving up of explicit uncertainty . . . Mathematics
can sometimes be put in such black-and-white terms, but our knowledge or
belief about the external world never can.
— John W. Tukey.
(1991). “The Philosophy of Multiple Comparisons.” Statistical Science 6,
100–116.
Where there is no uncertainty there cannot be truth.
—
Richard Feynman (confirmed by Bill Langford)
So far as the theories of mathematics are about reality, they are not
certain; so far as they are certain, they are not about reality.
—
Albert Einstein
Doubt is not a pleasant condition, but certainty is absurd. - Voltaire
Art is a lie that enables us to realize the truth.
— Pablo
Picasso
At their best, graphics are instruments for reasoning.
— Edward Tufte
An elementary demonstration is one that requires no knowledge — just
an infinite amount of intelligence.
— Richard Feynman.
All models are wrong but some are useful.
— George E.P.
Box
All models are wrong but, we hope, not as wrong as the ones we used
earlier.
— paraphrased from Isaac Asimov
‘All models are wrong’ is a model, thus must be wrong. Perhaps it’s
useful
— paraphrased from a comment on a blog.
I heard what you were saying! You know nothing of my work! You mean
my whole fallacy is wrong. How you got to teach a course in anything is
totally amazing!
— Marshall McLuhan as himself in Annie
Hall
The business of the statistician is to catalyze the scientific
learning process.
— George E. P. Box
There are no routine statistical question; only questionable
statistical routines.
— D.R. Cox
We at York must give special emphasis to the humanizing of man,
freeing him from those pressures which mechanize the mind, which make
for routine thinking, which divorce thinking and feeling, which permit
custom to dominate intelligence, which freeze awareness of the human
spirit and its possibilities…
— Murray G. Ross
It is better to be wrong than to be vague.
— Freeman
Dyson
It is much more important to be clear than to be correct.
—
Blair Wheaton
Science may be described as the art of systematic
over-simplification.
— Karl Popper
There are three kinds of lies: lies, damned lies, and statistics.
— Mark Twain with attribution to Benjamin
Disraeli
Lies — damned lies — and statistics
— Leonard Henry
Courtney with attribution to a “Wise Statesman,” possibly Disraeli
[see http://www.york.ac.uk/depts/maths/histstat/lies.htm]
Statistical thinking will one day be as necessary for efficient
citizenship as the ability to read and write.
— S. Wilks
attributing to H. G. Wells
A certain elementary training in statistical method is becoming as
necessary for anyone living in this world of today as reading and
writing.
— H. G. Wells in “The Informative Content of
Education,” The Presidential Address to the Educational Science Section
of the British Association for the Advancement of Science, given on
September 2nd, 1937.
Statistical literacy is a necessary precondition for an educated
citizenship in a technological democracy
— Gerd Gigenrenzer et
al.
It is easy to lie with statistics. It is hard to tell the truth
without it.
— Andrejs Dunkels
Data analysis is an aid to thinking and not a replacement for.
—
Richard Shillington
Methodology should never be allowed to displace intelligence.
—
paraphrased from Leland Wilkinson, I think
Another thing about fit indices is that they are used all too often
as substitutes for thinking. In most cases, statistical analysis should
be not about determining the “best fitting” model according to a single
numerical criterion. In any given research there hopefully are
underlying substantive theory and knowledge, the research hopefully is
guided by research questions and knowledge about control variables,
there is a distinction between primary and secondary interest, a single
research often has elements of hypothesis testing as well as
exploration, etc. etc. Fit indices in the ?IC family are useful only as
a secondary type of summary information, but research questions and
existing knowledge are more important.
— Tom Snijders
I am a firm believer that before you use a method, you should know
how to break it. Describing how to break something should be an
essential part of describing a new piece of statistical methodology (or,
for that matter, of resurrecting an existing one).
— Dan
Simpson
If you try to estimate everything, you will end up estimating
nothing.
— [I forget who said this but I’d like to know!]
Fishing for hypotheses is like throwing a dart at a wall and then
drawing a target around it.
— Andrée Monette
When statistics are not based on strictly accurate calculations, they
mislead instead of guide. The mind easily lets itself be taken in by the
false appearance of exactitude which statistics retain in their
mistakes, and confidently adopts errors clothed in the form of
mathematical truth.
— Alexis de Tocqueville [With the
benefit of a few centuries to reflect on this, we appreciate that the
accuracy of the calculations is only one of many requirements to ensure
that statistics guide and not mislead]
Causal interpretation of the results of regression analysis of
observational data is a risky business. The responsibility rests
entirely on the shoulders of the researcher, because the shoulders of
the statistical technique cannot carry such strong inferences.
—
Jan de Leeuw.
Correlation is not causation - but it sure helps
— Edward
Tufte
Correlation does not imply causation but it does waggle its eyebrows
suggestively and gesture furtively while mouthing ‘look over there.’
— Randall Munroe, xkcd.com.
OK! Correlation does not imply causation yada yada.
— Paul
Krugman
Do I love you because you’re beautiful, or are you beautiful because
I love you?
— Prince Topher to Cinderella, philosophizing
on causality
The investigation of causal relations between economic phenomena
presents many problems of peculiar difficulty and offers many
opportunities for fallacious conclusions. Since the statistician can
seldom or never make experiments for himself, he has to accept the data
of daily experience, and discuss as best he can the relations of a whole
group of changes; he cannot, like the physicist, narrow down the issue
to the effect of one variation at a time. The problems of statistics are
in this sense far more complex than the problems of physics.
—
Udny Yule
… a primary objective in the design and analysis of observational
studies is to control, through sampling and statistical adjustment, the
possible biasing effects of those confounding variables that can be
measured: a primary objective of in the evaluation of observational
studies is to speculate about the remaining biasing effects of those
confounding variables that cannot be [or: were not] measured.
—
Donald B Rubin (Matched Sampling for Causal Effects, 2006)
In our lust for measurement, we frequently measure that which we can
rather than that which we wish to measure… and forget that there is a
difference.
— Udny Yule
Not everything that can be counted counts, and not everything that
counts can be counted.
— Albert Einstein
If a man is offered a fact which goes against his instincts, he will
scrutinize it closely, and unless the evidence is overwhelming, he will
refuse to believe it. If, on the other hand, he is offered something
which affords a reason for acting in accordance to his instincts, he
will accept it even on the slightest evidence.
— Bertrand
Russell
There’s no crime in being ignorant. Problems arise when people who
don’t know they’re ignorant rise to power.
— Neil deGrasse
Tyson (with thanks to Jen Agg)
It ain’t what they don’t know that’s the problem — it’s what they
know that ain’t so
— said of members of the U.S. Congress by ??
(communicated by David Brillinger). Variants aimed at different groups
are attributed to sources ranging from Will Rogers to Ronald Reagan.
Moral indignation is jealousy wearing a halo.
— H. G.
Wells
If you can’t be a good example, be a horrible warning.
— scrawled
in a country bathroom.
From the Globe & Mail, Social Studies column by Michael Kesterton, September 9, 2003: > Random: Washington-area teenagers have been overheard saying such things as: > “Did you see that outfit she was wearing? That was so random!” “Who invited > those random kids to this party?” “I never watch the news on TV. It’s too, > like, random.” The adjective seems to mean “serendipitous,” but is more > value-neutral. “It’s actually rather specific the way students use it,” > English teacher Patrick Welsh tells The Washington Post, adding “the > brightest of the bright kids are the ones who tend to use it.”
I have a soft spot for secret passageways, bookshelves that open into
silence, staircases that go down into a void, and hidden safes. I even
have one myself, but I won’t tell you where. At the other end of the
spectrum are statistics which I hate with all my heart.
— Luis
Buñuel
What difference does it make to the dead, the orphans and the
homeless, whether the mad destruction is wrought under the name of
totalitarianism or the holy name of liberty or democracy?
—
Mahatma Gandhi (1869 - 1948), Non-Violence in Peace and War
No problem is so big or so complicated that it can’t be run away
from.
— Linus van Pelt (Peanuts)
Natural Selection is a mechanism for generating an exceedingly high
degree of improbability.
— R. A. Fisher
In times of change learners inherit the earth, while the learned find
themselves beautifully equipped to deal with a world that no longer
exists.
— Eric Hoffer
Being a statistician means never having to say you’re certain
—
??
There’ll be a time when not having strong opinions about anything
will be seen not as a character flaw, but as a virtue.
— Alberto
Cairo
It has often and confidently been asserted, that man’s origin can
never be known: but ignorance more frequently begets confidence than
does knowledge: it is those who know little, and not those who know
much, who so positively assert that this or that problem will never be
solved by science.
— Charles Darwin
One of the painful things about our time is that those who feel
certainty are stupid, and those with any imagination and understanding
are filled with doubt and indecision.
— Bertrand
Russell
The methods of statistics turn art into science
— paraphrased
from Arnold Zellner
Statistics is an art struggling to be a science.
— Heather
Krause
A data scientist is a statistician who lives in San Francisco
—
?
A data scientist is a statistician who is useful
— Hadley
Wickham
A popular joke is that “a data scientist is a statistician who lives
in San Francisco,” but Hadley Wickham, a Ph. D. statistician, floated a
more cynical take on Twitter: “a data scientist is a statistician who is
useful.” Statisticians are the guardians of statistical inference, and
it is our responsibility to educate practitioners about using models
appropriately, and the hazards of ignoring model assumptions when making
inferences. But many model assumptions are only truly met under
idealized conditions, and thus, as Box eloquently argued, one must think
carefully about when statistical inferences are valid. When they are
not, statisticians are caught in the awkward position, as Wickham
suggests, of always saying “no”. This position can be dissatisfying.
— Ben Baumer in “A Data Science Course for Undergraduates:
Thinking with Data”, March, 2015
The absence of evidence is not evidence of absence
— Carl
Sagan and many many others cautioning against concluding that the
null hypothesis is correct when you merely fail to reject it.
The absence of evidence is not evidence of absence
— Donald
Rumsfeld to George W. Bush concluding the alternative hypothesis to
justify the attack on Iraq. A difference of evidence is not in itself
evidence of a difference
— ??
The difference between ‘significant’ and ‘not significant’ is not
itself statistically significant.
— Andrew Gelman and Hal Stern,
American Statistician (2006)
If it were a fact, it wouldn’t be called intelligence
—
Donald Rumsfeld interviewed by Stephen Colbert
Wow!
—
Stephen Colbert
Changing your mind is the only sure proof you can offer that you’ve
got one
— Richard P. Feynman quoting ??
Ignorance more frequently begets confidence than does knowledge.
— Charles Darwin, The Descent of Man
Statisticians learn not to be surprised by the improbable — which is
usually probable — only by the improbably improbable
— ??
One might perchance say this was probable that things improbable oft
will hap to men
— Aristotle quoting Agathon
Railing against collinearity is like railing against gravity
—
anonymous referee commenting on an article on collinearity and variance
inflation.
There once was a student of yore
Whose inference truly was poor.
From a sample of one,
His mean was .1,
And the variance he found was .4.
— G. Eric Moorhouse
If you think you understand X that’s a sure sign that you don’t
understand X
— a metaquote.
Believe those who are seeking the truth. Doubt those who find it.
— André Gide
If you amplify everything, you hear nothing.
— Jon
Stewart
Seek the company of those who seek the truth, and run away from those
who have found it.
— Vaclav Havel
The scientist is not a person who gives the right answers, he is one
who asks the right questions.
— Claude Lévi-Strauss (Le Cru
et le Cuit, 1964)
We are inclined to believe those whom we do not know because they
have never deceived us.
— Samuel Johnson
“Faith” is a fine invention
For Gentlemen who see!
But Microscopes are prudent
In an Emergency!
— Emily Dickinson
Let us change our traditional attitude to the construction of
programs: Instead of imagining that our main task is to instruct a
computer what to do, let us concentrate rather on explaining to humans
what we want the computer to do.
— Donald E. Knuth,
1984
…academic administrative positions must be about both leadership and
management because one without the other leads to no results or to
trivial results.
— Sheila Embleton
It’s foie. You’ve got to get it right
— the “King of
Ginger” rejecting a dish performing quality control at The Black
Hoof
There’s no task so impressive that it can’t be ruined by a rubric
— Hans Krause
It’s not the data alone, but analytics — and people trained to use
them — that generate real value from big data.
— Suzanne Gordon,
CIO, SAS
After Eisenhower, you couldn’t win an election without radio. After
JFK, you couldn’t win an election without television. After Obama, you
couldn’t win an election without social networking. I predict that in
2012, you won’t be able to win an election without big data.
—
Alistair Croll
The real battlefront is not between Islam and the West. The real
battlefront is between all the faith traditions . . . atheists among
that . . . all the moderates against extremists.
— Imam Feisal
Abdul Rauf
This is not a scientific survey. It’s a random survey.
—
Representative Daniel Webster voting in May 2012 for the
abolition of the American Community Survey, the U.S. analogue of the
Canadian “long form.”
There was a young man of Lyon
Who normally fished on the Rhône.
One hour he caught seven.
Next five.
Then eleven.
Not normal! Those fish were Poisson.
— G. Eric Moorhouse
90% of the world’s data was generated in the last two years and 80%
of that data is unstructured …
— Geeknet, Inc. 2012
Statistical rituals largely eliminate statistical thinking in the
social sciences. Rituals are indispensable for identification with
social groups, but they should be the subject rather than the procedure
of science.
— Gerd Gigerenzer
… statistics is fraught with contextual issues, which is the nature
of the discipline, whereas often mathematics strips off the context in
order to abstract and generalize.
— J. Michael
Shaughnessy
I’ve worked in so many areas — I’m sort of a dilettante. Basically,
I’m not interested in doing research and I never have been. I’m
interested in understanding, which is quite a different thing. And often
to understand something you have to work it out yourself because no one
else has done it.
— David Blackwell
… no scientific worker has a fixed level of significance at which
from year to year, and in all circumstances, he rejects hypotheses; he
rather gives his mind to each particular case in the light of his
evidence and his ideas.
— Sir Ronald A. Fisher (1956) quoted in
Gerd Gigerenzer (2004) “Mindless Statistics”
Why do intelligent people engage in statistical rituals rather than
in statistical thinking? Every person of average intelligence can
understand that \(p(D|H)\) is not the
same as \(p(H|D)\). That this insight
fades away when it comes to hypothesis testing suggests that the cause
is not intellectual but social and emotional. Here is a hypothesis: The
conflict between statisticians, both suppressed by and inherent in the
textbooks, has become internalized in the minds of researchers. The
statistical ritual is a form of conflict resolution, like compulsive
hand washing, which makes it resistant to arguments.
— Gerd
Gigerenzer (2004) “Mindless Statistics”
… causal vocabulary was virtually prohibited [in Statistics] for more
than half a century. And when you prohibit speech, you prohibit thought
and stifle principles, methods, and tools.
— Judea Pearl (2018)
“The Book of Why”
In observational studies, it must be remembered that the issue of
bias reduction nearly always dominates the issue of variance reduction:
a precise estimate that is badly biased can be more deceptive than
helpful, and matched sampling is a key tool for reducing this bias
without compromising the integrity or objectivity of the study’s design.
— Donald Rubin (2006) “Matched Sampling for Causal
Effects”
The special training statisticans receive in mapping real problems
into formal probability models, computing inferences from data and
models, and exploring the adequacy of these inferences, is not really
part of any other formal discipline, yet is often critical to the
quality of empirical research.
— Donald Rubin (1993) “The Future
of Statistics”
The only victories that leave no regret are those that are gained
over ignorance.
— Napoléon Bonaparte
The only thing worse than fighting with your allies is fighting with
no allies.
— Winston Churchill
I have a foreboding of an America in my children’s or grandchildren’s time – when the United States is a service and information economy; when nearly all the manufacturing industries have slipped away to other countries; when awesome technological powers are in the hands of a very few, and no one representing the public interest can even grasp the issues; when the people have lost the ability to set their own agendas or knowledgeably question those in authority; when, clutching our crystals and nervously consulting our horoscopes, our critical faculties in decline, unable to distinguish between what feels good and what’s true, we slide, almost without noticing, back into superstition and darkness.
The dumbing down of America is most evident in the slow decay of
substantive content in the enormously influential media, the 30-second
sound bites (now down to 10 seconds or less), lowest common denominator
programming, credulous presentations on pseudoscience and superstition,
but especially a kind of celebration of ignorance.
— Carl
Sagan (1995) The Demon-Haunted World: Science as a Candle in
the Dark cited on MSNBC, The 11th Hour, by Brian Williams, July 12,
2021.
The shadow of the rim of a circular bicycle wheel is an ellipse. If the light source is infinitely far away (e.g. the sun) the shadows of perpendicular spokes are conjugate axes of the ellipse. As the wheel turns, the shadows of a perpedicular pair of spokes produce all pairs of conjugate axes.↩︎