Are there any free statistical textbooks available?
- 2$\begingroup$ Look at Statistics Topics ebook on Amazon by Mehta, and his free web log Statistics Ideas that has lecture slides. Nearly free and better in some pedagogical topics, than the ones you cite on your list of resources. $\endgroup$user48690– user486902014-06-20 00:16:54 +00:00Commented Jun 20, 2014 at 0:16
29 Answers
Online books include
- http://davidmlane.com/hyperstat/
- http://vassarstats.net/textbook/
- https://dwstockburger.com/Multibook/mbk.htm
- https://web.archive.org/web/20180122061046/http://bookboon.com/en/statistics-ebooks
- http://www.freebookcentre.net/SpecialCat/Free-Statistics-Books-Download.html
Update: I can now add my own forecasting textbook
The Elements of Statistical Learning by Hastie, Tibshirani, and Friedman is a standard text for statistics and data mining, and is now free:
https://web.stanford.edu/~hastie/ElemStatLearn/
Also Available here.
- 19$\begingroup$ Why pay $70 for the book? To support the authors and to have a physical copy. That's why I did it, anyway! $\endgroup$Shane– Shane2010-07-23 17:13:42 +00:00Commented Jul 23, 2010 at 17:13
- 2$\begingroup$ I agree with Shane... and a hardcopy makes reading it much easier. $\endgroup$Vince– Vince2010-07-24 00:07:57 +00:00Commented Jul 24, 2010 at 0:07
- 1$\begingroup$ Did that, too (previous edition). But it is nice to be able to look things up online when the book is not at hand. And to have access to the new edition. $\endgroup$cbeleites– cbeleites2012-08-17 12:03:36 +00:00Commented Aug 17, 2012 at 12:03
- $\begingroup$ (+1) Just wanted to comment that this is a GREAT book, it is my all-time favorite. I also ordered a physical copy of it :-). $\endgroup$Néstor– Néstor2012-08-20 03:13:01 +00:00Commented Aug 20, 2012 at 3:13
- $\begingroup$ If you attend Hastie and Tibshirani's Statistical Learning and Data Mining seminar, you'll receive a free copy of the text. And you can have your book signed! $\endgroup$RobertF– RobertF2013-02-26 18:36:19 +00:00Commented Feb 26, 2013 at 18:36
- 2$\begingroup$ Michael Lavine is a clear lecturer and thinker, so I have little doubt his book is worth a look. $\endgroup$2010-10-08 20:26:34 +00:00Commented Oct 8, 2010 at 20:26
- 3$\begingroup$ I'm teaching out that book this semester. It may be a good statistics book, but I'm having second thoughts regarding its light probability content. $\endgroup$John D. Cook– John D. Cook2010-10-09 01:21:48 +00:00Commented Oct 9, 2010 at 1:21
There's a superb Probability book here: https://web.archive.org/web/20100102085337/http://www.dartmouth.edu/~chance/teaching_aids/books_articles/probability_book/book.html which you can also buy in hardcopy.;
I've often found the Engineering Statistics Handbook useful. It can be found here.
Although I've never read it myself, I hear Introduction to Probability and Statistics Using R is very good. It's a full ~400 page ebook (also available as an actual book). As a bonus, it also teaches you R, which of course you want to learn anyways.
- 1$\begingroup$ +1 For this resource. As the name says, excellent for a practical approach to engineering problems. $\endgroup$Bossykena– Bossykena2010-07-26 17:42:34 +00:00Commented Jul 26, 2010 at 17:42
Machine Learning
One the most, if not the most, popular textbooks on machine learning is Hastie, Tibshirani, and Friedman, The Elements of Statistical Learning, which is fully available online (currently 10th printing). It is comparable in scope e.g. to Bishop's Pattern Recognition and ML or Murphy's ML, but those books are not free, while ESL is.
Hastie & Tibshirani also co-wrote freely available An Introduction to Statistical Learning, With Applications in R which is basically a simpler version of The Elements and focuses on R.
In 2015, Hastie & Tibshirani co-authored a new textbook Statistical Learning with Sparsity: The Lasso and Generalizations, also available online. This one is quite a bit shorter and focuses specifically on lasso.
Another freely available all-encompassing machine learning textbook is David Barber's Bayesian Reasoning and Machine Learning. I did not use it myself, but it is widely considered to be an excellent book.
Switching now to more specialized topics, there are:
Rasmussen & Williams Gaussian Processes for Machine Learning, which is the book on Gaussian processes.
Much awaited Goodfellow, Bengio and Courville Deep Learning textbook that is about to be published by MIT Press. It isn't published yet, but the book is already available online. On the official website one can view it in browser but cannot download (as per agreement with the publisher), but it is easy to find a combined PDF e.g. here on github.
Csaba Szepesvári, Algorithms for Reinforcement Learning, a concise book on RL. A classical, much more detailed but a bit dated textbook is Sutton & Barto, Reinforcement Learning: An Introduction which is also freely available online but only in a cumbersome HTML format.
Boyd and Vandenberghe, Convex Optimization.
I really like The Little Handbook of Statistical Practice by Gerard E. Dallal
Here's a fresh one: Introduction to Probability and Statistics Using R . It's R-specific, though, but it's a great one. I haven't read it yet, but it seems fine so far...
- $\begingroup$ Link is broken. Try lulu.com/items/volume_68/8123000/8123594/3/print/IPSUR.pdf $\endgroup$oob– oob2012-04-07 20:17:24 +00:00Commented Apr 7, 2012 at 20:17
- 2$\begingroup$ First edition at cran.r-project.org/web/packages/IPSUR/vignettes/IPSUR.pdf and second edition at ipsur.org $\endgroup$Henry– Henry2012-11-21 00:28:24 +00:00Commented Nov 21, 2012 at 0:28
- 9$\begingroup$ I downvoted because of "it's a great one. I haven't read it...." $\endgroup$rolando2– rolando22013-10-01 17:56:04 +00:00Commented Oct 1, 2013 at 17:56
Norman Matloff has written a mathematical statistics textbook for computer science students that's free. Kind of a niche market, I suppose. For what it's worth, I haven't read it, but Matloff has a Ph.D. in mathematical statistics, works for a computer science department, and wrote a really good R book, that I recommend for people who want to go to the next stage of programming R better (as opposed to just fitting models with canned functions).
OpenIntro Statistics
http://www.openintro.org/stat/textbook.php
Inexpensive paperback copies are also available on Amazon.
- 1$\begingroup$ I moved this from answer to comment since I am expressing my opinion about free books on the net rather than providing a a list of some. As both an author and owner of books I see both sides. I appreciate that most statistics books, especially when they deal with specialized topics are very expensive. However as an author who has put in a lot of effort to try to write useful and informative books I think the authors and publishers deserve remuneration for the efforts they go through to produce the books. So I don't think books should be free. $\endgroup$Michael R. Chernick– Michael R. Chernick2012-08-17 21:13:40 +00:00Commented Aug 17, 2012 at 21:13
- 5$\begingroup$ But if authors want to put out material on the internet for free that is their choice. We all can benefit from that. $\endgroup$Michael R. Chernick– Michael R. Chernick2012-08-17 21:14:15 +00:00Commented Aug 17, 2012 at 21:14
- 4$\begingroup$ You could make the same arguments about software, but we all benefit from R. $\endgroup$Jeremy Miles– Jeremy Miles2015-03-02 03:47:30 +00:00Commented Mar 2, 2015 at 3:47
A New View of Statistics by Will G. Hopkins is great! It is designed to help you understand how to understand the results of statistical analyses, not how to prove statistical theorems.
"An Introduction to Statistical Learning with Applications in R" https://www.statlearning.com/ by two of the 3 authors of the well-known "The Elements of Statistical Learning" plus 2 other authors. An Introduction to Statistical Learning with Applications in R is written at a more introductory level with less mathematical background required than The Elements of Statistical Learning, makes use of R (unlike The Elements of Statistical Learning), and was first published in 2013, some years after this thread was started.
Not Statistics specific, but a good resource is: http://www.reddit.com/r/mathbooks Also, George Cain at Georgia Tech maintains a list of freely available maths texts that includes some statistical texts. http://people.math.gatech.edu/~cain/textbooks/onlinebooks.html
For getting into stochastic processes and SDEs, Tom Kurtz's lecture notes are hard to beat. It starts with a decent review of probability and some convergence results, and then dives right into continuous time stochastic processes in fairly clear, comprehensible language. In general it's one of the best books on the topic -- free or otherwise -- I've found.
I really like these two books by Daniel McFadden of Berkeley:
Lecture Notes: Econometric Tools http://elsa.berkeley.edu/users/mcfadden/e240a_sp98/e240a.html
Lecture Notes: Econometrics/Statistics http://elsa.berkeley.edu/users/mcfadden/e240b_f01/e240b.html
Cosma Shalizi, CMUs ML guru, occasionally updates a draft of a stats book soon to be published by Cambridge Press titled Advanced Data Analysis from an Elementary Point of View. Can't recommend it highly enough...
Here's the Table of contents:
I. Regression and Its Generalizations Regression Basics The Truth about Linear Regression Model Evaluation Smoothing in Regression Simulation The Bootstrap Weighting and Variance Splines Additive Models Testing Regression Specifications Logistic Regression Generalized Linear Models and Generalized Additive Models Classification and Regression Trees II. Distributions and Latent Structure Density Estimation Relative Distributions and Smooth Tests of Goodness-of-Fit Principal Components Analysis Factor Models Nonlinear Dimensionality Reduction Mixture Models Graphical Models III. Dependent Data Time Series Spatial and Network Data Simulation-Based Inference IV. Causal Inference Graphical Causal Models Identifying Causal Effects Causal Inference from Experiments Estimating Causal Effects Discovering Causal Structure Appendices Data-Analysis Problem Sets Reminders from Linear Algebra Big O and Little o Notation Taylor Expansions Multivariate Distributions Algebra with Expectations and Variances Propagation of Error, and Standard Errors for Derived Quantities Optimization chi-squared and the Likelihood Ratio Test Proof of the Gauss-Markov Theorem Rudimentary Graph Theory Information Theory Hypothesis Testing Writing R Functions Random Variable Generation - 2$\begingroup$ I point people to Cosma's notes regularly. There's some good material in there $\endgroup$Glen_b– Glen_b2016-06-06 01:10:37 +00:00Commented Jun 6, 2016 at 1:10
I know other authors have gone to some trouble to make their books available here on stack exchange ... The printed version of our 2002 edition was printed 3 times and sold out 3 times; Springer and Google recently started selling it (book only) as a PDF eBook (no software) on the Springer and Google sites for $79.
We are delighted to be able to make the PDF eBook version (2002 edition) available for FREE to stackexchange users at:
http://www.mathstatica.com/book/bookcontents.html
This is a complete PDF version of the original 2002 printed edition. Although no software is included (neither Mathematica nor mathStatica), the methods, theorems, summary tables, examples, exercises, theorems etc are all useful and relevant ... even as a reference text for people who do not even have Mathematica.
One can either download:
the entire book as a single download file ... with live clickable Table of Contents etc, ... or
chapter by chapter.
iBooks installation
To install as an iBook:
Download the entire book as a single PDF file
Then drag it into iBooks (under the section: PDF files).
iPad installation
To install on an iPad:
First install it as an iBook (as above)
Open iTunes; select your iPad; click on Books: select the book and sync it over to your iPad.
It's nice to see academics freely distribute their works. Here is trove of free ML / Stats books in PDF:
Machine Learning
- Elements of Statistical Learning Hastie, Tibshirani, Friedman
- All of Statistics Larry Wasserman
- Machine Learning and Bayesian Reasoning David Barber
- Gaussian Processes for Machine Learning Rasmussen and Williams
- Information Theory, Inference, and Learning Algorithms David MacKay
- Introduction to Machine Learning Smola and Vishwanathan
- A Probabilistic Theory of Pattern Recognition Devroye, Gyorfi, Lugosi
- Introduction to Information Retrieval Manning, Rhagavan, Shutze
- Forecasting: principles and practice Hyndman, Athanasopoulos (Online Book)
Probability / Stats
- Introduction to statistical thought Lavine
- Basic Probability Theory Robert Ash
- Introduction to probability Grinstead and Snell
- Principle of Uncertainty Kadane
Linear Algebra / Optimization
- Linear Algebra, Theory, and Applications Kuttler
- Linear Algebra Done Wrong Treil
- Applied Numerical Computing Vandenberghe
- Applied Numerical Linear Algebra James Demmel
- Convex Optimization Boyd and Vandenberghe
Genetic Algorithm
- $\begingroup$ If LADW is mentioned, perhaps LADR by Axler could have been mentioned too; the latter is way better book imo. $\endgroup$User1865345– User18653452023-06-02 12:04:02 +00:00Commented Jun 2, 2023 at 12:04
Statsoft's Electronic Statistics Handbook ('The only Internet Resource about Statistics Recommended by Encyclopedia Britannica') is worth checking out.
- $\begingroup$ This link now redirects to a product page for a data science/AI software. Can you update the link, if this resource is still freely available? $\endgroup$dipetkov– dipetkov2023-03-31 09:07:11 +00:00Commented Mar 31, 2023 at 9:07
Not properly an entire textbook, but the part IV of Mathematics for Computer Science is about probability and random variables.
Some downloadable notes on probability, which seems interesting: http://www.math.harvard.edu/~knill/teaching/math19b_2011/handouts/chapters1-19.pdf
Applied probability: http://www.acsu.buffalo.edu/~bialas/EAS305/docs/EAS305%20NOTES%202005.pdf
http://www.ma.huji.ac.il/~razk/Teaching/LectureNotes/LectureNotesProbability.pdf
A write up of probability tutorials and related puzzles along with R code for learning. Hope it helps
http://www.probabilitycourse.com/ is a website hosting free online-based Probability and Statistics textbook. It also has extra features such as graphing tools and lecture videos
Here is also a great free book on multivariate statistics by Marden, primarily concerned with the normal linear model linked on this page:
- 2$\begingroup$ How do I shrink the picture? :) $\endgroup$Richard Hardy– Richard Hardy2020-04-13 08:11:42 +00:00Commented Apr 13, 2020 at 8:11
- $\begingroup$ on the image file if you add some whitespace it will shrink and fit to width. Alternatively, you may use a lower resolution image. $\endgroup$VIBGYOR– VIBGYOR2020-07-23 17:46:21 +00:00Commented Jul 23, 2020 at 17:46
- $\begingroup$ Use ImageMagick. E.g.,
convert xxx -density 600 -resize 25% xxx. $\endgroup$chl– chl2020-11-27 20:02:48 +00:00Commented Nov 27, 2020 at 20:02 - $\begingroup$ @chl, thanks. I was looking for a built-in solution. Otherwise there are multiple services to choose from. I use FastStone Photo Resizer every now and then. $\endgroup$Richard Hardy– Richard Hardy2020-11-27 20:58:36 +00:00Commented Nov 27, 2020 at 20:58
- $\begingroup$ No built-in skrinking feature, AFAIK. +1, BTW, this was a very nice free update from the authors of this memorable textbook. $\endgroup$chl– chl2020-11-27 21:22:39 +00:00Commented Nov 27, 2020 at 21:22
It's not a textbook but Bayesian Methods in the Search for the MH370 is a great introduction to particle filters.
S. Davey, N. Gordon, I. Holland, M. Rutten, and J. Williams, Bayesian Methods in the Search for MH370 (2016)
A digital textbook on probability and statistics by M. Taboga can be found at https://www.statlect.com The level is intermediate. It has hundreds of solved exercises and examples, as well as step-by-step proofs of all the results presented.
For an introduction to the statistical analysis of networks, Statistical Analysis of Networks by Konstantin Avrachenkov and Maximilien Dreveton. The paper version isn't free, but the PDF version is. It is published under a Creative Commons By-NC licence.









