Markov Chain Monte Carlo based Bayesian data analysis has now become the method of choice for analyzing and interpreting data in almost all disciplines of science. In astronomy, over the last decade, we have also seen a steady increase in the number of papers that employ Monte Carlo based Bayesian analysis. New, efficient Monte Carlo based methods are continuously being developed and explored. In this review, we first explain the basics of Bayesian theory and discuss how to set up data analysis problems within this framework. Next, we provide an overview of various Monte Carlo based methods for performing Bayesian data analysis.

Here is the course link. Bayesian data analysis is an approach to statistical modeling and machine learning that is becoming more and more popular. It provides a uniform framework to build problem specific models that can be used for both statistical inference and for prediction. This course will introduce you to Bayesian data analysis: What it is, how it works, and why it is a useful tool to have in your data science toolbox. This chapter will introduce you to Bayesian data analysis and give you a feel for how it works.

It's impossible to collect all the relevant data to answer any particular question, so there is necessarily uncertainty in our analysis. As such, we need to quantify the uncertainty and from that judge our results. Traditional statistical methods (also called frequentist methods) such as hypothesis testing and confidence intervals often don't address this appropriately. For example, we typically want to know the probability that a parameter falls in some range, but this type of analysis is unavailable from a frequentist perspective. Developing a statistical model with frequentist methods is often out of reach for typical data analysts so they are left asking "What test do I apply to this data?"

There is much debate among scholars and practitioners about what data science is, and what it isn't. Does it deal only with big data? Is data science really that new? How is it different from statistics and analytics? One way to consider data science is as an evolutionary step in interdisciplinary fields like business analysis that incorporate computer science, modeling, statistics, analytics, and mathematics.

"The second edition was reviewed in JASA by Maiti (2004) … we now stand 10 years later with an even more impressive textbook that truly stands for what Bayesian data analysis should be. Quite a lot … this is truly the reference book for a graduate course on Bayesian statistics and not only Bayesian data analysis." Praise for the Second Edition: … it is simply the best all-around modern book focused on data analysis currently available. The second edition makes this an even more robust choice. I am thoroughly excited to have this book in hand to supplement course material and to offer research collaborators and clients at our consulting lab more sophisticated methods to solve their research problems.

Bayesian methods can be used in general data-analytic models, in psychometric models, and in models of mind. In all three applications, there is Bayesian estimation of parameter values in a model. What differs between models is the source of the data and the meaning (semantic referent) of the parameters, as described in the diagram below: As an example of a generic data-analytic model, consider data about ice cream sales and sleeve lengths, measured at different times of year. A linear regression model might show a negative slope for the line that describes a trend in the scatter of points. But the slope does not necessarily describe anything in the processes that generated the ice cream sales and sleeve lengths.

Bayesian data analysis is cool, Markov chain Monte Carlo is the cool technique that makes Bayesian data analysis possible, and wouldn't it be coolness if you could do all of this in the browser? That was what I thought, at least, and I've now made bayes.js: A small JavaScript library that implements an adaptive MCMC sampler and a couple of probability distributions, and that makes it relatively easy to implement simple Bayesian models in JavaScript. Well, you can do that right now by clicking "Start sampling" below! This will run an MCMC sampler in your browser implemented in JavaScript.