We review the Metropolis algorithm -- a simple Markov Chain Monte Carlo (MCMC) sampling method -- and its application to estimating posteriors in Bayesian statistics. A simple python example is provided. Follow @efavdb Follow us on twitter for new submission alerts! One of the central aims of statistics is to identify good methods for fitting models to data. Notice that if we could solve for this function, we would be able to identify which parameter values are most likely -- those that are good candidates for a fit.

The full code is available as an IPython notebook on github. Assuming a multivariate normal distribution for the residuals in linear regression allows us to construct test statistics and therefore specify uncertainty in our fits. A t-test judges the explanatory power of a predictor in isolation, although the standard error that appears in the calculation of the t-statistic is a function of the other predictors in the model. On the other hand, an F-test is a global test that judges the explanatory power of all the predictors together, and we've seen that parsimony in choosing predictors can improve the quality of the overall regression. We've also seen that multicollinearity can throw off the results of individual t-tests as well as obscure the interpretation of the signs of the fitted coefficients. A symptom of multicollinearity is when none of the individual coefficients are significant but the overall F-test is significant.

Does your company suffer from corporate amnesia? Palo Alto, California-based startup Maana has developed a cure for what ails organizations everywhere: Knowledge of how to perform a certain task or make a specific decision walks out the door with employees migrating to another job or retiring. Even when this tacit knowledge is captured, codified and stored in a database, it may not be accessible to the people who need it, when they need it. "We patented a unique and novel way of indexing and organizing the knowledge that is locked in data silos across the organization," says founder and CEO Babur Ozden. Today, Maana released a new version of its AI-driven platform.

Forget everything you know about Microsoft's Tay chatbot. It was a disaster, it didn't work, the researchers behind it have likely all been fired or reassigned. In truth, it was a test of the Microsoft natural language processing algorithms, and it didn't pass the test. Plus, Tay was never intended as something that proved Microsoft's prowess with A.I. It was a mere consumer test, a minimal entry in their grand A.I. scheme. You know what the company is really planning to do with A.I.? Look no further than the Microsoft Office MyAnalytics dashboard, a free add-on for companies that use the advanced E5 plan for Office 365.

Like so much in Britain, you can credit the weather for this. Ocado has rolled out AI using Google's open-source TensorFlow to improve service at its customer call centre. The online food retailer took six months to build and install a system based on machine learning., using Python, C, Kubernetes on Google Compute with TensorFlow. The cloud-based AI will do the heavy lifting for inbound customer emails, opening and scanning for key words and context, before prioritising and forwarding them. On an ordinary day the system handles 2000 messages and double that at busy times such as Christmas.

Since the human genome was successfully mapped in 2003, researchers have been making use of technology to organise the growing mountain of genomics data into a form that will eventually benefit actual patients. When he unveiled the Precision Medicine Initiative in 2015, US president Barack Obama recognised the potential that technology and gene mapping can bring to patients. His state of the union address laid out a vision for the groundbreaking initiative: "Doctors have always recognised that every patient is unique, and doctors have always tried to tailor their treatments as best they can to individuals. You can match a blood transfusion to a blood type - that was an important discovery. What if matching a cancer cure to our genetic code was just as easy, just as standard?"

Artificial intelligence (AI) has been around for a long time and people are still waiting for the first C-3PO (a talking robot from Star Trek) to be released. Looking at the money big tech companies and venture capitalists are pouring into the sector, AI is making huge progress, although the investors are looking for different things than a talking robot. "In the long run, I think we will evolve in computing from a mobile-first to an AI-first world. And I do think we're at the forefront of developments," said Sundar Pichai, CEO of Google, Inc. on an earnings call with investors in April. Google is the most active investor in AI with 9 acquisitions completed since 2011.

I am from Budapest, Hungary. I am qualified as a physicist and later on I decided to get a master degree in applied mathematics. At the moment I am working as a simulation engineer at a multinational company. I have been interested in algorithms and data structures and its implementations especially in Java since university. Later on I got acquainted with machine learning techniques, artificial intelligence, numerical methods and recipes such as solving differential equations, linear algebra, interpolation and extrapolation.

The Hidden Markov Model or HMM is all about learning sequences. A lot of the data that would be very useful for us to model is in sequences. Stock prices are sequences of prices. Language is a sequence of words. Credit scoring involves sequences of borrowing and repaying money, and we can use those sequences to predict whether or not you're going to default.

Thank you for making time to take this brief insideHPC / insideBIGDATA audience survey on AI / Machine Learning and Deep Learning. Your feedback and insights are important to helping us develop a better resource for professionals interested in these topics. We'll keep this very short and we will be publishing a free report so you can request a copy at the end of the survey! Oh yeah, there is an opportunity to win a cool new pair Bose Wireless Noise Cancellation Headphones, so if you want to be included in the'optional' sweepstakes you'll have the option to include your email address at the end of the survey (don't worry we never sell or rent your email address).