We show that Entropy-SGD (Chaudhari et al., 2017), when viewed as a learning algorithm, optimizes a PAC-Bayes bound on the risk of a Gibbs (posterior) classifier, i.e., a randomized classifier obtained by a risk-sensitive perturbation of the weights of a learned classifier. Entropy-SGD works by optimizing the bound's prior, violating the hypothesis of the PAC-Bayes theorem that the prior is chosen independently of the data. Indeed, available implementations of Entropy-SGD rapidly obtain zero training error on random labels and the same holds of the Gibbs posterior. In order to obtain a valid generalization bound, we rely on a result showing that data-dependent priors obtained by stochastic gradient Langevin dynamics (SGLD) yield valid PAC-Bayes bounds provided the target distribution of SGLD is $\epsilon$-differentially private. We observe that test error on MNIST and CIFAR10 falls within the (empirically nonvacuous) risk bounds computed under the assumption that SGLD reaches stationarity. In particular, Entropy-SGLD can be configured to yield relatively tight generalization bounds and still fit real labels, although these same settings do not obtain state-of-the-art performance.

In this paper, we examine the emulation of non-linear deterministic computer codes where the output is a time series, possibly multivariate. Such computer models simulate the evolution of some real-world phenomena over time, for example models of the climate or the functioning of the human brain. The models we are interested in are highly non-linear and exhibit tipping points, bifurcations and chaotic behaviour. Each simulation run is too time-consuming to perform naive uncertainty quantification. We therefore build emulators using Gaussian processes to model the output of the code. We use the Gaussian process to predict one-step ahead in an iterative way over the whole time series. We consider a number of ways to propagate uncertainty through the time series including both the uncertainty of inputs to the emulators at time t and the correlation between them. The methodology is illustrated with a number of examples. These include the highly non-linear dynamical systems described by the Lorenz and Van der Pol equations. In both cases we will show that we not only have very good predictive performance but also have measures of uncertainty that reflect what is known about predictability in each system.

In a few years time the Droids from Star Wars are going to seem like relics. Today's robots might be better suited for sewing clothes and building cars, but tomorrow's could be as indispensable and ubiquitous as our smartphones are. A group of researchers in Europe recently published a white paper unveiling their experiments in teaching robots to anticipate human movements. The team's work, to create "robots that can predict human actions and intent, and understand human non-verbal cues," could pave the way for innumerable advances in the field. The researchers focused on combining previous research teaching AI to understand human gaze and pose, both of which are crucial for robots to understand in order for them to work with humans.

A team at Quid wrote an analysis on 5 innovation hotspots outside the U.S. which was published on the World Economic Forum. Using Quid, we found London, Paris, Singapore, Munich, and Tel Aviv to be five innovation hotspots and examined what makes them so attractive to entrepreneurs. To do this we analysed every company that has received funding in the last 10 years across these five hotspots. We then used Quid's artificial intelligence (AI) and Natural Language Processing (NLP) to "read" the business descriptions of the companies in order to segment each market by theme and derive further insights into the fastest growing segments, the largest exits and the top investors. We also interviewed Tech Pioneers, members of the World Economic Forum's global community of trailblazing companies, who are based in these hotspots.

He started his talk with a broader philosophical statement: "Anything is possible." Referring to SpaceX and Tesla as the most cutting edge companies he has funded, he continued, "The future of technology that we couldn't imagine 15–20 years ago is obviously now possible. There is no doubt that the future of cars will be electric and autonomous. He then reflected on the SpaceX story. "I remember Elon came back from Russia very disappointed with the realization that there is a very weird supply chain in this industry.

Being smart and talented isn't enough to make you successful, according to new research. The world's most successful people are simply the luckiest, a simulation of a thousand 40-year careers shows. While we know luck plays a role in success, scientists say that up until now its influence has been widely underestimated. Being smart and talented isn't enough to make you successful, according to new research. The world's most successful people are simply the luckiest (stock image) Previous research has shown that top performers are often the luckiest people, who have benefited from rich-get-richer dynamics that boost their initial fortune.

Internet giants Google, Facebook and Twitter are facing renewed pressure to tackle the problem of terrorist propaganda online after the European Commission (EC) gave them just a one hour deadline to remove offensive content from their pages or face penalties. The EC's demand comes at a time when the major search and social media companies are being urged to do more to censor inappropriate or illegal material posted by users and hosted on their domains. "Considering that terrorist content is most harmful in the first hours of its appearance online, all companies should remove such content within one hour from its referral as a general rule," the EC said in a statement. The commission will also ask companies to report back on the degree of co-operation they receive from other organisations in order to determine whether stricter legislation is necessary. Most online media companies have clear rules in place warning users against publishing hate speech and routinely investigate and remove troubling content as soon as it is reported by users.

A thriving super colony of some 1.5 million Adelie penguins has been discovered on the remote Danger Islands in the east Antarctic, surprised scientists announced. Just 100 miles (160 kilometres) away in the west Antarctic, the same species is in decline due to sea ice melt blamed on global warming, they said. The first complete census revealed that the Danger Islands host more than 750,000 breeding pairs of Adelie penguins, more than the rest of the Antarctic Peninsula region combined, the team reported. It included the third and fourth-largest Adelie penguin colonies in the world. A thriving super colony of some 1.5 million Adelie penguins has been discovered on the remote Danger Islands in the east Antarctic, surprised scientists announced.

The UK games market broke the £5bn sales mark for the first-time last year as Nintendo's new hybrid Switch console boomed and virtual reality headsets flew off the shelves. Gaming fans forked out £5.11bn on consoles, games, hardware such as headsets and attending events – a 12.4% year-on-year rise – as the sector defied a wider downturn in consumer spending. Trade body Ukie said that there has been a "renaissance" in games consoles as Nintendo's hybrid home console-meets-handheld device proved as popular in the UK as it has globally. Console sales, including the PS4 Pro and Xbox One X, grew 30% to £659m, reversing a sales decline since 2014. "It is clear that the console gaming market is now enjoying a renaissance," said Dorian Bloch, director, entertainment at GfK. "Nintendo's Switch has enjoyed the best [sales] start for a Nintendo home console since the mighty Wii back in 2006."

To meet its goal in empowering patients to achieve better health outcomes and improve medication adherence, London-based Amiko Digital Health Ltd. is developing advanced sensor technologies and Artificial Intelligence-powered mobile health products. Earlier this month, Amiko and supplier Sanner presented their cooperation for the development of "smart" add-ons for inhaled drug delivery systems at Pharmapack Europe. Sanner Ventures, parent company of Sanner GmbH, is supporting Amiko with a strategic investment in which funds will be used to expand Amiko's flagship product, the Respiro platform, a respiratory disease management tool. Amiko CEO and Co-Founder Duilio Macchi says, "With Sanner, we have found the ideal partner for the integration of our technology. Sanner has the expertise in plastic primary packaging solutions and drug delivery systems. We have the know-how in sensor technology and AI. By incorporating our sensors in new packaging systems and customized add-ons we will jointly help pharmaceutical companies to provide patients with digital solutions beyond the pill."