Media
r/MachineLearning - [1909.11150] Exascale Deep Learning for Scientific Inverse Problems (500 TB dataset)
Abstract: We introduce novel communication strategies in synchronous distributed Deep Learning consisting of decentralized gradient reduction orchestration and computational graph-aware grouping of gradient tensors. These new techniques produce an optimal overlap between computation and communication and result in near-linear scaling (0.93) of distributed training up to 27,600 NVIDIA V100 GPUs on the Summit Supercomputer. We demonstrate our gradient reduction techniques in the context of training a Fully Convolutional Neural Network to approximate the solution of a longstanding scientific inverse problem in materials imaging. The efficient distributed training on a dataset size of 0.5 PB, produces a model capable of an atomically-accurate reconstruction of materials, and in the process reaching a peak performance of 2.15(4) EFLOPS$_{16}$.
What Is AI Strategy? How To Integrate It In Your Organisation?
Artificial Intelligence (AI) has slowly made its way into the business world and has changed its landscape considerably. The technology has the potential to completely revolutionise the way businesses function. It is a broad concept which is generally perceived as being limited to the use of humanoid robots due to its depiction in Hollywood movies. However, there is more to AI than just highly intelligent robots. It encompasses any technique which allows the computer to imitate human intelligence.
Dotscience Announces Upcoming Speaking Sessions on Chaos and Pain in Machine Learning and the 'DevOps for ML Manifesto'
Dotscience, the pioneer in DevOps for machine learning (ML), today announced its schedule of presentations at upcoming industry events through the end of 2019. Dotscience will be exhibiting its DevOps for ML platform, which provides collaborative, end-to-end ML data and model management. Dotscience helps simplify, accelerate and control AI and ML models through the entire model development lifecycle. Dotscience makes it possible for ML engineering to be just as simple, fast and safe as modern software engineering when using DevOps techniques. The company sees a parallel between the challenges of software development in the 1990s and the current state of ML model management today.
Why Every Company Needs An Artificial Intelligence (AI) Strategy For 2019
If you haven't heard of them yet, you soon will. ByteDance product TikTok was one of the most downloaded apps of 2018. Another ByteDance product is Toutiao, which, thanks to its combination of search engine, news and social media, is often referred to as'Buzzfeed with Brains'. Unlike Facebook and other social media platforms, Toutiao doesn't generate news feed content for its users based on who they're following; it uses AI to display a continuous stream of content that's based on what the platform believes that user wants. In other words, it gets to know you as a user and recommends content based on what it believes you like and don't like.
AI to compose classical music live in concert โ with over 100 musicians
A visionary performance in Armenia will feature a live, AI-composed orchestral score, performed by musicians from around the world. The World Congress of Information Technology (WCIT) has announced that it will be hosting its first concert to be composed entirely by artificial intelligence. The innovative outdoor concert takes place in Armenia as part of the organisation's opening ceremony, and will be performed by the'World Orchestra'. Specially formed for the event, the orchestra has been made up of more than 100 professional musicians โ including 75 from orchestras in the 14 countries that previously hosted WCIT, and 30 from the Armenia State Symphony Orchestra. The unique ensemble will be led by Sergey Smbatyan, a virtuoso violinist and Principal Conductor of the Armenian State Symphony Orchestra, who also came up with the idea for the show.
How Spotify knows what music you like (hint: with machine learning)
Just two decades ago, if you wanted to discover new artists and bands to listen to, you had to go to to your local music store to rummage through the heaps of CDs or wait for your favourite music TV show to start. With the rise of the internet, you spent hours searching, downloading songs and meticulously creating your dance summer hits playlists. But today we like to get our music just like all other information โ with one touch or click. You just tap your Spotify app and dive in the endless choice of tracks. Spotify has revolutionised the way we discover music in the digital era.
Can a computer fool you into thinking it is human?
Robert Epstein was looking for love. The year being 2006, he was looking online. As he recounted in the journal Scientific American Mind, he began a promising email exchange with a pretty brunette in Russia. Epstein was disappointed - he wanted more than a penfriend, let's be frank - but she was warm and friendly. Soon she confessed she was developing a crush on him.
TriMap: Large-scale Dimensionality Reduction Using Triplets
Amid, Ehsan, Warmuth, Manfred K.
B M ORE V ISUALIZATIONS We compare the results of TriMap to LargeVis in Figure 7 and 8. We also provide more visualizations obtained using TriMap in Figure 9. C D ISCUSSION We briefly discuss the results of TriMap and draw a comparison to the other methods. TriMap generally provides better global accuracy compared to the competing methods. It also successfully maintains the continuity of the underlying manifold. This can be seen from the COIL-20 result where certain clusters are located farther away from the remaining clusters. However, the underlying structure for the main cluster resembles the one provided by the other methods. TriMap also preserves the continuous structure in the Fashion MNIST and the TV News datasets. TriMap is also efficient in uncovering the possible outliers in the data. For instance, PCA reveals a large number of outliers in the Tabula Muris and the 360 K Lyrics datasets.
Amazon Is Making it Easier to Delete Your Alexa Recordings
Inc. defended the privacy features of its Alexa digital assistant -- and introduced some new tools to reassure users โ following months of debate about the practices of the technology giant and its largest competitors. The company plans to roll out a feature that lets users of the Alexa voice-based assistant automatically delete their verbal recordings regularly, on a rolling three-month and 18-month basis. Previously, Alexa users had to manually delete their stored voice recordings on a companion website. "We care about this," Dave Limp, the leader of Amazon's devices and services business, said of privacy during a press event at the company's headquarters in Seattle. "Privacy is absolutely foundational to everything that we do in and around Alexa."
What's Amazon planning to reveal โ Alexa in the ear?
Is there a wireless earbud that answers to the name Alexa in your future? Amazon is staging an event Wednesday in Seattle to introduce its fall lineup of devices. At last year's event, Amazon introduced 70 products, including updates to the Echo speaker line, a microwave that answered to Alexa and a DVR for cord-cutters. This year, CNBC reported, an Alexa earbud could top the list. Apple dominates the earbuds market with the help of Siri.