training


5 steps to prepare your company for the AI revolution

#artificialintelligence

The practical benefits of automation are many: fewer data-entry errors, faster customer service response times, workload automation, better resource management, and the ability to turn legacy data into powerful insights. But recent advances in AI and natural language processing have made chatbots more capable of delivering customer service. Open dialogue and healthy conflict resolution will prove essential as employees collaborate on increasingly challenging questions. As AI and other automation technologies mature into transformative products, it's critical your company is working from a well-crafted plan for how to take advantage of the opportunities.


Hate speech detection with machine learning -- a guest post from Futurice

#artificialintelligence

In addition we chose to test Support Vector Machine (SVM) and Random Forest (RF), because they tend to perform very well in the most challenging tasks. We tested Bag-of-Words (BOW) and FastText (FT) (Word embeddings) feature extraction methods and Gaussian Naive Bayes (GNB), Random Forest (RF) and Support Vector Machines (SVM) machine learning methods. Based on the experiment, we chose a feature extraction and machine learning method to train a model for hate speech detection. At first, we downloaded social media messages from a previous day, then predicted hate speech (scored each message) and stored the result in a CSV file.


Using Azure Data Lake and R for Fraud Detection

#artificialintelligence

The advantage of processing data using Azure Data Lake Analytics (ADLA) comes from the unique characteristics of U-SQL, a big data query language that combines SQL-like declarative benefits with the expressiveness and extensibility of C#. This document uses the example of online purchase transactions to demonstrate a basic 3-step process in fraud detection: feature engineering, training, and scoring. To evaluate the model, we can split the dataset into training and testing sets, train a model using the training set, and then evaluate the model's performance using metrics such as accuracy or AUC on the test set. With Azure Data Lake Analytics, AI engineers and data scientists can easily enable their machine learning solutions on petabyte-scale infrastructure instantly, without having to worry about cluster provision, management, etc., and the code can automatically be parallelized for the scale they need.


Why it's time for CIOs to invest in machine learning

#artificialintelligence

To Olley, machine learning fills a gap in technology that has existed for a long time: solving complex problems with pattern recognition. "With the majority of Elsevier's revenue coming from technology-based products and services, we started using machine learning in our commercial products, but it's equally applicable to internal IT platforms," Olley says. As part of the executive teams within RBI and Elsevier, Dan continues to drive organic online product growth across the portfolio. Prior to RELX Group, Dan held technology and product management leadership roles with GM Financial, Wunderman Cato Johnson, and IBM, as well as a number of software organizations in the United Kingdom and other international locales.


Variance, Clustering, and Density Estimation Revisited

@machinelearnbot

In some cases, it could be just 0 or 1, with 1 meaning that there is a training set data point close to the location in question in the grid, 0 meaning that you are far enough away from any neighbor. To compute density estimates on each cell of the grid, draw a 3x3 window around each yellow cell, and add 1 to all locations (cells) in that 3x3 window. In our example, the number of groups (g 3: low risk, medium risk, high risk of default) will be multiplied by 2 (M / F) x 3 (young / medium / old), resulting in 18 groups, for instance "young females with medium risk of default" being one of these 18 groups. Of course, accessing a cell in the grid (represented by a 2-dim array), while extremely fast and not depending on the number of observations, still requires a tiny bit of time, but it is entirely dependent only on the size of the array, and its dimension.


UC Berkeley Releases Massive Dex-Net 2.0 Dataset

IEEE Spectrum Robotics Channel

The dataset consists of 6.7 million point object point clouds, accompanying parallel-jaw gripper poses, along with a robustness estimate of how likely it is that the grasp will be able to lift and carry the object, and now you can use it to train your own grasping system. Instead, Dex-Net 2.0 relies on "a probabilistic model to generate synthetic point clouds, grasps, and grasp robustness labels from datasets of 3D object meshes using physics-based models of grasping, image rendering, and camera noise." In other words, Dex-Net 2.0 leverages cloud computing to rapidly generate a large training set for a CNN, in "a hybrid of well-established analytic methods from robotics and Deep Learning," as Goldberg explains: The key to Dex-Net 2.0 is a hybrid approach to machine learning Jeff Mahler and I developed that combines physics with Deep Learning. Mahler: With the release we hope that other roboticists can replicate our training results to facilitate development of new architectures for predicting grasp robustness from point clouds, and to encourage benchmarking of new methods.


Sorting Lego sucks, so here's an AI that does it for you

#artificialintelligence

You see, Mattheij decided he wanted in on the profitable cottage industry of online Lego reselling, and after placing a bunch of bids for the colorful little blocks on eBay, he came into possession of 2 tons (4,400 pounds) of Lego -- enough to fill his entire garage. As Mattheij explains in his blog post, resellers can make up to €40 ($45) per kilogram for Lego sets, and rare parts and Lego Technic can fetch up to €100 ($112) per kg. Instead of spending an eternity sifting through his own, intimidatingly large collection, Mattheij set to work on building an automated Lego sorter powered by a neural network that could classify the little building blocks. "By the end of two weeks I had a training data set of 20,000 correctly labeled images."


State-of-the-Art Machine Learning Automation with HDT

@machinelearnbot

In its simplest form, our particular problem consists of analyzing historical data about articles and blog posts, to identify features (also called metrics or variables) that are good predictors of blog popularity when combined together, to build a system that can predict the popularity of an article before it gets published. As we have seen in the previous section, the problem consists of predicting pv, the logarithm of unique page views for an article (over some time period), as a function of keywords found in the title, and whether the article in question is a blog or not. Some nodes have a far larger volatility, for instance when one of the keywords has different meanings, such as the word "training", in "training deep learning" (training set) versus "deep learning training" (courses.) It involves training sets, cross-validation, feature selection, binning, and populating hash tables of key-value pairs (referred to here as the nodes).


Inside the black box: Understanding AI decision-making ZDNet

#artificialintelligence

Neural networks, machine-learning systems, predictive analytics, speech recognition, natural-language understanding and other components of what's broadly defined as'artificial intelligence' (AI) are currently undergoing a boom: research is progressing apace, media attention is at an all-time high, and organisations are increasingly implementing AI solutions in pursuit of automation-driven efficiencies. Neural networks are a particular concern not only because they are a key component of many AI applications -- including image recognition, speech recognition, natural language understanding and machine translation -- but also because they're something of a'black box' when it comes to elucidating exactly how their results are generated. This'black box' problem was addressed in a recent paper from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL), which examined neural networks trained on text-based data using a system comprising two modules -- a'generator' and an'encoder'. Many people -- including Stephen Hawking, Elon Musk and leading AI researchers -- have expressed concerns about how AI might develop, leading to the creation of organisations like Open AI and Partnership on AI aimed at avoiding potential pitfalls.


Getting Started with Predictive Maintenance Models - Silicon Valley Data Science

@machinelearnbot

We are also provided with a training set of full run-to-failure data for a number of engines and a test set with truncated engine data and their corresponding RUL values. One way of addressing this is to look at the distribution of sensor values in "healthy" engines, and compare it to a similar set of measurements when the engines are close to failure. The figure above shows the distribution of the values of a particular sensor (sensor 2) for each engine in the training set, where healthy values (in blue) are those taken from the first 20 cycles of the engine's lifetime and failing values are from the last 20 cycles. In blue are the values of a particular sensor (sensor 2 in this case) plotted against the true RUL value at each time cycle for the engines in the training set.