Media
r/MachineLearning - [D] Researchers: Are we on the cusp of an 'AI winter'?
The'big breakthrough' for vision was in 2012. We're still working on it, though it has spawned very useful technological solutions. BERT and similar models really hit the big time 1 1/2 years ago, and we've barely scratched the surface. Text is (IMHO) even bigger than images. So it's going to be 8 years before we've extracted all the goodness out of that.
Reformer: The Efficient Transformer
Kitaev, Nikita, Kaiser, ลukasz, Levskaya, Anselm
Large Transformer models routinely achieve state-of-the-art results on a number of tasks but training these models can be prohibitively costly, especially on long sequences. We introduce two techniques to improve the efficiency of Transformers. Furthermore, we use reversible residual layers instead of the standard residuals, which allows storing activations only once in the training process instead of N times, where N is the number of layers. The resulting model, the Reformer, performs on par with Transformer models while being much more memory-efficient and much faster on long sequences. The Transformer architecture (V aswani et al., 2017) is widely used in natural language processing and yields state-of-the-art results on a number of tasks. To obtain these results, researchers have resorted to training ever larger Transformer models. The number of parameters exceeds 0.5B per layer in the largest configuration reported in (Shazeer et al., 2018) while the number of layers goes up to 64 in (Al-Rfou et al., 2018). Transformer models are also used on increasingly long sequences.
Mining Changes in User Expectation Over Time From Online Reviews
Hou, Tianjun, Yannou, Bernard, Leroy, Yann, Poirson, Emilie
Customers post online reviews at any time. With the timestamp of online reviews, they can be regarded as a flow of information. With this characteristic, designers can capture the changes in customer feedback to help set up product improvement strategies. Here we propose an approach for capturing changes of user expectation on product affordances based on the online reviews for two generations of products. First, the approach uses a rule-based natural language processing method to automatically identify and structure product affordances from review text. Then, inspired by the Kano model which classifies preferences of product attributes in five categories, conjoint analysis is used to quantitatively categorize the structured affordances. Finally, changes of user expectation can be found by applying the conjoint analysis on the online reviews posted for two successive generations of products. A case study based on the online reviews of Kindle e-readers downloaded from amazon.com shows that designers can use our proposed approach to evaluate their product improvement strategies for previous products and develop new product improvement strategies for future products.
Joint Reasoning for Multi-Faceted Commonsense Knowledge
Chalier, Yohan, Razniewski, Simon, Weikum, Gerhard
Commonsense knowledge (CSK) supports a variety of AI applications, from visual understanding to chatbots. Prior works on acquiring CSK, such as ConceptNet, have compiled statements that associate concepts, like everyday objects or activities, with properties that hold for most or some instances of the concept. Each concept is treated in isolation from other concepts, and the only quantitative measure (or ranking) of properties is a confidence score that the statement is valid. This paper aims to overcome these limitations by introducing a multi-faceted model of CSK statements and methods for joint reasoning over sets of inter-related statements. Our model captures four different dimensions of CSK statements: plausibility, typicality, remarkability and salience, with scoring and ranking along each dimension. For example, hyenas drinking water is typical but not salient, whereas hyenas eating carcasses is salient. For reasoning and ranking, we develop a method with soft constraints, to couple the inference over concepts that are related in in a taxonomic hierarchy. The reasoning is cast into an integer linear programming (ILP), and we leverage the theory of reduction costs of a relaxed LP to compute informative rankings. This methodology is applied to several large CSK collections. Our evaluation shows that we can consolidate these inputs into much cleaner and more expressive knowledge. Results are available at https://dice.mpi-inf.mpg.de.
Gerd Leonhard
This is my brand-new film on the future of work, jobs and education. Find out more at http://www.howthefuturework... (and download the film for offline viewing, if desired). Are you excited, or are you worried? The next 20 years will bring more change than the previous 300 years. Technology is rebooting the very idea of work, how we work, when we work, where we work, and sooner or later why we work.
Warner Bros. will now determine vision dates with artificial intelligence - Somag News
Warner Bros. their managers will now get the analytical information they need when deciding on the vision history of a film through artificial intelligence algorithms, and then reach the final conclusion. Artificial intelligence, which has taken steps in many areas of our lives, has started to show itself in different subjects as well. He will soon look at the assessment of artificial intelligence algorithms in determining the vision history of a film. It will help The famous film production and distribution company will use the artificial intelligence project management system developed by Cinelytic. The goal here is to prevent the executives from re-performing and depriving them of what is considered to be a low value for each film.
Deepfakes: Informed digital citizens are the best defense against online manipulation
More than a decade ago, Internet analyst and new media scholar Clay Shirky said: "The only real way to end spam is to shut down e-mail communication." Will shutting down the Internet be the only way to end deepfake propaganda in 2020? Today, anyone can create their own fake news and also break it. Online propaganda is more misleading and manipulative than ever. Deepfakes, a specific form of disinformation that uses machine-learning algorithms to create audio and video of real people saying and doing things they never said or did, are moving quickly toward being indistinguishable from reality.
Dating sites, political ads, Fire TV and more: Tech Q&A
Kim Komando has all the answers about dating sites, political ads, Fire TV and more. Each week, I receive tons of questions from my listeners about tech concerns, new products and all things digital. Sometimes, choosing the most interesting questions to highlight is the best part of my job. This week, I received questions about whether any old tech is worth money to collectors, dating online, the Fire Stick, political ads and whether I shut down my app. Do you have a question you'd like to ask me?