Goto

Collaborating Authors

 Deep Learning


Endotracheal Tube Position Assessment on Chest Radiographs Using Deep Learning

#artificialintelligence

"Just Accepted" papers have undergone full peer review and have been accepted for publication in Radiology: Artificial Intelligence. This article will undergo copyediting, layout, and proof review before it is published in its final version. Please note that during production of the final copyedited article, errors may be discovered which could affect the content. To determine the efficacy of deep learning in assessing endotracheal tube (ETT) position on radiographs. Images were split into training (80%, 18368 images), validation (10%, 2296 images), and'internal test' (10%, 2296 images), derived from the same institution as the training data.


A Brief History of Deep Learning Frameworks

#artificialintelligence

The past decade has seen a burst of algorithms and applications in machine learning especially deep learning. Behind the burst of these deep learning algorithms and applications are a wide variety of deep learning tools and frameworks. They are the scaffolding of the machine learning revolution: the widespread adoption of deep learning frameworks like TensorFlow and PyTorch enabled many ML practitioners to more easily assemble models using well-suited domain-specific languages and a rich collection of building blocks. Looking back at the evolution of deep learning frameworks we can clearly see a tightly coupled relationship between deep learning frameworks and deep learning algorithms. The concept of neural networks have been around for a while. Before the early 2000s, there were a handful of tools that can be used to describe and develop neural networks.


Yet Another Library for Deep Learning You Should Know About

#artificialintelligence

It has many algorithms, supports sparse datasets, is fast and has many utility functions, like cross-validation, grid search, etc. When it comes to advanced modeling, scikit-learn many times falls shorts. If you need Boosting, Neural Networks or t-SNE, it's better to avoid scikit-learn. While MLPClassifier and MLPRegressor have a rich set of arguments, there's no option to customize layers of a Neural Network (beyond setting the number of hidden units for each layer) and there's no GPU support. While there are already superior libraries available like PyTorch or Tensorflow, scikit-neuralnetwork may be a good choice for those coming from a scikit-learn ecosystem.


Everything Product People Need to Know About Transformers, GPT-3, and HuggingFace (

#artificialintelligence

This is Part 1in the 3 Part Series on Transformers for Product People. Natural language processing (NLP) has passed an industry-changing inflection point. More than 20 long standing NLP challenges have been solved with near-human results in the past year, all by a single model: the attention-based transformer. This model was developed and published in December 2017, and has since kicked off an arms race between Google and OpenAI, with both labs shattering state of the art results with each new model release. With models like GPT-3 making a splash in the media, decision makers are wondering just how big this development is.


Is deep learning a new kind of programming?

#artificialintelligence

This site is hosted on GitHub and is generated using F# Formatting and DotLiquid. For more info, see the website source on GitHub. Please submit issues & corrections on GitHub.


MIT's Introduction to Deep Learning: A Free Online Course

#artificialintelligence

MIT has posted online its introductory course on deep learning, which covers applications to computer vision, natural language processing, biology, and more. Students "will gain foundational knowledge of deep learning algorithms and get practical experience in building neural networks in TensorFlow." Experience in Python is helpful but not necessary. The first lecture appears above. The rest of the course materials (videos & slides) can be found here.


Artificial Intelligence, Deep Learning, and Machine Learning

#artificialintelligence

"The coming era of Artificial Intelligence will not be the era of war, but be the era of deep compassion, non-violence, and love." My first interest in artificial intelligence came around with my addiction to video games. It was beautiful to see the depth of these non-player characters and how their personalities came to life within the game. The only problem was that these characters were programmed to say specific lines of dialogue and act in a pre-programmed type of way. All of them didn't have a mind of their own -- for the most part.


Honey I Shrunk the Model: Why Big Machine Learning Models Must Go Small

#artificialintelligence

Bigger is not always better for machine learning. Yet, deep learning models and the datasets on which they're trained keep expanding, as researchers race to outdo one another while chasing state-of-the-art benchmarks. However groundbreaking they are, the consequences of bigger models are severe for both budgets and the environment alike. For example, GPT-3, this summer's massive, buzzworthy model for natural language processing, reportedly cost $12 million to train. What's worse, UMass Amherst researchers found that the computing power required to train a large AI model can produce over 600,000 pounds of CO2 emissions – that's five times the amount of the typical car over its lifespan.


How to ensure An 'AI for Good' Project is Actually Good

#artificialintelligence

Artificial intelligence (AI) has been at the front and centre during the COVID-19 pandemic. The global pandemic has pushed governments and private organisations globally to propose AI solutions for everything from analysing cough sound to installing disinfecting robots in hospitals. Such efforts are part of a broader trend that has been picking up momentum- the deployment of projects by companies, governments, universities, and research institutes aiming to use AI for societal good. The goal of these programs is deploying cutting-edge AI technologies to solve crucial issues like poverty, hunger, crime, and climate change, under the'AI for good' umbrella. But the bigger question is what makes an AI project good? AI has the potential to address some of humanity's biggest challenges, such as poverty and climate change.


Semantic Annotation for Tabular Data

arXiv.org Artificial Intelligence

Detecting semantic concept of columns in tabular data is of particular interest to many applications ranging from data integration, cleaning, search to feature engineering and model building in machine learning. Recently, several works have proposed supervised learning-based or heuristic pattern-based approaches to semantic type annotation. Both have shortcomings that prevent them from generalizing over a large number of concepts or examples. Many neural network based methods also present scalability issues. Additionally, none of the known methods works well for numerical data. We propose $C^2$, a column to concept mapper that is based on a maximum likelihood estimation approach through ensembles. It is able to effectively utilize vast amounts of, albeit somewhat noisy, openly available table corpora in addition to two popular knowledge graphs to perform effective and efficient concept prediction for structured data. We demonstrate the effectiveness of $C^2$ over available techniques on 9 datasets, the most comprehensive comparison on this topic so far.