Collaborating Authors

Neural Networks

Self-Supervised Learning and Its Applications -


In the past decade, the research and development in AI have skyrocketed, especially after the results of the ImageNet competition in 2012. The focus was largely on supervised learning methods that require huge amounts of labeled data to train systems for specific use cases. In this article, we will explore Self Supervised Learning (SSL) – a hot research topic in a machine learning community. Self-supervised learning (SSL) is an evolving machine learning technique poised to solve the challenges posed by the over-dependence of labeled data. For many years, building intelligent systems using machine learning methods has been largely dependent on good quality labeled data. Consequently, the cost of high-quality annotated data is a major bottleneck in the overall training process.

Neuromorphic chips more energy efficient for deep learning


Neuromorphic chips have been endorsed in research showing that they are much more energy efficient at operating large deep learning networks than non-neuromorphic hardware. This may become important as AI adoption increases. The study was carried out by the Institute of Theoretical Computer Science at the Graz University of Technology (TU Graz) in Austria using Intel's Loihi 2 silicon, a second-generation experimental neuromorphic chip announced by Intel Labs last year that has about a million artificial neurons. Their research paper, "A Long Short-Term Memory for AI Applications in Spike-based Neuromorphic Hardware," published in Nature Machine Intelligence, claims that the Intel chips are up to 16 times more energy efficient in deep learning tasks than performing the same task on non-neuromorphic hardware. The hardware tested consisted of 32 Loihi chips.

Microsoft expands its AI partnership with Meta


Microsoft and Meta are extending their ongoing AI partnership, with Meta selecting Azure as "a strategic cloud provider" to accelerate its own AI research and development. Microsoft officials shared more details about the latest on the Microsoft-Meta partnership on Day 2 of the Microsoft Build 2022 developers conference. Microsoft and Meta -- back when it was still known as Facebook -- announced the ONNX (Open Neural Network Exchange) format in 2017 in the name of enabling developers to move deep-learning models between different AI frameworks. Microsoft open sourced the ONNX Runtime, which is the inference engine for models in the ONNX format, in 2018. Today, Meta officials said they'll be using Azure to accelerate research and development across the Meta AI group.

How visual-based AI is evolving across industries


Artificial Intelligence is transforming the business world as a whole with all its applications and potential, with visual-based AI being capable of digital images and videos. Visual-based AI, which refers to computer vision, is an application of AI that is playing a significant role in enabling a digital transformation by enabling machines to detect and recognize not just images and videos, but also the various elements within them, such as people, objects, animals and even sentiments, emotional and other parameters-based capabilities to name a few. Artificial intelligence is now further evolving across various industries and sectors. Transport: Computer vision aids in a better experience for transport, as video analytics combined with Automatic number plate recognition can help in tracking and tracing violators of traffic safety laws (speed limits and lane violation etc.) and stolen or lost cars, as well as in toll management and traffic monitoring and controlling. Aviation: Visual AI can help in providing prompt assistance for elderly passengers and for those requiring assistance (physically challenged, pregnant women etc.); it can also be useful in creating a new "face-as-a-ticket" option for easy and fast boarding for passengers, in tracking down lost baggage around the airport as well as in security surveillance on passengers and suspicious objects (track and trace objects and passengers relevant to it).

25 Best edX Courses for Data Science and Machine Learning


The course material of this course is available freely. But for the certificate, you have to pay. In this course, you will learn the foundational TensorFlow concepts such as the main functions, operations, and execution pipelines. This course will also teach how to use TensorFlow in curve fitting, regression, classification, and minimization of error functions. You will understand different types of Deep Architectures, such as Convolutional Networks, Recurrent Networks, and Autoencoders.

Is an AI Autumn Around the Corner? -


It is hard, looking at the current technological landscape, to believe that artificial intelligence may actually be facing a reckoning that could cause investment in the field to dry up. Yet increasingly, the sentiment being expressed by those who work most with AI is that we may be heading for a wall. There are several solid reasons for this concern. Alan Morrison recently noted that what is more recently referred to as Artificial Intelligence can be divided into about five different buckets. The first, from within the realm of Data Science, is the use of stochastic (probability-based) algorithms used in conjunction with large data sets to perform what amounts to predictive analytics.

Suicidal Text Analysis Using NLP


It is estimated that each year many people, most of whom are teenagers and young adults die by suicide worldwide. Suicide receives special attention with many countries developing national strategies for prevention. It is found that, social media is one of the most powerful tool from where we can analyze the text and estimate the chances of suicidal thoughts. Using nlp we can analyze twitter and reddit texts monitor the actions of that person. The most difficult part to prevent suicide is to detect and understand the complex risk factors and warning signs that may lead to suicide.

Advanced Data Science Capstone


As a coursera certified specialization completer you will have a proven deep understanding on massive parallel data processing, data exploration and visualization, and advanced machine learning & deep learning. You'll understand the mathematical foundations behind all machine learning & deep learning algorithms. You can apply knowledge in practical use cases, justify architectural decisions, understand the characteristics of different algorithms, frameworks & technologies & how they impact model performance & scalability. If you choose to take this specialization and earn the Coursera specialization certificate, you will also earn an IBM digital badge. To find out more about IBM digital badges follow the link

Papers based on Contrastive Learning


Abstract: Graph contrastive learning (GCL) has attracted a surge of attention due to its superior performance for learning node/graph representations without labels. However, in practice, unlabeled nodes for the given graph usually follow an implicit imbalanced class distribution, where the majority of nodes belong to a small fraction of classes (a.k.a., head class) and the rest classes occupy only a few samples (a.k.a., tail classes). This highly imbalanced class distribution inevitably deteriorates the quality of learned node representations in GCL. Indeed, we empirically find that most state-of-the-art GCL methods exhibit poor performance on imbalanced node classification. Motivated by this observation, we propose a principled GCL framework on Imbalanced node classification (ImGCL), which automatically and adaptively balances the representation learned from GCL without knowing the labels.

Automating model parallelism with just one line of code


Researchers from Google, Amazon Web Services, UC Berkeley, Shanghai Jiao Tong University, Duke University and Carnegie Mellon University have published a paper titled "Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning" at OSDI 2022. The paper introduces a new method for automating the complex process of parallelising a model with only one line of code. So how does Alpa work? Data parallelism is a technique where model weights are duplicated across accelerators while only partitioning and distributing the training data. The dataset is split into'N' parts in data parallelism with'N' being the quantity of GPUs.