Collaborating Authors

Pattern Recognition

A deep learning framework for unsupervised affine and deformable image registration


Recent studies have shown that deep learning methods, notably convolutional neural networks (ConvNets), can be used for image registration. Thus far training of ConvNets for registration was supervised using predefined example registrations. However, obtaining example registrations is not trivial. To circumvent the need for predefined examples, and thereby to increase convenience of training ConvNets for image registration, we propose the Deep Learning Image Registration (DLIR) framework for unsupervised affine and deformable image registration. In the DLIR framework ConvNets are trained for image registration by exploiting image similarity analogous to conventional intensity-based image registration. After a ConvNet has been trained with the DLIR framework, it can be used to register pairs of unseen images in one shot. We propose flexible ConvNets designs for affine image registration and for deformable image registration. By stacking multiple of these ConvNets into a larger architecture, we are able to perform coarse-to-fine image registration. We show for registration of cardiac cine MRI and registration of chest CT that performance of the DLIR framework is comparable to conventional image registration while being several orders of magnitude faster.",

What is Artificial Intelligence


We humans have been getting smarter for millennia. Instead of asking this question, we can find some answers using the term Artificial Intelligence. AI comes from the Latin word Artificiality which means "play". It really is so used today as a generic term for a whole range of things including pattern recognition, natural language processing, image recognition, mechanical operation, and many more, but primarily time-based (via computer systems). Before we look at ways in which AI can help us, let's look at how we define AI, so that we can also judge the quality of AI systems currently using this term and the new ways of using AI that are coming.

C++ WildCard pattern matching


Given a text and a wildcard pattern, implement wildcard pattern matching algorithm that finds if wildcard pattern is matched with text. The matching should cover the entire text (not partial text). The wildcard pattern can include the characters? Let s consider any character in the pattern. Case 2: The character is?

Most Basic Code for and Image Recognition System using cifar-10 dataset


Now the most basic model for an image recognition system that can be created using this dataset will predict the classes to which that object belongs along with the likelihood. At the end of the…

Build an object detection model to identify license plates from images of cars


This code pattern is part of the Getting started with IBM Maximo Visual Inspection learning path. In this code pattern, learn how to use optical character recognition (OCR) and the IBM Maximo Visual Inspection object recognition service to identify and read license plates. Using IBM Maximo Visual Inspection and the Custom Inference Scripts, you can build an object detection model to identify license plates from images of cars. The models in the IBM Maximo Visual Inspection object recognition service can identify portions of images that represent a license plate. Then, the post custom inference script can crop this area and use open source to perform OCR on the text to return the license plate.

SpaceML Taps Satellite Images to Help Model Wildfire Risks


When freak lightning ignited massive wildfires across Northern California last year, it also sparked efforts from data scientists to improve predictions for blazes. One effort came from SpaceML, an initiative of the Frontier Development Lab, which is an AI research lab for NASA in partnership with the SETI Institute. Dedicated to open-source research, the SpaceML developer community is creating image recognition models to help advance the study of natural disaster risks, including wildfires. SpaceML uses accelerated computing on petabytes of data for the study of Earth and space sciences, with the goal of advancing projects for NASA researchers. It brings together data scientists and volunteer citizen scientists on projects that tap into the NASA Earth Observing System Data and Information System data.

Introduction to the Artificial Intelligence


These systems are advanced networks trained to build ad-hoc systems and improve themselves using data. Examples: -- Multipurpose Systems, Systems with human-level Intelligence, reasoning, thinking, and decision-making, and Systems that synthesize diverse information and decide actions.

Paint4Poem: A Dataset for Artistic Visualization of Classical Chinese Poems Artificial Intelligence

In this work we propose a new task: artistic visualization of classical Chinese poems, where the goal is to generatepaintings of a certain artistic style for classical Chinese poems. For this purpose, we construct a new dataset called Paint4Poem. Thefirst part of Paint4Poem consists of 301 high-quality poem-painting pairs collected manually from an influential modern Chinese artistFeng Zikai. As its small scale poses challenges for effectively training poem-to-painting generation models, we introduce the secondpart of Paint4Poem, which consists of 3,648 caption-painting pairs collected manually from Feng Zikai's paintings and 89,204 poem-painting pairs collected automatically from the web. We expect the former to help learning the artist painting style as it containshis most paintings, and the latter to help learning the semantic relevance between poems and paintings. Further, we analyze Paint4Poem regarding poem diversity, painting style, and the semantic relevance between poems and paintings. We create abenchmark for Paint4Poem: we train two representative text-to-image generation models: AttnGAN and MirrorGAN, and evaluate theirperformance regarding painting pictorial quality, painting stylistic relevance, and semantic relevance between poems and paintings.The results indicate that the models are able to generate paintings that have good pictorial quality and mimic Feng Zikai's style, but thereflection of poem semantics is limited. The dataset also poses many interesting research directions on this task, including transferlearning, few-shot learning, text-to-image generation for low-resource data etc. The dataset is publicly available.(

WebQA: Multihop and Multimodal QA Artificial Intelligence

Web search is fundamentally multimodal and multihop. Often, even before asking a question we choose to go directly to image search to find our answers. Further, rarely do we find an answer from a single source but aggregate information and reason through implications. Despite the frequency of this everyday occurrence, at present, there is no unified question answering benchmark that requires a single model to answer long-form natural language questions from text and open-ended visual sources -- akin to a human's experience. We propose to bridge this gap between the natural language and computer vision communities with WebQA. We show that A. our multihop text queries are difficult for a large-scale transformer model, and B. existing multi-modal transformers and visual representations do not perform well on open-domain visual queries. Our challenge for the community is to create a unified multimodal reasoning model that seamlessly transitions and reasons regardless of the source modality.

Multimodal Classification: Current Landscape, Taxonomy and Future Directions Artificial Intelligence

Multimodal classification research has been gaining popularity in many domains that collect more data from multiple sources including satellite imagery, biometrics, and medicine. However, the lack of consistent terminology and architectural descriptions makes it difficult to compare different existing solutions. We address these challenges by proposing a new taxonomy for describing such systems based on trends found in recent publications on multimodal classification. Many of the most difficult aspects of unimodal classification have not yet been fully addressed for multimodal datasets including big data, class imbalance, and instance level difficulty. We also provide a discussion of these challenges and future directions.