Hybrid Knowledge Routed Modules for Large-scale Object Detection

Neural Information Processing Systems

Abstract The dominant object detection approaches treat the recognition of each region separately and overlook crucial semantic correlations between objects in one scene. This paradigm leads to substantial performance drop when facing heavy long-tail problems, where very few samples are available for rare classes and plenty of confusing categories exists. We exploit diverse human commonsense knowledge for reasoning over large-scale object categories and reaching semantic coherency within one image. Particularly, we present Hybrid Knowledge Routed Modules (HKRM) that incorporates the reasoning routed by two kinds of knowledge forms: an explicit knowledge module for structured constraints that are summarized with linguistic knowledge (e.g. shared attributes, relationships) about concepts; and an implicit knowledge module that depicts some implicit constraints (e.g. common spatial layouts). By functioning over a region-to-region graph, both modules can be individualized and adapted to coordinate with visual patterns in each image, guided by specific knowledge forms. HKRM are light-weight, general-purpose and extensible by easily incorporating multiple knowledge to endow any detection networks the ability of global semantic reasoning. Experiments on large-scale object detection benchmarks show HKRM obtains around 34.5% improvement on VisualGenome (1000 categories) and 30.4% on ADE in terms of mAP.

Report on the First International Conference on Knowledge Capture (K-CAP)

AI Magazine

The International Conference on Knowledge Capture (K-CAP) is a new forum for multidisciplinary research on capturing knowledge from a variety of sources and creating representations that are useful for reasoning. This article describes the first conference series, held in October 2001, and presents an invitation to the AI community to participate in K-CAP 2003.

Developing and Deploying Knowledge on a Global Scale

AI Magazine

To enhance the quality and consistency of its customer- support organization, Reuters embarked on a global knowledge development and reuse project. The system supports 38 Reuter products worldwide. This article presents a case study of Reuter experience in putting a global knowledge organization in place, building knowledge bases at multiple distributed sites, deploying these knowledge bases in multiple sites around the world, and maintaining and enhancing knowledge bases within a global organizational framework. This project is the first to address issues in multicountry knowledge development and maintenance and multicountry knowledge deployment.

Francesco Rago Blog – #AI #IoT #DeepLearning


A cognitive subject – whose individuality is based on dependence on other individualities – clarifies the notion of knowledge through an ecological model, where the environment is not only understood as a physical environment, but rather as a complex network of social, historical, material, geographic, cultural, institutional relationships. The cognitive subject is immersed in this network, along with his epistemic attempts, his aspirations and his cognitive ways. Epistemic activity is assessed on the basis of the success in promoting ecosystems committed to promoting a continuous increase in collective individual knowledge. Furthermore, epistemic activity is evaluated on the basis of success in promoting true and justified beliefs (This is the key point for a discussion on creativity of sentients). Cognitive subjects are not self-sufficient epistemic because they need interactions with other subjects.