Problem Solving
Core Challenges in Embodied Vision-Language Planning
Francis, Jonathan (Carnegie Mellon University) | Kitamura, Nariaki (Carnegie Mellon University) | Labelle, Felix (Carnegie Mellon University) | Lu, Xiaopeng (Carnegie Mellon University) | Navarro, Ingrid (Carnegie Mellon University) | Oh, Jean
Recent advances in the areas of multimodal machine learning and artificial intelligence (AI) have led to the development of challenging tasks at the intersection of Computer Vision, Natural Language Processing, and Embodied AI. Whereas many approaches and previous survey pursuits have characterised one or two of these dimensions, there has not been a holistic analysis at the center of all three. Moreover, even when combinations of these topics are considered, more focus is placed on describing, e.g., current architectural methods, as opposed to also illustrating high-level challenges and opportunities for the field. In this survey paper, we discuss Embodied Vision-Language Planning (EVLP) tasks, a family of prominent embodied navigation and manipulation problems that jointly use computer vision and natural language. We propose a taxonomy to unify these tasks and provide an in-depth analysis and comparison of the new and current algorithmic approaches, metrics, simulated environments, as well as the datasets used for EVLP tasks. Finally, we present the core challenges that we believe new EVLP works should seek to address, and we advocate for task construction that enables model generalizability and furthers real-world deployment.
Home
Controlled Natural Languages (CNLs) are effective languages for Knowledge Representation and Reasoning that look like the ones you use every day, so you can easily read and understand them. However, when they are based on Logical AI, meaning behind what is being said can be accurately processed not just by humans but also by machines. As logical CNLs can represent information about the real world in a way that machines can process, you will be able to ensure that meaning of what you write is accurately understood by creating definitions of words yourself or selecting the definitions from pre-defined vocabularies (ontologies). For the first time on any social platform, utility and information will not be lost or neglected, because, by writing in logical CNLs, you will be able to see the overlapping points of agreement, disagreements, and contradictions in the meaning map of all conversations and use logical reasoning to solve complex tasks such as diagnosing a medical condition. Other social platforms (such as Facebook, Twitter, etc.) do not really understand meaning of what you're saying.
Deep Reinforcement Learning for Solving Rubik's Cube
The Rubik's Cube is a famous 3-D puzzle toy. A regular Rubik's Cube has six faces, each of which has nine coloured stickers, and the puzzle is solved when each face has a united colour. If we count one quarter (90) turn as one move and two quarter turns (a "face" turn) as two moves, the best algorithms human-invented can solve any instance of the cube in 26 moves. My target is to let the computer learn how to solve the Rubik's Cube without feeding it any human knowledge like the symmetry of the cube. The most challenging part is the Rubik's Cube has 43,252,003,274,489,856,000 possible permutations.
58-member bipartisan House Problem Solvers Caucus backs bill to extend Title 42
National correspondent Bill Melugin has the latest from Eagle Pass, Texas, on'Special Report.' FIRST ON FOX: The Problem Solvers Caucus is backing legislation in the House that would extend Title 42 -- the latest sign of bipartisan pushback against the Biden administration's plans to end the public health order in May. The Biden administration announced earlier this month that it will end the order on May 23, a measure that has been used since March 2020 to quickly remove a majority of migrants encountered at the southern border due to the COVID-19 pandemic. But with growing fears that the already massive border numbers will only accelerate if the order is lifted, a number of moderate Democrats have joined with Republicans in pushing the administration to delay its move. Dec 09: 2021: A U.S. Border Patrol agent speaks with immigrants before transporting some of them to a processing center in Yuma, Arizona.
Pinaki Laskar on LinkedIn: #architecture #intelligence #autonomous
AI Researcher, Cognitive Technologist Inventor - AI Thinking, Think Chain Innovator - AIOT, XAI, Autonomous Cars, IIOT Founder Fisheyebox Spatial Computing Savant, Transformative Leader, Industry X.0 Practitioner How to built an #architecture for autonomous #intelligence? A system architecture for #autonomous intelligence, The configurator module performs executive control: Given a task to be executed, it preconfigures the perception module, the world model, the cost and the actor for the task at hand, possibly by modulating the parameters of those modules. The perception module receives signals from sensors and estimates the current state of the world. For a given task, only a small subset of the perceived state of the world is relevant and useful. The configurator module primes the perception system to extract the relevant information from the percept for the task at hand.
Python Data Structures Tutorial
Also explains sequence and string functions, slicing, concatenating, iterating, sorting, etc. with code examples. This course combines conceptual lectures to explain how a data structure works, and code lectures that walk through how to implement a data structure in Python code. All the code lectures are based on Python 3 code in a Jupyter notebook. Data structures covered in this course include native Python data structures String, List, Tuple, Set, and Dictionary, as well as Stacks, Queues, Heaps, Linked Lists, Binary Search Trees, and Graphs. The list data type has some more methods.
AI Widens Search Spaces and Promises More Hits in Drug Discovery
Traditional drug discovery techniques are all about brute force--and a little bit of luck. Basically, large-scale, high-throughput screening is used to cover a search space. The process is a little like conducting antisubmarine warfare without the benefit of sonar. Unsurprisingly, very few of the depth charges (drug candidates) hit their targets and achieve the desired results (successful clinical trials). The seas are simply too vast.
Developing safe controllers for autonomous systems under uncertainty
We then define abstract actions that correspond to control inputs that cause transitions between these regions. Due to the noise, every action has multiple possible outcomes that all occur with a certain probability. We compute lower and upper bounds (intervals) on these probabilities based on a finite number of observations of the noise. Our abstraction procedure ensures that we obtain a faithful, yet abstract representation of the autonomous system. In fact, this abstraction constitutes a type of Markov decision process, which is the standard type of model in sequential decision making under uncertainty. To analyze our abstract models in a rigorous manner, we use state-of-art tools from an area called formal verification.
Design considerations for a hierarchical semantic compositional framework for medical natural language understanding
Taira, Ricky K., Garlid, Anders O., Speier, William
Medical natural language processing (NLP) systems are a key enabling technology for transforming Big Data from clinical report repositories to information used to support disease models and validate intervention methods. However, current medical NLP systems fall considerably short when faced with the task of logically interpreting clinical text. In this paper, we describe a framework inspired by mechanisms of human cognition in an attempt to jump the NLP performance curve. The design centers about a hierarchical semantic compositional model (HSCM) which provides an internal substrate for guiding the interpretation process. The paper describes insights from four key cognitive aspects including semantic memory, semantic composition, semantic activation, and hierarchical predictive coding. We discuss the design of a generative semantic model and an associated semantic parser used to transform a free-text sentence into a logical representation of its meaning.