Government
Ensemble learning for Physics Informed Neural Networks: a Gradient Boosting approach
Fang, Zhiwei, Wang, Sifan, Perdikaris, Paris
While the popularity of physics-informed neural networks (PINNs) is steadily rising, to this date, PINNs have not been successful in simulating multi-scale and singular perturbation problems. In this work, we present a new training paradigm referred to as "gradient boosting" (GB), which significantly enhances the performance of physics informed neural networks (PINNs). Rather than learning the solution of a given PDE using a single neural network directly, our algorithm employs a sequence of neural networks to achieve a superior outcome. This approach allows us to solve problems presenting great challenges for traditional PINNs. Our numerical experiments demonstrate the effectiveness of our algorithm through various benchmarks, including comparisons with finite element methods and PINNs. Furthermore, this work also unlocks the door to employing ensemble learning techniques in PINNs, providing opportunities for further improvement in solving PDEs.
Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Prediction
Liu, Yu, Zhang, Xin, Ding, Jingtao, Xi, Yanxin, Li, Yong
Monitoring sustainable development goals requires accurate and timely socioeconomic statistics, while ubiquitous and frequently-updated urban imagery in web like satellite/street view images has emerged as an important source for socioeconomic prediction. Especially, recent studies turn to self-supervised contrastive learning with manually designed similarity metrics for urban imagery representation learning and further socioeconomic prediction, which however suffers from effectiveness and robustness issues. To address such issues, in this paper, we propose a Knowledge-infused Contrastive Learning (KnowCL) model for urban imagery-based socioeconomic prediction. Specifically, we firstly introduce knowledge graph (KG) to effectively model the urban knowledge in spatiality, mobility, etc., and then build neural network based encoders to learn representations of an urban image in associated semantic and visual spaces, respectively. Finally, we design a cross-modality based contrastive learning framework with a novel image-KG contrastive loss, which maximizes the mutual information between semantic and visual representations for knowledge infusion. Extensive experiments of applying the learnt visual representations for socioeconomic prediction on three datasets demonstrate the superior performance of KnowCL with over 30\% improvements on $R^2$ compared with baselines. Especially, our proposed KnowCL model can apply to both satellite and street imagery with both effectiveness and transferability achieved, which provides insights into urban imagery-based socioeconomic prediction.
Topic-Selective Graph Network for Topic-Focused Summarization
Due to the success of the pre-trained language model (PLM), existing PLM-based summarization models show their powerful generative capability. However, these models are trained on general-purpose summarization datasets, leading to generated summaries failing to satisfy the needs of different readers. To generate summaries with topics, many efforts have been made on topic-focused summarization. However, these works generate a summary only guided by a prompt comprising topic words. Despite their success, these methods still ignore the disturbance of sentences with non-relevant topics and only conduct cross-interaction between tokens by attention module. To address this issue, we propose a topic-arc recognition objective and topic-selective graph network. First, the topic-arc recognition objective is used to model training, which endows the capability to discriminate topics for the model. Moreover, the topic-selective graph network can conduct topic-guided cross-interaction on sentences based on the results of topic-arc recognition. In the experiments, we conduct extensive evaluations on NEWTS and COVIDET datasets. Results show that our methods achieve state-of-the-art performance.
Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection
In this work, we propose a method for incorporating question-answering (QA) signals into a summarization model. Our method identifies salient noun phrases (NPs) in the input document by automatically generating wh-questions that are answered by the NPs and automatically determining whether those questions are answered in the gold summaries. This QA-based signal is incorporated into a two-stage summarization model which first marks salient NPs in the input document using a classification model, then conditionally generates a summary. Our experiments demonstrate that the models trained using QA-based supervision generate higher-quality summaries than baseline methods of identifying salient spans on benchmark summarization datasets. Further, we show that the content of the generated summaries can be controlled based on which NPs are marked in the input document. Finally, we propose a method of augmenting the training data so the gold summaries are more consistent with the marked input spans used during training and show how this results in models which learn to better exclude unmarked document content.
Heterogeneous robot teams with unified perception and autonomy: How Team CSIRO Data61 tied for the top score at the DARPA Subterranean Challenge
Kottege, Navinda, Williams, Jason, Tidd, Brendan, Talbot, Fletcher, Steindl, Ryan, Cox, Mark, Frousheger, Dennis, Hines, Thomas, Pitt, Alex, Tam, Benjamin, Wood, Brett, Hanson, Lauren, Surdo, Katrina Lo, Molnar, Thomas, Wildie, Matt, Stepanas, Kazys, Catt, Gavin, Tychsen-Smith, Lachlan, Penfold, Dean, Overs, Leslie, Ramezani, Milad, Khosoussi, Kasra, Kendoul, Farid, Wagner, Glenn, Palmer, Duncan, Manderson, Jack, Medek, Corey, O'Brien, Matthew, Chen, Shengkang, Arkin, Ronald C.
The DARPA Subterranean Challenge was designed for competitors to develop and deploy teams of autonomous robots to explore difficult unknown underground environments. Categorised in to human-made tunnels, underground urban infrastructure and natural caves, each of these subdomains had many challenging elements for robot perception, locomotion, navigation and autonomy. These included degraded wireless communication, poor visibility due to smoke, narrow passages and doorways, clutter, uneven ground, slippery and loose terrain, stairs, ledges, overhangs, dripping water, and dynamic obstacles that move to block paths among others. In the Final Event of this challenge held in September 2021, the course consisted of all three subdomains. The task was for the robot team to perform a scavenger hunt for a number of pre-defined artefacts within a limited time frame. Only one human supervisor was allowed to communicate with the robots once they were in the course. Points were scored when accurate detections and their locations were communicated back to the scoring server. A total of 8 teams competed in the finals held at the Mega Cavern in Louisville, KY, USA. This article describes the systems deployed by Team CSIRO Data61 that tied for the top score and won second place at the event.
Resources for Turkish Natural Language Processing: A critical survey
Çöltekin, Çağrı, Doğruöz, A. Seza, Çetinoğlu, Özlem
The recent (re)popularization of deep learning methods increased the importance and need for the data even further. Similarly, the other subfields of theoretical and applied linguistics have also seen a shift towards more data-driven methods. As a result, availability of large and high-quality language data is essential for both linguistic research and practical NLP applications. In this paper, we present a comprehensive and critical survey of linguistic resources for Turkish.
Drone strike in Syria kills 2 al-Qaida-linked operatives
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. A drone strike believed to have been carried out by the U.S.-led coalition in northwestern Syria on Friday killed two operatives with an al-Qaida-linked group, Syrian opposition activists said. The two militants were killed while riding a motorcycle near the northern village of Qah, close to the Turkish border, according to the Britain-based Syrian Observatory for Human Rights, an opposition war monitor, and several other activist collectives. There was no immediate comment from the U.S. military.
Ted Cruz's Resume Example - ChatGPT Famous Resumes
Do you know Ted Cruz, a former Texas senator to the US Senate? If not, allow me to briefly outline his outstanding background. Senator Cruz is, first and foremost, a highly educated person with degrees from both Princeton University and Harvard Law School. His successful legal career, which included his tenure as Texas' Solicitor General, when he presented nine cases to the Supreme Court, was definitely influenced by this solid educational foundation. Senator Cruz has made other achievements as well.
Paul Ryan's Resume Example - ChatGPT Famous Resumes
Paul Ryan is a highly accomplished person with extensive knowledge in the public and commercial sectors. He is a strong candidate for any position due to his demonstrated success and leadership. First and foremost, Ryan has a wealth of government experience. From 2015 until 2019, he was the House of Representatives' 54th Speaker, making him the chamber's youngest speaker in the previous 150 years. Ryan served in Congress for several terms and had a number of executive posts, including chairman of the House Ways & Means Committee.
Lou Diamond Phillips's Resume Example - ChatGPT Famous Resumes
Michael Dukakis, the former governor of Massachusetts, is a highly successful person with a long history of public service. Have you ever questioned his credentials? He presided over Massachusetts as governor twice, from 1983 to 1991 and 1975 to 1979. He led a dramatic economic turnaround during his time in office, creating jobs and enhancing the business environment in the state. In addition, he established a national paradigm for universal health care.