Sarajevo
Solid Waste Detection in Remote Sensing Images: A Survey
Fraternali, Piero, Morandini, Luca, González, Sergio Luis Herrera
The detection and characterization of illegal solid waste disposal sites are essential for environmental protection, particularly for mitigating pollution and health hazards. Improperly managed landfills contaminate soil and groundwater via rainwater infiltration, posing threats to both animals and humans. Traditional landfill identification approaches, such as on-site inspections, are time-consuming and expensive. Remote sensing is a cost-effective solution for the identification and monitoring of solid waste disposal sites that enables broad coverage and repeated acquisitions over time. Earth Observation (EO) satellites, equipped with an array of sensors and imaging capabilities, have been providing high-resolution data for several decades. Researchers proposed specialized techniques that leverage remote sensing imagery to perform a range of tasks such as waste site detection, dumping site monitoring, and assessment of suitable locations for new landfills. This review aims to provide a detailed illustration of the most relevant proposals for the detection and monitoring of solid waste sites by describing and comparing the approaches, the implemented techniques, and the employed data. Furthermore, since the data sources are of the utmost importance for developing an effective solid waste detection model, a comprehensive overview of the satellites and publicly available data sets is presented. Finally, this paper identifies the open issues in the state-of-the-art and discusses the relevant research directions for reducing the costs and improving the effectiveness of novel solid waste detection methods.
Vaccine: Perturbation-aware Alignment for Large Language Model
Huang, Tiansheng, Hu, Sihao, Liu, Ling
The new paradigm of finetuning-as-a-service introduces a new attack surface for Large Language Models (LLMs): a few harmful data uploaded by users can easily trick the finetuning to produce an alignment-broken model. We conduct an empirical analysis and uncover a \textit{harmful embedding drift} phenomenon, showing a probable cause of the alignment-broken effect. Inspired by our findings, we propose Vaccine, a perturbation-aware alignment technique to mitigate the security risk of users finetuning. The core idea of Vaccine is to produce invariant hidden embeddings by progressively adding crafted perturbation to them in the alignment phase. This enables the embeddings to withstand harmful perturbation from un-sanitized user data in the finetuning phase. Our results on open source mainstream LLMs (e.g., Llama2, Opt, Vicuna) demonstrate that Vaccine can boost the robustness of alignment against harmful prompts induced embedding drift while reserving reasoning ability towards benign prompts. Our code is available at \url{https://github.com/git-disl/Vaccine}.
Locating Factual Knowledge in Large Language Models: Exploring the Residual Stream and Analyzing Subvalues in Vocabulary Space
We find the location of factual knowledge in large language models by exploring the residual stream and analyzing subvalues in vocabulary space. We find the reason why subvalues have human-interpretable concepts when projecting into vocabulary space. The before-softmax values of subvalues are added by an addition function, thus the probability of top tokens in vocabulary space will increase. Based on this, we find using log probability increase to compute the significance of layers and subvalues is better than probability increase, since the curve of log probability increase has a linear monotonically increasing shape. Moreover, we calculate the inner products to evaluate how much a feed-forward network (FFN) subvalue is activated by previous layers. Base on our methods, we find where factual knowledge
Understanding Path Planning Explanations
Halilovic, Amar, Krivic, Senka
Abstract--Navigation is a must-have skill for any mobile robot. For the design of our user study, we will extend and formalize our approach to explain both path planning failures There is an increasing deployment of autonomous robots and deviations from the initial trajectory, i.e. to be able to in various domains [1]. Currently, we use one and accountability in their decision-making exists [2]. Navigation is a pivotal aspect of an autonomous robot create different planning failures and trajectory-contrastive decision-making spectrum. After generating explanations for the created scenarios, a key role in achieving accurate and efficient navigation in we will perturb the explanations in the following way: changing environments.
The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie
Motlagh, Negin Yazdani, Khajavi, Matin, Sharifi, Abbas, Ahmadi, Mohsen
In the digital era, the integration of artificial intelligence (AI) in education has ushered in transformative changes, redefining teaching methodologies, curriculum planning, and student engagement. This review paper delves deep into the rapidly evolving landscape of digital education by contrasting the capabilities and impact of OpenAI's pioneering text generation tools like Bing Chat, Bard, Ernie with a keen focus on the novel ChatGPT. Grounded in a typology that views education through the lenses of system, process, and result, the paper navigates the multifaceted applications of AI. From decentralizing global education and personalizing curriculums to digitally documenting competence-based outcomes, AI stands at the forefront of educational modernization. Highlighting ChatGPT's meteoric rise to one million users in just five days, the study underscores its role in democratizing education, fostering autodidacticism, and magnifying student engagement. However, with such transformative power comes the potential for misuse, as text-generation tools can inadvertently challenge academic integrity. By juxtaposing the promise and pitfalls of AI in education, this paper advocates for a harmonized synergy between AI tools and the educational community, emphasizing the urgent need for ethical guidelines, pedagogical adaptations, and strategic collaborations.
RecXplainer: Amortized Attribute-based Personalized Explanations for Recommender Systems
Verma, Sahil, Shah, Chirag, Dickerson, John P., Beniwal, Anurag, Sadagopan, Narayanan, Seshadri, Arjun
Recommender systems influence many of our interactions in the digital world -- impacting how we shop for clothes, sorting what we see when browsing YouTube or TikTok, and determining which restaurants and hotels we are shown when using hospitality platforms. Modern recommender systems are large, opaque models trained on a mixture of proprietary and open-source datasets. Naturally, issues of trust arise on both the developer and user side: is the system working correctly, and why did a user receive (or not receive) a particular recommendation? Providing an explanation alongside a recommendation alleviates some of these concerns. The status quo for auxiliary recommender system feedback is either user-specific explanations (e.g., "users who bought item B also bought item A") or item-specific explanations (e.g., "we are recommending item A because you watched/bought item B"). However, users bring personalized context into their search experience, valuing an item as a function of that item's attributes and their own personal preferences. In this work, we propose RecXplainer, a novel method for generating fine-grained explanations based on a user's preferences over the attributes of recommended items. We evaluate RecXplainer on five real-world and large-scale recommendation datasets using five different kinds of recommender systems to demonstrate the efficacy of RecXplainer in capturing users' preferences over item attributes and using them to explain recommendations. We also compare RecXplainer to five baselines and show RecXplainer's exceptional performance on ten metrics.
Full text: NATO Vilnius summit communique
NATO leaders are holding their annual summit as Ukraine looks to the security alliance for support in its attempt to push back invading Russian forces. The Vilnius communique, however, while emphasising NATO's support for Ukraine, gave no clear timetable on when the country might be able to join the alliance, in a major disappointment for Ukrainian President Volodymyr Zelenskyy, who had travelled to the Lithuanian capital. "Ukraine's future is in NATO," the leaders said in the joint statement on Tuesday. "We will be in a position to extend an invitation to Ukraine to join the alliance when allies agree and conditions are met," the declaration said, without specifying the conditions. The communique also touched on the Asia Pacific, with the leaders of Australia, Japan, New Zealand and South Korea all attending as NATO allies. It said China was a challenge to NATO's interests, security and values with its "ambitions and coercive policies" triggering a furious response from Beijing. And it accused Beijing and Moscow of "mutually reinforcing attempts to undercut the rules-based international order". China has said it wants peace in Ukraine, but has not condemned Russia's full scale invasion since it began in February 2022. NATO is a defensive Alliance. It is the unique, essential and indispensable transatlantic forum to consult, coordinate and act on all matters related to our individual and collective security. We reaffirm our iron-clad commitment to defend each other and every inch of Allied territory at all times, protect our one billion citizens, and safeguard our freedom and democracy, in accordance with Article 5 of the Washington Treaty. We will continue to ensure our collective defence from all threats, no matter where they stem from, based on a 360-degree approach, to fulfil NATO's three core tasks of deterrence and defence, crisis prevention and management, and cooperative security. We adhere to international law and to the purposes and principles of the Charter of the United Nations and are committed to upholding the rules-based international order. This Summit marks a milestone in strengthening our Alliance. We look forward to our valuable exchanges with the Heads of State and Government of Australia, Japan, New Zealand, and the Republic of Korea, as well as the President of the European Council and the President of the European Commission at this Summit. We also welcome the engagements with the Foreign Ministers of Georgia and the Republic of Moldova, and with the Deputy Foreign Minister of Bosnia and Herzegovina, as we continue to consult closely on the implementation of NATO's tailored support measures. This is an historic step for Finland and for NATO. For many years, we worked closely as partners; we now stand together as Allies. NATO membership makes Finland safer, and NATO stronger. Every nation has the right to choose its own security arrangements.
When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories
Mallen, Alex, Asai, Akari, Zhong, Victor, Das, Rajarshi, Khashabi, Daniel, Hajishirzi, Hannaneh
Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world knowledge. This paper aims to understand LMs' strengths and limitations in memorizing factual knowledge, by conducting large-scale knowledge probing experiments of 10 models and 4 augmentation methods on PopQA, our new open-domain QA dataset with 14k questions. We find that LMs struggle with less popular factual knowledge, and that scaling fails to appreciably improve memorization of factual knowledge in the long tail. We then show that retrieval-augmented LMs largely outperform orders of magnitude larger LMs, while unassisted LMs remain competitive in questions about high-popularity entities. Based on those findings, we devise a simple, yet effective, method for powerful and efficient retrieval-augmented LMs, which retrieves non-parametric memories only when necessary. Experimental results show that this significantly improves models' performance while reducing the inference costs.
Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under Discussion
Ko, Wei-Jen, Wu, Yating, Dalton, Cutter, Srinivas, Dananjay, Durrett, Greg, Li, Junyi Jessy
Automatic discourse processing is bottlenecked by data: current discourse formalisms pose highly demanding annotation tasks involving large taxonomies of discourse relations, making them inaccessible to lay annotators. This work instead adopts the linguistic framework of Questions Under Discussion (QUD) for discourse analysis and seeks to derive QUD structures automatically. QUD views each sentence as an answer to a question triggered in prior context; thus, we characterize relationships between sentences as free-form questions, in contrast to exhaustive fine-grained taxonomies. We develop the first-of-its-kind QUD parser that derives a dependency structure of questions over full documents, trained using a large, crowdsourced question-answering dataset DCQA (Ko et al., 2022). Human evaluation results show that QUD dependency parsing is possible for language models trained with this crowdsourced, generalizable annotation scheme. We illustrate how our QUD structure is distinct from RST trees, and demonstrate the utility of QUD analysis in the context of document simplification. Our findings show that QUD parsing is an appealing alternative for automatic discourse processing.
Graph Neural Networks on Factor Graphs for Robust, Fast, and Scalable Linear State Estimation with PMUs
Kundacina, Ognjen, Cosovic, Mirsad, Miskovic, Dragisa, Vukobratovic, Dejan
As phasor measurement units (PMUs) become more widely used in transmission power systems, a fast state estimation (SE) algorithm that can take advantage of their high sample rates is needed. To accomplish this, we present a method that uses graph neural networks (GNNs) to learn complex bus voltage estimates from PMU voltage and current measurements. We propose an original implementation of GNNs over the power system's factor graph to simplify the integration of various types and quantities of measurements on power system buses and branches. Furthermore, we augment the factor graph to improve the robustness of GNN predictions. This model is highly efficient and scalable, as its computational complexity is linear with respect to the number of nodes in the power system. Training and test examples were generated by randomly sampling sets of power system measurements and annotated with the exact solutions of linear SE with PMUs. The numerical results demonstrate that the GNN model provides an accurate approximation of the SE solutions. Furthermore, errors caused by PMU malfunctions or communication failures that would normally make the SE problem unobservable have a local effect and do not deteriorate the results in the rest of the power system.