Technology
Distilled Wasserstein Learning for Word Embedding and Topic Modeling
Hongteng Xu, Wenlin Wang, Wei Liu, Lawrence Carin
Theworddistributions of topics, their optimal transports to the word distributions of documents, and the embeddings of words are learned in a unified framework. When learning thetopic model, weleverage adistilled underlying distance matrix toupdate the topic distributions and smoothly calculate the corresponding optimal transports.
Transformer-based WorkingMemoryforMultiagent ReinforcementLearningwithActionParsing
Learning in real-world multiagent tasks is challenging due to the usual partial observability ofeach agent. Previous efforts alleviate thepartial observability by historical hidden states with Recurrent Neural Networks, however, they do not consider themultiagent characters thateither themultiagent observationconsists ofanumber ofobject entities orthe action space shows clear entity interactions.
e1b248453bca182b6138b8c14a75340d-Paper-Conference.pdf
Intensive algorithmic efforts have been made to enable the rapid improvements of certificated robustness for complex ML models recently. However, current robustness certification methods are only able to certify under a limited perturbation radius. Given that existingpure data-driven statistical approaches have reached a bottleneck, in this paper, we propose to integrate statistical ML modelswithknowledge (expressed aslogical rules) asareasoningcomponent using Markovlogic networks (MLN), so as to further improvethe overall certified robustness.