Oceania
Positively transitioned sentiment dialogue corpus for developing emotion-affective open-domain chatbots
Wang, Weixuan, Peng, Wei, Huang, Chong Hsuan, Wang, Haoran
In this paper, we describe a data enhancement method for developing Emily, an emotion-affective open-domain chatbot. The proposed method is based on explicitly modeling positively transitioned (PT) sentiment data from multi-turn dialogues. We construct a dialogue corpus with PT sentiment data and will release it for public use. By fine-tuning a pretrained dialogue model using the produced PT-enhanced dialogues, we are able to develop an emotion-affective open-domain chatbot exhibiting close-to-human performance in various emotion-affective metrics. We evaluate Emily against a few state-of-the-art (SOTA) open-domain chatbots and show the effectiveness of the proposed approach. The corpus is made publicly available.
Privacy-Aware Adversarial Network in Human Mobility Prediction
Zhan, Yuting, Haddadi, Hamed, Mashhadi, Afra
As mobile devices and location-based services are increasingly developed in different smart city scenarios and applications, many unexpected privacy leakages have arisen due to geolocated data collection and sharing. User re-identification and other sensitive inferences are major privacy threats when geolocated data are shared with cloud-assisted applications. Significantly, four spatio-temporal points are enough to uniquely identify 95\% of the individuals, which exacerbates personal information leakages. To tackle malicious purposes such as user re-identification, we propose an LSTM-based adversarial mechanism with representation learning to attain a privacy-preserving feature representation of the original geolocated data (i.e., mobility data) for a sharing purpose. These representations aim to maximally reduce the chance of user re-identification and full data reconstruction with a minimal utility budget (i.e., loss). We train the mechanism by quantifying privacy-utility trade-off of mobility datasets in terms of trajectory reconstruction risk, user re-identification risk, and mobility predictability. We report an exploratory analysis that enables the user to assess this trade-off with a specific loss function and its weight parameters. The extensive comparison results on four representative mobility datasets demonstrate the superiority of our proposed architecture in mobility privacy protection and the efficiency of the proposed privacy-preserving features extractor. We show that the privacy of mobility traces attains decent protection at the cost of marginal mobility utility. Our results also show that by exploring the Pareto optimal setting, we can simultaneously increase both privacy (45%) and utility (32%).
SBPF: Sensitiveness Based Pruning Framework For Convolutional Neural Network On Image Classification
Lu, Yiheng, Gong, Maoguo, Zhao, Wei, Feng, Kaiyuan, Li, Hao
Pruning techniques are used comprehensively to compress convolutional neural networks (CNNs) on image classification. However, the majority of pruning methods require a well pre-trained model to provide useful supporting parameters, such as C1-norm, BatchNorm value and gradient information, which may lead to inconsistency of filter evaluation if the parameters of the pre-trained model are not well optimized. Therefore, we propose a sensitiveness based method to evaluate the importance of each layer from the perspective of inference accuracy by adding extra damage for the original model. Because the performance of the accuracy is determined by the distribution of parameters across all layers rather than individual parameter, the sensitiveness based method will be robust to update of parameters. Namely, we can obtain similar importance evaluation of each convolutional layer between the imperfect-trained and fully trained models. For VGG-16 on CIFAR-10, even when the original model is only trained with 50 epochs, we can get same evaluation of layer importance as the results when the model is trained fully. Then we will remove filters proportional from each layer by the quantified sensitiveness. Our sensitiveness based pruning framework is verified efficiently on VGG-16, a customized Conv-4 and ResNet-18 with CIFAR-10, MNIST and CIFAR-100, respectively.
Hierarchical Residual Learning Based Vector Quantized Variational Autoencoder for Image Reconstruction and Generation
Adiban, Mohammad, Stefanov, Kalin, Siniscalchi, Sabato Marco, Salvi, Giampiero
We propose a multi-layer variational autoencoder method, we call HR-VQVAE, that learns hierarchical discrete representations of the data. By utilizing a novel objective function, each layer in HR-VQVAE learns a discrete representation of the residual from previous layers through a vector quantized encoder. Furthermore, the representations at each layer are hierarchically linked to those at previous layers. We evaluate our method on the tasks of image reconstruction and generation. Experimental results demonstrate that the discrete representations learned by HR-VQVAE enable the decoder to reconstruct high-quality images with less distortion than the baseline methods, namely VQVAE and VQVAE-2. HR-VQVAE can also generate high-quality and diverse images that outperform state-of-the-art generative models, providing further verification of the efficiency of the learned representations. The hierarchical nature of HR-VQVAE i) reduces the decoding search time, making the method particularly suitable for high-load tasks and ii) allows to increase the codebook size without incurring the codebook collapse problem.
IDNP: Interest Dynamics Modeling using Generative Neural Processes for Sequential Recommendation
Du, Jing, Ye, Zesheng, Yao, Lina, Guo, Bin, Yu, Zhiwen
Recent sequential recommendation models rely increasingly on consecutive short-term user-item interaction sequences to model user interests. These approaches have, however, raised concerns about both short- and long-term interests. (1) {\it short-term}: interaction sequences may not result from a monolithic interest, but rather from several intertwined interests, even within a short period of time, resulting in their failures to model skip behaviors; (2) {\it long-term}: interaction sequences are primarily observed sparsely at discrete intervals, other than consecutively over the long run. This renders difficulty in inferring long-term interests, since only discrete interest representations can be derived, without taking into account interest dynamics across sequences. In this study, we address these concerns by learning (1) multi-scale representations of short-term interests; and (2) dynamics-aware representations of long-term interests. To this end, we present an \textbf{I}nterest \textbf{D}ynamics modeling framework using generative \textbf{N}eural \textbf{P}rocesses, coined IDNP, to model user interests from a functional perspective. IDNP learns a global interest function family to define each user's long-term interest as a function instantiation, manifesting interest dynamics through function continuity. Specifically, IDNP first encodes each user's short-term interactions into multi-scale representations, which are then summarized as user context. By combining latent global interest with user context, IDNP then reconstructs long-term user interest functions and predicts interactions at upcoming query timestep. Moreover, IDNP can model such interest functions even when interaction sequences are limited and non-consecutive. Extensive experiments on four real-world datasets demonstrate that our model outperforms state-of-the-arts on various evaluation metrics.
Machine Learning with DBOS
Redmond, Robert, Weckwerth, Nathan W., Xia, Brian S., Li, Qian, Kraft, Peter, Kumar, Deeptaanshu, Demiralp, รaฤatay, Stonebraker, Michael
We recently proposed a new cluster operating system stack, DBOS, centered on a DBMS. DBOS enables unique support for ML applications by encapsulating ML code within stored procedures, centralizing ancillary ML data, providing security built into the underlying DBMS, co-locating ML code and data, and tracking data and workflow provenance. Here we demonstrate a subset of these benefits around two ML applications. We first show that image classification and object detection models using GPUs can be served as DBOS stored procedures with performance competitive to existing systems. We then present a 1D CNN trained to detect anomalies in HTTP requests on DBOS-backed web services, achieving SOTA results. We use this model to develop an interactive anomaly detection system and evaluate it through qualitative user feedback, demonstrating its usefulness as a proof of concept for future work to develop learned real-time security services on top of DBOS.
Professor in Computing (Artificial Intelligence), Faculty of Science and Engineering job with MACQUARIE UNIVERSITY - SYDNEY AUSTRALIA
We are looking for an outstanding academic leader at Level E (Professor) with an excellent track record of teaching and research in the discipline of Artificial Intelligence (AI). The appointee will provide leadership and mentorship in the AI discipline within the School of Computing and leverage your international standing to provide a focal point for the further development of the discipline at Macquarie University. You will have a distinguished scholarly research record and a renowned reputation in the field. Your role will ensure research, teaching, and engagement activities within this discipline excel, you will mentor and support staff to develop them and grow their careers. You will demonstrate research excellence, contribute to the development and management of our teaching programs, provide leadership amongst national and international peers, and represent the University at public forums.
Computational Learning Theory: 15th Annual Conference on Computational Learning Theory, COLT 2002, Sydney, Australia, July 8-10, 2002. Proceedings (Lecture Notes in Computer Science, 2375): Kivinen, Jyrki, Sloan, Robert H.: 9783540438366: Amazon.com: Books
Computational Learning Theory: 15th Annual Conference on Computational Learning Theory, COLT 2002, Sydney, Australia, July 8-10, 2002. Proceedings (Lecture Notes in Computer Science, 2375) [Kivinen, Jyrki, Sloan, Robert H.] on Amazon.com. *FREE* shipping on qualifying offers. Computational Learning Theory: 15th Annual Conference on Computational Learning Theory, COLT 2002, Sydney, Australia, July 8-10, 2002. Proceedings (Lecture Notes in Computer Science, 2375)
Europe's Forthcoming AI Act Will Have a Wide Reach and Broad Implications - Fintech Schweiz Digital Finance News - FintechNewsCH
Like the European Union (EU)'s General Data Protection Regulation (GDPR) that entered into force in 2016, the upcoming Artificial Intelligence (AI) Act will have extraterritorial scope and global impact. Considering the AI Act's broad scope and the financial risks relating to non-compliance, businesses must prepare for these future regulatory changes now and proactively take the initiatives to comply with best practices early on, according to a new whitepaper by Swiss data services company Unit8. The paper, titled Upcoming AI Regulation: What to expect and how to prepare, delves into the EU's forthcoming AI Act, providing insights into the future development of AI regulation in Europe and the potential implications for organizations worldwide. The European Commission (EC) unveiled a proposal for a legal framework on AI in April 2021, seeking to address risks of specifically created by AI applications, proposing a list of high risk applications, setting clear requirements for AI systems for high risk applications and defining specific obligations for AI users and providers of high risk applications. The proposed rules also propose a conformity assessment method for AI systems, propose enforcement after an AI system is placed in the market, and propose a governance structure at European and national level.
Lecturer/Senior Lecturer (Adjunct)/Research Fellow/Senior Research Fellow in Artificial Intelligence job with MONASH UNIVERSITY
With excellent, high-quality students, a vibrant research environment, being based in the Suzhou Industrial Park, which houses over 100 Fortune 500 companies, and in close proximity to other higher education institutions, this is a unique opportunity to engage in multi-disciplinary research collaborations and enhance your future career prospects in a teaching and research focused role. The Department of Data Science and Artificial Intelligence and Department of Software Systems and Cybersecurity strive to provide a welcoming and open culture that is inclusive of students and staff of diverse genders, sexes, sexualities, religions and cultures and people with disabilities. In accordance with Monash University's commitment to Athena Swan principles, we particularly encourage applications from women in data science and artificial intelligence. For further information, please see our website: www.monash.edu/it/edi/women-in-it. If deep engagement with Monash Australia and its teaching & research staff, and the opportunity to collaborate with experts across the Faculty of Information Technology within a world top 100 University, is of interest to you, we look forward to receiving your application!