Goto

Collaborating Authors

 fss


Split Happens: Combating Advanced Threats with Split Learning and Function Secret Sharing

Khan, Tanveer, Budzys, Mindaugas, Michalas, Antonis

arXiv.org Artificial Intelligence

--Split Learning (SL) - splits a model into two distinct parts to help protect client data while enhancing Machine Learning (ML) processes. Though promising, SL has proven vulnerable to different attacks, thus raising concerns about how effective it may be in terms of data privacy. Recent works have shown promising results for securing SL through the use of a novel paradigm, named Function Secret Sharing (FSS), in which servers obtain shares of a function they compute and operate on a public input hidden with a random mask. However, these works fall short in addressing the rising number of attacks which exist on SL. In SplitHappens, we expand the combination of FSS and SL to U-shaped SL. Similarly to other works, we are able to make use of the benefits of SL by reducing the communication and computational costs of FSS. However, a U-shaped SL provides a higher security guarantee than previous works, allowing a client to keep the labels of the training data secret, without having to share them with the server . Through this, we are able to generalize the security analysis of previous works and expand it to different attack vectors, such as modern model inversion attacks as well as label inference attacks. We tested our approach for two different convolutional neural networks on different datasets. These experiments show the effectiveness of our approach in reducing the training time as well as the communication costs when compared to simply using FSS while matching prior accuracy.


Data-driven Mesoscale Weather Forecasting Combining Swin-Unet and Diffusion Models

Hirabayashi, Yuta, Matsuoka, Daisuke

arXiv.org Artificial Intelligence

In particular, diffusion models represent fine-scale details wit hout spatial smoothing, which is crucial for mesoscale predictions, such as heavy rainfall fo recasting. However, the applications of diffusion models to mesoscale prediction remain limited. T o address this gap, this study proposes an architecture that combines a diffusion model with Swin-Unet as a deterministic model, achieving mesoscale predictions while maintain ing flexibility. The proposed architecture trains the two models independently, allowin g the diffusion model to remain unchanged when the deterministic model is updated. Comp arisons using the Fractions Skill Score and power spectral analysis demonstrate th at incorporating the diffusion model leads to improved accuracy compared to predictions with out it. These findings underscore the potential of the proposed architecture to enha nce mesoscale predictions, particularly for strong rainfall events, while maintaining flexibility.


A Machine Learning Approach for Design of Frequency Selective Surface based Radar Absorbing Material via Image Prediction

Sutrakar, Vijay Kumar, K, Anjana P, Kesharwani, Sajal, Bisariya, Siddharth

arXiv.org Artificial Intelligence

The paper presents an innovative methodology for designing frequency selective surface (FSS) based radar absorbing materials using machine learning (ML) technique. In conventional electromagnetic design, unit cell dimensions of FSS are used as input and absorption coefficient is then predicted for a given design. In this paper, absorption coefficient is considered as input to ML model and image of FSS unit cell is predicted. Later, this image is used for generating the FSS unit cell parameters. Eleven different ML models are studied over a wide frequency band of 1GHz to 30GHz. Out of which six ML models (i.e. (a) Random Forest classification, (b) K- Neighbors Classification, (c) Grid search regression, (d) Random Forest regression, (e) Decision tree classification, and (f) Decision tree regression) show training accuracy more than 90%. The absorption coefficients with varying frequencies of these predicted images are subsequently evaluated using commercial electromagnetic solver. The performance of these ML models is encouraging, and it can be used for accelerating design and optimization of high performance FSS based radar absorbing material for advanced electromagnetic applications in future.


Exponentially Consistent Nonparametric Clustering of Data Streams

Singh, Bhupender, Rajagopalan, Ananth Ram, Bhashyam, Srikrishna

arXiv.org Machine Learning

In this paper, we consider nonparametric clustering of $M$ independent and identically distributed (i.i.d.) data streams generated from unknown distributions. The distributions of the $M$ data streams belong to $K$ underlying distribution clusters. Existing results on exponentially consistent nonparametric clustering algorithms, like single linkage-based (SLINK) clustering and $k$-medoids distribution clustering, assume that the maximum intra-cluster distance ($d_L$) is smaller than the minimum inter-cluster distance ($d_H$). First, in the fixed sample size (FSS) setting, we show that exponential consistency can be achieved for SLINK clustering under a less strict assumption, $d_I < d_H$, where $d_I$ is the maximum distance between any two sub-clusters of a cluster that partition the cluster. Note that $d_I < d_L$ in general. Our results show that SLINK is exponentially consistent for a larger class of problems than $k$-medoids distribution clustering. We also identify examples where $k$-medoids clustering is unable to find the true clusters, but SLINK is exponentially consistent. Then, we propose a sequential clustering algorithm, named SLINK-SEQ, based on SLINK and prove that it is also exponentially consistent. Simulation results show that the SLINK-SEQ algorithm requires fewer expected number of samples than the FSS SLINK algorithm for the same probability of error.


Efficient Frequency Selective Surface Analysis via End-to-End Model-Based Learning

Hammami, Cheima, Polo-López, Lucas, Magoarou, Luc Le

arXiv.org Artificial Intelligence

This paper introduces an innovative end-to-end model-based deep learning approach for efficient electromagnetic analysis of high-dimensional frequency selective surfaces (FSS). Unlike traditional data-driven methods that require large datasets, this approach combines physical insights from equivalent circuit models with deep learning techniques to significantly reduce model complexity and enhance prediction accuracy. Compared to previously introduced model-based learning approaches, the proposed method is trained end-to-end from the physical structure of the FSS (geometric parameters) to its electromagnetic response (S-parameters). Additionally, an improvement in phase prediction accuracy through a modified loss function is presented. Comparisons with direct models, including deep neural networks (DNN) and radial basis function networks (RBFN), demonstrate the superiority of the model-based approach in terms of computational efficiency, model size, and generalization capability.


Make Split, not Hijack: Preventing Feature-Space Hijacking Attacks in Split Learning

Khan, Tanveer, Budzys, Mindaugas, Michalas, Antonis

arXiv.org Artificial Intelligence

The popularity of Machine Learning (ML) makes the privacy of sensitive data more imperative than ever. Collaborative learning techniques like Split Learning (SL) aim to protect client data while enhancing ML processes. Though promising, SL has been proved to be vulnerable to a plethora of attacks, thus raising concerns about its effectiveness on data privacy. In this work, we introduce a hybrid approach combining SL and Function Secret Sharing (FSS) to ensure client data privacy. The client adds a random mask to the activation map before sending it to the servers. The servers cannot access the original function but instead work with shares generated using FSS. Consequently, during both forward and backward propagation, the servers cannot reconstruct the client's raw data from the activation map. Furthermore, through visual invertibility, we demonstrate that the server is incapable of reconstructing the raw image data from the activation map when using FSS. It enhances privacy by reducing privacy leakage compared to other SL-based approaches where the server can access client input information. Our approach also ensures security against feature space hijacking attack, protecting sensitive information from potential manipulation. Our protocols yield promising results, reducing communication overhead by over 2x and training time by over 7x compared to the same model with FSS, without any SL. Also, we show that our approach achieves >96% accuracy and remains equivalent to the plaintext models.


Fine Structure-Aware Sampling: A New Sampling Training Scheme for Pixel-Aligned Implicit Models in Single-View Human Reconstruction

Chan, Kennard Yanting, Liu, Fayao, Lin, Guosheng, Foo, Chuan Sheng, Lin, Weisi

arXiv.org Artificial Intelligence

Pixel-aligned implicit models, such as PIFu, PIFuHD, and ICON, are used for single-view clothed human reconstruction. These models need to be trained using a sampling training scheme. Existing sampling training schemes either fail to capture thin surfaces (e.g. ears, fingers) or cause noisy artefacts in reconstructed meshes. To address these problems, we introduce Fine Structured-Aware Sampling (FSS), a new sampling training scheme to train pixel-aligned implicit models for single-view human reconstruction. FSS resolves the aforementioned problems by proactively adapting to the thickness and complexity of surfaces. In addition, unlike existing sampling training schemes, FSS shows how normals of sample points can be capitalized in the training process to improve results. Lastly, to further improve the training process, FSS proposes a mesh thickness loss signal for pixel-aligned implicit models. It becomes computationally feasible to introduce this loss once a slight reworking of the pixel-aligned implicit function framework is carried out. Our results show that our methods significantly outperform SOTA methods qualitatively and quantitatively. Our code is publicly available at https://github.com/kcyt/FSS.


Few Shot Semantic Segmentation: a review of methodologies and open challenges

Catalano, Nico, Matteucci, Matteo

arXiv.org Artificial Intelligence

Many surveys and reviews like [22, 23, 39] describe semantic segmentation as the Computer Vision (CV) task of predicting a category label at the pixel level. It builds upon simpler vision tasks such as image classification and object detection, and also shares some similarities with more advanced challenges like parts segmentation, instance segmentation, and panoptic segmentation. A visual comparison between the related Computer Vision (CV) tasks is reported in Figure 1. Image classification aims at understanding the overall scene in an image by giving it one or more labels, while object detection (Figure 1b) focuses on predicting the location of one or more objects in an image usually providing bounding boxes. Pixel-level prediction tasks like parts segmentation (Figure 1d) is a closer problem to semantic segmentation (Figure 1c), as it aims at predicting pixel-level segmentation masks covering the parts that compose the intended subject, such as face parts like the chin, nose and eyes. Instance segmentation (Figure 1e) aims to distinguish individual objects in an image, even if they are of the same kind, but does not necessarily assign them a category. Finally, panoptic segmentation (Figure 1f) combines semantic segmentation with instance segmentation, predicting the pixel-level category and distinguishing each object in the scene. Overall, we can place semantic segmentation as a midpoint on a spectrum of image understanding tasks ranging from coarse to fine.


Can we integrate spatial verification methods into neural-network loss functions for atmospheric science?

Lagerquist, Ryan, Ebert-Uphoff, Imme

arXiv.org Artificial Intelligence

In the last decade, much work in atmospheric science has focused on spatial verification (SV) methods for gridded prediction, which overcome serious disadvantages of pixelwise verification. However, neural networks (NN) in atmospheric science are almost always trained to optimize pixelwise loss functions, even when ultimately assessed with SV methods. This establishes a disconnect between model verification during vs. after training. To address this issue, we develop spatially enhanced loss functions (SELF) and demonstrate their use for a real-world problem: predicting the occurrence of thunderstorms (henceforth, "convection") with NNs. In each SELF we use either a neighbourhood filter, which highlights convection at scales larger than a threshold, or a spectral filter (employing Fourier or wavelet decomposition), which is more flexible and highlights convection at scales between two thresholds. We use these filters to spatially enhance common verification scores, such as the Brier score. We train each NN with a different SELF and compare their performance at many scales of convection, from discrete storm cells to tropical cyclones. Among our many findings are that (a) for a low (high) risk threshold, the ideal SELF focuses on small (large) scales; (b) models trained with a pixelwise loss function perform surprisingly well; (c) however, models trained with a spectral filter produce much better-calibrated probabilities than a pixelwise model. We provide a general guide to using SELFs, including technical challenges and the final Python code, as well as demonstrating their use for the convection problem. To our knowledge this is the most in-depth guide to SELFs in the geosciences.


Fuzziness, Indeterminacy and Soft Sets: Frontiers and Perspectives

Voskoglou, Michael Gr.

arXiv.org Artificial Intelligence

The present paper comes across the main steps that laid from Zadeh's fuzziness ana Atanassov's intuitionistic fuzzy sets to Smarandache's indeterminacy and to Molodstov's soft sets. Two hybrid methods for assessment and decision making respectively under fuzzy conditions are also presented through suitable examples that use soft sets and real intervals as tools. The decision making method improves an earlier method of Maji et al. Further, it is described how the concept of topological space, the most general category of mathematical spaces, can be extended to fuzzy structures and how to generalize the fundamental mathematical concepts of limit, continuity compactness and Hausdorff space within such kind of structures. In particular, fuzzy and soft topological spaces are defined and examples are given to illustrate these generalizations.