Goto

Collaborating Authors

 error


Knowledge Distillation by On-the-Fly Native Ensemble

xu lan, Xiatian Zhu, Shaogang Gong

Neural Information Processing Systems

Knowledge distillation is effective to train the small and generalisable network models for meeting the low-memory and fast running requirements. Existing offline distillation methods rely on a strong pre-trained teacher, which enables favourable knowledge discovery and transfer but requires a complex two-phase training procedure. Online counterparts address this limitation at the price of lacking a high-capacity teacher. In this work, we present an On-the-fly Native Ensemble (ONE) learning strategyforone-stage online distillation.


Bootstrapping the Error of Oja's Algorithm

Neural Information Processing Systems

We consider the problem of quantifying uncertainty for the estimation error of the leading eigenvector from Oja's algorithm for streaming principal component analysis, where the data are generated IID from some unknown distribution. By combining classical tools from the U-statistics literature with recent results on high-dimensional central limit theorems for quadratic forms of random vectors and concentration of matrix products, we establish a weighted $\chi^2$ approximation result for the $\sin^2$ error between the population eigenvector and the output of Oja's algorithm. Since estimating the covariance matrix associated with the approximating distribution requires knowledge of unknown model parameters, we propose a multiplier bootstrap algorithm that may be updated in an online manner. We establish conditions under which the bootstrap distribution is close to the corresponding sampling distribution with high probability, thereby establishing the bootstrap as a consistent inferential method in an appropriate asymptotic regime.


Comparative Analysis of Shear Strength Prediction Models for Reinforced Concrete Slab-Column Connections

Wahab, Sarmed, Mahmoudabadi, Nasim Shakouri, Waqas, Sarmad, Herl, Nouman, Iqbal, Muhammad, Alam, Khurshid, Ahmad, Afaq

arXiv.org Artificial Intelligence

This research aims at comparative analysis of shear strength prediction at slab-column connection, unifying machine learning, design codes and Finite Element Analysis. Current design codes (CDCs) of ACI 318-19 (ACI), Eurocode 2 (EC2), Compressive Force Path (CFP) method, Feed Forward Neural Network (FNN) based Artificial Neural Network (ANN), PSO-based FNN (PSOFNN), and BAT algorithm-based BATFNN are used. The study is complemented with FEA of slab for validating the experimental results and machine learning predictions.In the case of hybrid models of PSOFNN and BATFNN, mean square error is used as an objective function to obtain the optimized values of the weights, that are used by Feed Forward Neural Network to perform predictions on the slab data. Seven different models of PSOFNN, BATFNN, and FNN are trained on this data and the results exhibited that PSOFNN is the best model overall. PSOFNN has the best results for SCS=1 with highest value of R as 99.37% and lowest of MSE, and MAE values of 0.0275%, and 1.214% respectively which are better than the best FNN model for SCS=4 having the values of R, MSE, and MAE as 97.464%, 0.0492%, and 1.43%, respectively.


Tensorflow Plugin - Metal - Apple Developer

#artificialintelligence

Error: "Could not find a version that satisfies the requirement tensorflow-macos (from versions: none)." A tensorflow installation wheel that matches the current Python environment couldn't be found by the package manager. Check that the Python version used in the environment is supported (Python 3.8, Python 3.9, Python 3.10). Complex data type isn't supported by tensorflow-metal. Error: "Cannot assign a device for operation: Could not satisfy explicit device specification because the node was colocated with a group of nodes that required incompatible device."


Intellectual abilities of artificial intelligence (AI) - Semiwiki

#artificialintelligence

To understand AI’s capabilities and abilities we need to recognize the different components and subsets of AI. Terms like Neural Networks, Machine Learning (ML), and Deep Learning, need to be define and explained. In general, Artificial intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think like humans and…


The 6-Minute Guide to Scikit-learn's Version 1.0 Changes 😎

#artificialintelligence

Now scikit-learn let's you create B-splines with the preprocessing.SplineTransformer. I think of splines like more fine-grained polynomial transformations. As seen in the plot below, splines make it easier to avoid the ridiculous extrapolations you often see with high-degree polynomials. James et al. are all about splines in their recently updated machine learning touchstone An Introduction to Statistical Learning, 2nd Edition. My favorite 1.0 change is to OneHotEncoder.


Anomaly Detection with Azure Machine Learning Studio. TechBullion

#artificialintelligence

We knew Azure is one of the fastest growing Cloud services around the world it helps developers and IT Professionals to create and manage their applications. When Azure HDInsight has huge success in Hadoop based technology, For Marketing Leaders in Big data Microsoft has taken another step and introduced Azure Machine Learning which is also called as "Azure ML". After the release of Azure ML, the developers feel easy to build applications and Azure ML run's under a public cloud by this user need not to download any external hardware or software. Azure Machine Learning is combined in the development environment which is renamed as Azure ML Studio. The main reason to introduce Azure ML to make users to create a data models without the help of data science background, In Azure ML Data models, are Created with end-to-end services were as ML Studio is used to build and test by using drag-and-drop and also we can deploy analytics solution for our data's too.


How Attractive Are You in the Eyes of Deep Neural Network?

#artificialintelligence

The original paper implemented a bunch of different models, including classic ML models with handcrafted features and 3 deep learning models: AlexNet, ResNet18, and ResNext50. I want to keep my work as simple as possible (I don't want to implement and train the whole resnet network from scratch), I want to fine tune some existing model that will do the job. In keras, there's a module called applications, which is a collection of different pre-trained models. One of them is resnet50. ResNet is a Deep Convolutional network that was developed by Microsoft and won the 2015 ImageNet competition, which is an image classification task.


Will AI help legal practices?

#artificialintelligence

Artificial Intelligence (AI) is the hottest trend at the moment, everyone is talking about how it may change our lives and even take our jobs. Potentially every industry will be affected by AI in the (near) future, but this doesn't mean it will be a negative effect. I have a background in Law so naturally I'm interested to see how AI might change the legal profession for the better. As AI continues to develop and learn it can be used to cut time in proof-reading and research. A study in America found that it took legal professionals on average one hour to proof a document for mistakes, but it only took the AI a matter of minutes.


Seventh Workshop on the Validation and Verification of Knowledge-Based Systems

AI Magazine

The annual Workshop on the Validation and Verification of Knowledge-Based Systems is the leading forum for presenting research on the validation and verification of knowledge-based systems (KBSs). The 1994 workshop was significant in that there was a definitive move in the philosophical position of the workshop from a testing-and toolbased approach to KBS evaluation to that of a formal specification-based approach. This workshop included 12 full papers and 5 short papers and was attended by 35 researchers from government, industry, and academia. The workshop is the leading forum for presenting research on the validation and verification of knowledge-based systems (KBSs). It has influenced the evolution of the discipline from its origins in 1988; at this time, researchers were asking the questions, How can we evaluate the correctness of KBS? How is this process different from conventional system evolution?