Goto

Collaborating Authors

 loss


66808849a9f5d8e2d00dbdc844de6333-Supplemental-Conference.pdf

Neural Information Processing Systems

The target isavector in RNp, half comprised of "distance" units and half comprised of "direction" units. This calculation is performed in d dimensions. Next, we ran a much narrower sweep ofฮฑE/ฮฑI ratio values in the range(2.5,10), Oneratio ฮฑE/ฮฑI = 3.5417appeared to outperform DoS, but this was due to a single lucky seed (Figure 1e).


Capturing implicit hierarchical structure in 3D biomedical images with self-supervised hyperbolic representations

Neural Information Processing Systems

We consider the task of representation learning for unsupervised segmentation of 3D voxel-grid biomedical images. We show that models that capture implicit hierarchical relationships between subvolumes are better suited for this task. To that end, we consider encoder-decoder architectures with a hyperbolic latent space, to explicitly capture hierarchical relationships present in subvolumes of the data. We propose utilizing a 3D hyperbolic variational autoencoder with a novel gyroplane convolutional layer to map from the embedding space back to 3D images. To capture these relationships, we introduce an essential self-supervised loss---in addition to the standard VAE loss---which infers approximate hierarchies and encourages implicitly related subvolumes to be mapped closer in the embedding space.


FastAI's callbacks for better CNN training -- meet SaveModelCallback.

#artificialintelligence

FastAI has a very flexible callback system that let's you greatly customize your training process. However, some of the pre-built and useful callbacks are not as easy to find without a deep dive into the documentation and to my knowledge, aren't covered in the regular courses. A common question is thus, "how do I automatically save my best model if it happens in the middle of a training run?" and the answer is to use the SaveModelCallback. The purpose of this callback, as the name implies, is to automatically save a new'best loss' model automatically during training. At the end of training, it then conveniently loads the top model so it's ready for you to continue with.


A Too-Clever Ranking Method

AI Magazine

I developed what I thought was an extremely clever method for detecting "bad" training instances. Each instance was scored, and those with the lowest scores could be removed before running C4.5 to build a decision tree with the remainder. I ran an experiment in which I removed the bottom 10 percent of the instances in a University of California, Irvine (UCI) data set. The resulting tree was smaller and more accurate (as measured by 10-fold CV) than the tree built on the full data set. Then I removed the bottom 20 percent of the instances and got a tree that was smaller than the last one and just as accurate.


198253024057690

#artificialintelligence

"Artificial intelligence is coming for your job." That's been the mantra of skeptics, naysayers, and even pragmatic analysts for years. A quick Google search will yield dozens, if not hundreds, of articles, such as this Mother Jones article by columnist Kevin Drum, on how the expansion of AI and robotics is going to radically shift the job market for the worse as we offload tasks, such as assembly and even driving and customer service, normally performed by humans to machines. Even Bill Gates and politicians in the European Union have voiced concerns over AI contributing to mass unemployment and suggested that perhaps the robots that replace humans should be taxed as a means of funding universal basic income. Proponents of AI will tell workers not to worry, that AI is only going to augment their job, or better yet, take over their menial, repetitive job so that they can move on to a more complex (and assumed more rewarding) position.


self-driving-regulations-while-us-debates-legislation-germany-adopts-ethical-2588029

International Business Times

The legislation contains rules such as saving humans before animals and property, saving lives without discrimination and that self-driving software should contain safeguards against malicious hacking. Germany has taken a novel approach, rather than concentrating on self-driven cars, it concentrates on self-driving software -- most self-driving legislation concentrates on self-driven cars and consequences of putting them on roads and literally in charge of human lives. The German legislation concentrates on the root of self-driving, the computers, and software used to run self-driven cars. This makes it essential that decisions be taken when programming the software of conditionally and highly automated driving systems."


Neural Net: Combined features worse than separate features

#artificialintelligence

I created a dataframe with 3 columns, feature_1, feature_2, and target, with the goal of having feature_1 and feature_2 predict the target. I standardized feature_1 and one-hot-encoded feature_2 (which has 100 categories and therefore creates 100 columns). I know for sure that feature_1 and target are correlated and so is feature_2 and target. The target is numbers from 1 to 10 and I create a correlated categorical (feature_2) variable by making a portion of the categorical values map perfectly with the target, for example, when target is a 3, set feature_2 to "A". Creating a model with only feature_1 vs target I get val_loss of 7.60.


Understanding log_loss - March Machine Learning Mania 2016

#artificialintelligence

I read somewhere on this forum that last years winner had only 18 misclassification's. That made me suspicious way my submitted model is only in 126 place on a leader-board( my current result is 42 True predictions and 14 False ones). It seems that if I would had made my predictions more aggressive, something like: if pred 0.5: pred 0.95 else: pred 0.05 My log_loss would be 0.34, instead of 0.53. I'm curious is this common case to manually edit your probabilities or other classifiers like neural networks ( never tried it) just predicting with higher confidence?