Media
r/artificial - I cant conceive of a machine actually seeing colors like we do. The only thing I can see is possible is a computer simply having knowledge based on what color is what. Like having a number represent what color is there but not actually seeing it. Is this how AI works? I cant find anything on google.
Take for instance a computer that records a video and can recognize objects in the video, sure it has a data warehouse somewhere of what each object is, and if it doesn't it could add one once it "learns" what it is. But realistically how is that different from humans? Humans don't know what a color is until they learn what it is, I didn't know red was red until someone told me, and red is only red because it is generally agreed upon what the word red represents. If I see a color and tell you it's red, and an a.i.
r/artificial - Chatbots and dialogue systems
Originally chatbots were defined as any bot that is available on a chat platform. Virtual assistants like Siri and Cortana are also dialogue systems but not chatbots. Some Expert Systems built for making business decisions can also have a dialogue system to interact with them. Those aren't available on chat platforms and definitely don't chat.
r/MachineLearning - DeepMind's new neural network model beats AlexNet with 13 images per class
Definitely does have "echos" of BERT and friends from the NLP side of things, though still has a while to go to reach a similarly large revolution in performance. However, the OP's title does not match the claims of the paper. With unsupervised pretraining on over 1M images 13 labels per class they get 64% top-5 accuracy, well below Alexnet's 82% accuracy. While the paper's investigation is pretty thorough, I don't think they mention either compute requirements (given it's deepmind, I would default to assuming it's gigantic) or how the approach scales with different amounts of unsupervised data. Like how does it perform if only training the CPC feature extractor on half of imagenet?
r/MachineLearning - [D] CycleGAN implementation just learning identity mapping
Hi, don't know where else to ask but I just don't know what else I could try out with my code. I'm trying to reimplement CycleGAN in a Jupyter notbook and (for me) the code looks good, but somehow my generators just learn to map an input to itself (so what I put into it comes out at the other end). What's odd is that the GAN loss is going up, which is probably why the generators don't learn anything meaningful other than the identity mapping. I also got the feeling that my discriminators just learn to distinguish fake from real images, but nothing about horses or zebras. I would be so happy if somebody could give me a hint.
r/MachineLearning - [D] Flow-Based Generative Models, Bijective Transforms and Neural Lossless Compression
In order to be able to sample from p(x) all generative models attempt to learn a function from a known prior distribution p(z) to the natural distribution p(x). I don't think this is true. Some generative models are capable of sampling the learned p(x) directly, like autoregressive models which for example might model the joint distribution over all pixels in an image by using the probability product rule (e.g. Many common language models do the same over words or characters. Been meaning to read more about flow-based generative modeling.
r/MachineLearning - [D] How much of an effect, if any, does batch size have when doing hyperparameter optimization?
I have been using sci-kit optimize to do hyperparameter search (using gp_minimize specifically) for a neural network. I am working on a binary classification problem with a significant class imbalance. I have been using a batch size of 10, but just came across a tweet and notebook by Francois Chollet where he recommended using a high batch size in class imbalance problems in order so that each batch contains at least a few positive examples. My question is can I just take the networks with the best network architectures I found via my hyperparameter search where I used a batch size of 32, but just retrain them using the same hyperparameters but using a higher batch size? Or, would batch size have a significant effect on hyperparameter optimization, and I would be better off just redoing hyperparameter optimization but this time with a larger batch size?
r/deeplearning - Free cloud GPU credits for deep learning
I am working on https://www.tensorpad.com/ Part of our computational capacity is idle; hence, we're offering credits at a free and discounted rate, so that data scientists can benefit from the resources available, and work on neural networks. You can access the free credits by signing up (https://dashboard.tensorpad.com/ and redeeming "promo450" promo code in the Billing tab (https://dashboard.tensorpad.com/billing). For any questions, please contact us here, through support@tensorpad.com, or the Intercom on the site.