Education
Book Review: Machine Learning with PyTorch and Scikit-Learn - insideBIGDATA
The enticing new title courtesy of Packt Publishing, "Machine Learning with PyTorch and Scikit-Learn," by Sebastian Raschka, Yuxi (Hayden) Liu, and Vahid Mirjalili is a welcome addition to any data scientist's list of learning resources. This 2022 tome consists of 741 well-crafted pages designed to provide a comprehensive framework for working in the realm of machine learning and deep learning. The book is brimming over with topics that will propel you to a leading-edge understanding of the field. Topical areas include an introduction to ML including a simple implementation of perceptron algorithm, data munging, dimensionality reduction, a tour of classification algorithms (logistic regression, SVM, decision tree, KNN), model evaluation and hyperparameter tuning, ensemble learning, regression, sentiment analysis, and unsupervised learning with clustering. The book then shifts into high gear with a number of contemporary topics in deep learning, all using the popular PyTorch framework: implementing a simple multi-layer ANN, parallelizing neural network training, image classification with CNNs, modeling sequential data with RNNs, transformers and NLP, GANs, graph neural networks, and reinforcement learning.
Towards Homogeneous Modality Learning and Multi-Granularity Information Exploration for Visible-Infrared Person Re-Identification
Liu, Haojie, Xia, Daoxun, Jiang, Wei, Xu, Chao
Visible-infrared person re-identification (VI-ReID) is a challenging and essential task, which aims to retrieve a set of person images over visible and infrared camera views. In order to mitigate the impact of large modality discrepancy existing in heterogeneous images, previous methods attempt to apply generative adversarial network (GAN) to generate the modality-consisitent data. However, due to severe color variations between the visible domain and infrared domain, the generated fake cross-modality samples often fail to possess good qualities to fill the modality gap between synthesized scenarios and target real ones, which leads to sub-optimal feature representations. In this work, we address cross-modality matching problem with Aligned Grayscale Modality (AGM), an unified dark-line spectrum that reformulates visible-infrared dual-mode learning as a gray-gray single-mode learning problem. Specifically, we generate the grasycale modality from the homogeneous visible images. Then, we train a style tranfer model to transfer infrared images into homogeneous grayscale images. In this way, the modality discrepancy is significantly reduced in the image space. In order to reduce the remaining appearance discrepancy, we further introduce a multi-granularity feature extraction network to conduct feature-level alignment. Rather than relying on the global information, we propose to exploit local (head-shoulder) features to assist person Re-ID, which complements each other to form a stronger feature descriptor. Comprehensive experiments implemented on the mainstream evaluation datasets include SYSU-MM01 and RegDB indicate that our method can significantly boost cross-modality retrieval performance against the state of the art methods.
Information-theoretic Online Memory Selection for Continual Learning
Sun, Shengyang, Calandriello, Daniele, Hu, Huiyi, Li, Ang, Titsias, Michalis
A challenging problem in task-free continual learning is the online selection of a representative replay memory from data streams. In this work, we investigate the online memory selection problem from an information-theoretic perspective. To gather the most information, we propose the surprise and the learnability criteria to pick informative points and to avoid outliers. We present a Bayesian model to compute the criteria efficiently by exploiting rank-one matrix structures. We demonstrate that these criteria encourage selecting informative points in a greedy algorithm for online memory selection. Furthermore, by identifying the importance of the timing to update the memory, we introduce a stochastic informationtheoretic reservoir sampler (InfoRS), which conducts sampling among selective points with high information. Compared to reservoir sampling, InfoRS demonstrates improved robustness against data imbalance. Continual learning (Robins, 1995; Goodfellow et al., 2013; Kirkpatrick et al., 2017) aims at training models through a non-stationary data stream without catastrophic forgetting of past experiences. Specifically, replay-based methods (Lopez-Paz & Ranzato, 2017; Rebuffi et al., 2017; Rolnick et al., 2019) tackle the continual learning problem by keeping a replay memory for rehearsals over the past data. Given the limited memory budget, selecting a representative memory becomes critical. The majority of existing approaches focus on task-based continual learning and update the memory based on the given task boundaries. Since the requirement for task boundaries is usually not realistic, general continual learning (GCL) (Aljundi et al., 2019a; Delange et al., 2021; Buzzega et al., 2020) has received increasing attention, which assumes that the agent observes the streaming data in an online fashion without knowing task boundaries. GCL makes the online memory selection more challenging since one needs to update the memory in each iteration based only on instant observations. So, successful memory management for GCL needs to be both efficient and effective.
UT Joins New SEC Artificial Intelligence, Data Science Consortium
The University of Tennessee, Knoxville, is among the 14 member universities of the Southeastern Conference forming a new artificial intelligence consortium. The consortium is designed to grow opportunities in the fast-changing fields of AI and data science, which are expected to be foundational for the future of industry, education, and research. It is believed to be the first athletics conference collaboration to focus on AI for workforce development. "Artificial intelligence and data science have universal applications, and we are proud to join with SEC universities to lead education and research in these emerging fields," said Provost and Senior Vice Chancellor John Zomchick. "The consortium will create exciting opportunities for our faculty, staff, and students to explore AI and data science and shape their future."
The Layperson's Introduction to Computer Vision
In addition to being a machine learning engineer for my day job, I also volunteer in a number of different capacities to promote data science and machine learning. The company that I currently work for (State Farm) has a partnership with local area high schools to promote their STEM programs. In the specific high school I volunteer with, students have the opportunity to attend special classes throughout all four years of high school to eventually earn an associate's degree in Computer Science in partnership with a local community college. I've been with this cohort since they started their freshman year, and they are now entering the second semester of their junior year. As such, their teacher has asked the students to come up with potential computer science projects to benefit their school.
Confusion detection with EEG signals
Do students always ask doubts when they are confused? How do you know if someone is confused? Confusions happen when we are not able to comprehend what we see/hear. EEG, which stands for electroencephalography, is a method to record the electrical activity of the brain using electrophysiological monitoring. This is done through non-invasive (in most cases) electrodes placed along the scalp that records the brain's spontaneous electrical activity over a period of time.
A new approach that could improve how robots interact in conversational groups
To effectively interact with humans in crowded social settings, such as malls, hospitals, and other public spaces, robots should be able to actively participate in both group and one-to-one interactions. Most existing robots, however, have been found to perform much better when communicating with individual users than with groups of conversing humans. Hooman Hedayati and Daniel Szafir, two researchers at University of North Carolina at Chapel Hill, have recently developed a new data-driven technique that could improve how robots communicate with groups of humans. This method, presented in a paper presented at the 2022 ACM/IEEE International Conference on Human-Robot Interaction (HRI '22), allows robots to predict the positions of humans in conversational groups, so that they do not mistakenly ignore a person when their sensors are fully or partly obstructed. "Being in a conversational group is easy for humans but challenging for robots," Hooman Hedayati, one of the researchers who carried out the study, told TechXplore.
Deep Learning Bootcamp with 5 Capstone Projects
Learn about different Activation Functions used in a Neural Network. Implement Artificial Neural Networks to solve real world Problems. Implement the LSTMs to solve Sequential Problems. Learn about different Activation Functions used in a Neural Network. Implement Artificial Neural Networks to solve real world Problems.
The Beginner's Guide to Artificial Intelligence in Unity.
Do your non-player characters lack drive and ambition? Are they slow, stupid and constantly banging their heads against the wall? Then this course is for you. Join Penny as she explains, demonstrates and assists you in creating your very own NPCs in Unity with C#. All you need is a sound knowledge of Unity, C# and the ability to add two numbers together. In this course, Penny reveals the most popular AI techniques used for creating believable character behaviour in games using her internationally acclaimed teaching style and knowledge from over 25 years working with games, graphics and having written two award winning books on games AI.
MLOps Engineer
As an MLOps Engineer, you'll know how to engineer beautiful code in Python and take pride in what you produce. You'll be an advocate of high-quality engineering and best-practice in production software as well as rapid prototypes. Whilst the position is a hands-on technical role, we'd be particularly interested to find candidates with a desire to lead projects and take an active role in leading client discussions. Your responsibilities will involve building trusted relationships with prospects, finding creative ways to use machine learning to solve problems, scoping projects, and overseeing the delivery of these engagements. To be successful, you will need an understanding of ML & Data Science fundamentals, as well as best software engineering practices such as automated testing and CI/CD.