Goto

Collaborating Authors

 Education


Locality defeats the curse of dimensionality in convolutional teacher-student scenarios

arXiv.org Machine Learning

Convolutional neural networks perform a local and translationally-invariant treatment of the data: quantifying which of these two aspects is central to their success remains a challenge. We study this problem within a teacher-student framework for kernel regression, using `convolutional' kernels inspired by the neural tangent kernel of simple convolutional architectures of given filter size. Using heuristic methods from physics, we find in the ridgeless case that locality is key in determining the learning curve exponent $\beta$ (that relates the test error $\epsilon_t\sim P^{-\beta}$ to the size of the training set $P$), whereas translational invariance is not. In particular, if the filter size of the teacher $t$ is smaller than that of the student $s$, $\beta$ is a function of $s$ only and does not depend on the input dimension. We confirm our predictions on $\beta$ empirically. Theoretically, in some cases (including when teacher and student are equal) it can be shown that this prediction is an upper bound on performance. We conclude by proving, using a natural universality assumption, that performing kernel regression with a ridge that decreases with the size of the training set leads to similar learning curve exponents to those we obtain in the ridgeless case.


Online Learning with Optimism and Delay

arXiv.org Machine Learning

Inspired by the demands of real-time climate and weather forecasting, we develop optimistic online learning algorithms that require no parameter tuning and have optimal regret guarantees under delayed feedback. Our algorithms -- DORM, DORM+, and AdaHedgeD -- arise from a novel reduction of delayed online learning to optimistic online learning that reveals how optimistic hints can mitigate the regret penalty caused by delay. We pair this delay-as-optimism perspective with a new analysis of optimistic learning that exposes its robustness to hinting errors and a new meta-algorithm for learning effective hinting strategies in the presence of delay. We conclude by benchmarking our algorithms on four subseasonal climate forecasting tasks, demonstrating low regret relative to state-of-the-art forecasting models.


SAS and Microsoft Certifications for Data Scientists

#artificialintelligence

There are numerous reasons why a data scientist would be interested in a SAS or Microsoft professional certification. First, it is a great way to pick up a new skill or even improve an existing skill. Certifications can help with professional and career development. And now, you can even take certification exams from the comfort of your own home. I've had the opportunity to earn several SAS and Microsoft certifications, so in today's article, I want to share my thoughts around each one to help you decide which is right for you!


Become a Robotics Software Engineer

#artificialintelligence

In addition, learn and apply robotics software engineering algorithms such as localization, mapping, and navigation. Program robots using ROS, C, and the robotics algorithms that you'll learn in this program.


Reports of the Association for the Advancement of Artificial Intelligence's 2021 Spring Symposium Series

Interactive AI Magazine

The Association for the Advancement of Artificial Intelligence's 2021 Spring Symposium Series was held virtually from March 22-24, 2021. There were ten symposia in the program: Applied AI in Healthcare: Safety, Community, and the Environment, Artificial Intelligence for K-12 Education, Artificial Intelligence for Synthetic Biology, Challenges and Opportunities for Multi-Agent Reinforcement Learning, Combining Machine Learning and Knowledge Engineering, Combining Machine Learning with Physical Sciences, Implementing AI Ethics, Leveraging Systems Engineering to Realize Synergistic AI/Machine-Learning Capabilities, Machine Learning for Mobile Robot Navigation in the Wild, and Survival Prediction: Algorithms, Challenges and Applications. This report contains summaries of all the symposia. The two-day international virtual symposium included invited speakers, presenters of research papers, and breakout discussions from attendees around the world. Registrants were from different countries/cities including the US, Canada, Melbourne, Paris, Berlin, Lisbon, Beijing, Central America, Amsterdam, and Switzerland. We had active discussions about solving health-related, real-world issues in various emerging, ongoing, and underrepresented areas using innovative technologies including Artificial Intelligence and Robotics. We primarily focused on AI-assisted and robot-assisted healthcare, with specific focus on areas of improving safety, the community, and the environment through the latest technological advances in our respective fields. The day was kicked off by Raj Puri, Physician and Director of Strategic Health Initiatives & Innovation at Stanford University spoke about a novel, automated sentinel surveillance system his team built mitigating COVID and its integration into their public-facing dashboard of clinical data and metrics. Selected paper presentations during both days were wide ranging including talks from Oliver Bendel, a Professor from Switzerland and his Swiss colleague, Alina Gasser discussing co-robots in care and support, providing the latest information on technologies relating to human-robot interaction and communication. Yizheng Zhao, Associate Professor at Nanjing University and her colleagues from China discussed views of ontologies with applications to logical difference computation in the healthcare sector. Pooria Ghadiri from McGill University, Montreal, Canada discussed his research relating to AI enhancements in health-care delivery for adolescents with mental health problems in the primary care setting.


How Long Does It Take to Learn Python? (& 5 Learning Hacks)

#artificialintelligence

Yes. Python developers are in demand across a variety of industries, but the Python market is particularly hot in the world of data science, where Python is used for everything from basic data analysis and visualization to creating advanced machine learning algorithms. HiringLab investigated tech skills trends in early 2020 and found demand for Python skills in data science was up 128% over the past five years, and grew 12% over the course of 2019! Data analysts, data scientists, and data engineers with Python skills can earn salaries well over $100,000 per year in the United States, and these types of roles enjoy far-above-average salaries in most other parts of the world. From a financial perspective, investing in learning Python is almost certainly worth it. The answer to this question depends on what your goals are.


Every workplace can be a place of continual learning

MIT Technology Review

While businesses in every sector have been working toward a digital transformation for the past several years, covid-19 accelerated this shift across industries. New technologies are advancing at a pace that requires employers to continuously retrain their workforce to stay current. Organizations must become places of learning if they are to prepare workers for jobs of the future. Joe Schaefer is Chief Transformation Officer at Strategic Education. The World Economic Forum has published one estimate suggesting that technologies like artificial intelligence (AI) could displace 75 million jobs by 2022 but may also create 133 million new roles, and a study by IBM's Institute for Business Value predicts as many as 120 million workers in the world's 12 largest economies may need to be retrained in the next three years as a result of an increasing shift toward and embrace of automation and AI.


Artificial Intelligence and Machine Learning Programs Starting in June 2021

#artificialintelligence

Artificial Intelligence and Machine Learning have grown rapidly over the last few years. With an increase in popularity, the demand for AI and Machine Learning professionals has also increased. Learn Artificial Intelligence and Machine Learning from world-renowned universities taught by industry experts. Great Learning offers the best artificial intelligence and machine learning courses. It gives you the opportunity to earn a certificate from top global universities in collaboration with Great Lakes Executive Learning. Without further ado, here are the top artificial intelligence courses starting from June 2021.


Online Data Product Manager Training

#artificialintelligence

Product Manager is a top 5 job on LinkedIn's Most Promising Jobs for 2019, and one of the most coveted roles in large tech enterprises, as well as entrepreneurial startups. All products developed for today's market are data products - running on data-derived insights to provide the right experience, to the right user, at the right time. Companies like Amazon, Netflix, Google, and more are able to provide personalized and engaging experiences to users because they utilize data science, machine learning, and artificial intelligence to better meet user needs. In the Data Product Manager Nanodegree program, you will hone specialized skills in Product Management, a role with a starting base salary of $125,000 and be equipped to build products that leverage data to position customers and businesses to thrive. This program is designed for students who want to assume key leadership roles in data product development and strategy in their company.


Your Future May Lie With an Artificial Intelligence Certificate - TFOT

#artificialintelligence

Image by Mudassar Iqbal from Pixabay There are a lot of ways to start exploring the future, and considering what you want to do with your career could be a good start. If you’re not sure, it may be wise to look into options that involve technology. With the growing and expanding nature of technological ...