Africa
Learning Rate Annealing Can Provably Help Generalization, Even for Convex Problems
Learning rate schedule can significantly affect generalization performance in modern neural networks, but the reasons for this are not yet understood. Li-Wei-Ma (2019) recently proved this behavior can exist in a simplified non-convex neural-network setting. In this note, we show that this phenomenon can exist even for convex learning problems -- in particular, linear regression in 2 dimensions. We give a toy convex problem where learning rate annealing (large initial learning rate, followed by small learning rate) can lead gradient descent to minima with provably better generalization than using a small learning rate throughout. In our case, this occurs due to a combination of the mismatch between the test and train loss landscapes, and early-stopping.
An Object Model for the Representation of Empirical Knowledge
Colloc, Joël, Boulanger, Danielle
We are currently designing an object oriented model which describes static and dynamical knowledge in diff{\'e}rent domains. It provides a twin conceptual level. The internal level proposes: the object structure composed of sub-objects hierarchy, structure evolution with dynamical functions, same type objects comparison with evaluation functions. It uses multiple upward inheritance from sub-objects properties to the Object. The external level describes: object environment, it enforces object types and uses external simple inheritance from the type to the sub-types.
Summarising the keynotes at ICLR: part one
The virtual International Conference on Learning Representations (ICLR) was held on 26-30 April and included eight keynote talks, with a wide range of topics covered. Courtesy of the conference organisers you can watch the talks in full and see the question and answer sessions too. Africa has a population of over one billion people, over 3000 ethnic groups, and over 2000 different languages. This rich diversity offers an excellent opportunity to address complex research questions within the African continent. Research in Africa within the AI space can have global impact.
Covid-19 news: UK economy shrank at fastest pace since 2008
UK GDP fell by 2 per cent in the first quarter of 2020, the most rapid contraction of the UK's economy since the 2008 financial crisis. Rishi Sunak, the chancellor of the exchequer, said, "It is now very likely that the UK economy will face a significant recession this year, and we're already in the middle of that as we speak." The Bank of England predicts that the UK economy could shrink by as much as 14 per cent in 2020. In England some people who aren't able to work from home returned to work today, as part of the government's recent easing of certain restrictions. Despite the government urging people to avoid public transport if they could, some commuters said buses and trains were too crowded to practice social distancing. It could be as long as "four or five years" before covid-19 is under control and the pandemic could "potentially get worse", according to the World Health Organization's chief scientist Soumya Swaminathan. Speaking at an FT conference, she said a vaccine "seems ...
Prive-HD: Privacy-Preserved Hyperdimensional Computing
Khaleghi, Behnam, Imani, Mohsen, Rosing, Tajana
The privacy of data is a major challenge in machine learning as a trained model may expose sensitive information of the enclosed dataset. Besides, the limited computation capability and capacity of edge devices have made cloud-hosted inference inevitable. Sending private information to remote servers makes the privacy of inference also vulnerable because of susceptible communication channels or even untrustworthy hosts. In this paper, we target privacy-preserving training and inference of brain-inspired Hyperdimensional (HD) computing, a new learning algorithm that is gaining traction due to its light-weight computation and robustness particularly appealing for edge devices with tight constraints. Indeed, despite its promising attributes, HD computing has virtually no privacy due to its reversible computation. We present an accuracy-privacy trade-off method through meticulous quantization and pruning of hypervectors, the building blocks of HD, to realize a differentially private model as well as to obfuscate the information sent for cloud-hosted inference. Finally, we show how the proposed techniques can be also leveraged for efficient hardware implementation.
Simulation-Based Inference for Global Health Decisions
de Witt, Christian Schroeder, Gram-Hansen, Bradley, Nardelli, Nantas, Gambardella, Andrew, Zinkov, Rob, Dokania, Puneet, Siddharth, N., Espinosa-Gonzalez, Ana Belen, Darzi, Ara, Torr, Philip, Baydin, Atılım Güneş
This is fomenting the development of comprehensive modelling The COVID-19 pandemic has highlighted the importance and simulation to support the design of health interventions of in-silico epidemiological modelling in predicting and policies, and to guide decision-making in a variety of the dynamics of infectious diseases to inform health system domains [22, 49]. For example, simulations health policy and decision makers about suitable prevention have provided valuable insight to deal with public health and containment strategies. Work in this setting problems such as tobacco consumption in New Zealand [50], involves solving challenging inference and control and diabetes and obesity in the US [58]. They have been problems in individual-based models of ever increasing used to explore policy options such as those in maternal and complexity. Here we discuss recent breakthroughs antenatal care in Uganda [44], and applied to evaluate health in machine learning, specifically in simulation-based reform scenarios such as predicting changes in access to inference, and explore its potential as a novel venue primary care services in Portugal [21]. Their applicability for model calibration to support the design and evaluation in informing the design of cancer screening programmes of public health interventions. To further stimulate has been also discussed [42, 23]. Recently, simulations have research, we are developing software interfaces that informed the response to the COVID-19 outbreak [19].
Global trade impact of the Coronavirus Blue Prism Technology Services Market Emerging Market Trends, Size, Share and Growth Analysis 2018 to 2028 – Jewish Market Reports
COVID-19 (Coronavirus) has resulted in many advantages and disadvantages for companies in the Blue Prism Technology Services market. Research report of this Blue Prism Technology Services market is highlights key strategies that can help reduce the impact of COVID-19 on diverse business practices. Analysts of Fact.MR, in a recently published market study, shares important factors that are expected to shape the growth of the Blue Prism Technology Services market over the forecast period (20XX-20XX). The current trends, market drivers, strategic collaborations, and threats are thoroughly evaluated to provide a clear understanding of the current market landscape and the course the Blue Prism Technology Services market is likely to take over the upcoming decade. According to the report, the Blue Prism Technology Services market is poised to register a CAGR growth of XX% throughout the forecast period owing to several key factors including growing investments in the Blue Prism Technology Services space, innovations with a rise in the number of research and development projects.
Global trade impact of the Coronavirus Blue Prism Technology Services Market Emerging Market Trends, Size, Share and Growth Analysis 2018 to 2028 – Jewish Market Reports
COVID-19 (Coronavirus) has resulted in many advantages and disadvantages for companies in the Blue Prism Technology Services market. Research report of this Blue Prism Technology Services market is highlights key strategies that can help reduce the impact of COVID-19 on diverse business practices. Analysts of Fact.MR, in a recently published market study, shares important factors that are expected to shape the growth of the Blue Prism Technology Services market over the forecast period (20XX-20XX). The current trends, market drivers, strategic collaborations, and threats are thoroughly evaluated to provide a clear understanding of the current market landscape and the course the Blue Prism Technology Services market is likely to take over the upcoming decade. According to the report, the Blue Prism Technology Services market is poised to register a CAGR growth of XX% throughout the forecast period owing to several key factors including growing investments in the Blue Prism Technology Services space, innovations with a rise in the number of research and development projects.
Defining "Vision" in "Computer Vision"
Computer Vision also referred as Vision is the recent cutting edge field within computer science that deals with enabling computers, devices or machines, in general, to see, understand, interpret or manipulate what is being seen. Computer Vision technology implements deep learning techniques and in few cases also employs Natural Language Processing techniques as a natural progression of steps to analyze extracted text from images. With all the advancements of deep learning, building functions like image classification, object detection, tracking, and image manipulation has become more simpler and accurate thus leading way to exploring more complex autonomous applications like self-driving cars, humanoids or drones. With deep learning, we can now manipulate images, for example superimpose Tom Cruise's features onto another face. Or convert a picture into a sketch mode or water color painting mode.
A network-based transfer learning approach to improve sales forecasting of new products
Karb, Tristan, Kühl, Niklas, Hirt, Robin, Glivici-Cotruta, Varvara
Data-driven methods -- such as machine learning and time series forecasting -- are widely used for sales forecasting in the food retail domain. However, for newly introduced products insufficient training data is available to train accurate models. In this case, human expert systems are implemented to improve prediction performance. Human experts rely on their implicit and explicit domain knowledge and transfer knowledge about historical sales of similar products to forecast new product sales. By applying the concept of Transfer Learning, we propose an analytical approach to transfer knowledge between listed stock products and new products. A network-based Transfer Learning approach for deep neural networks is designed to investigate the efficiency of Transfer Learning in the domain of food sales forecasting. Furthermore, we examine how knowledge can be shared across different products and how to identify the products most suitable for transfer. To test the proposed approach, we conduct a comprehensive case study for a newly introduced product, based on data of an Austrian food retailing company. The experimental results show, that the prediction accuracy of deep neural networks for food sales forecasting can be effectively increased using the proposed approach.