Goto

Collaborating Authors

 Africa



Empirical study towards understanding line search approximations for training neural networks

arXiv.org Machine Learning

Choosing appropriate step sizes is critical for reducing the computational cost of training large-scale neural network models. Mini-batch sub-sampling (MBSS) is often employed for computational tractability. However, MBSS introduces a sampling error, that can manifest as a bias or variance in a line search. This is because MBSS can be performed statically, where the mini-batch is updated only when the search direction changes, or dynamically, where the mini-batch is updated every-time the function is evaluated. Static MBSS results in a smooth loss function along a search direction, reflecting low variance but large bias in the estimated "true" (or full batch) minimum. Conversely, dynamic MBSS results in a point-wise discontinuous function, with computable gradients using backpropagation, along a search direction, reflecting high variance but lower bias in the estimated "true" (or full batch) minimum. In this study, quadratic line search approximations are considered to study the quality of function and derivative information to construct approximations for dynamic MBSS loss functions. An empirical study is conducted where function and derivative information are enforced in various ways for the quadratic approximations. The results for various neural network problems show that being selective on what information is enforced helps to reduce the variance of predicted step sizes.


Best Report on Artificial Intelligence In The Education Sector Market 2026 with Major Eminent Key Players Cognii, IBM Corporation, Quantum Adaptive Learning, ALKES Corporation, Dreambox Learning, Blackboard, Microsoft Corporation, Pearson Corporation โ€“ Market Report Gazette

#artificialintelligence

The ability of the computer program to imitate the human intelligence needed for the task is termed as artificial intelligence (AI). Integration of the artificial intelligence in education sector creates revolution through its result driven approach. The applications in solving the issues such as language processing, reasoning, planning, and cognitive modeling increases the demand for the AI in the education sector. In another learning approach, AI can help organize and synthesize content to support content delivery. The Research Insights has added a new report to its source.


Adversarial Robustness 360 Toolbox v1.0: A Milestone in AI Security

#artificialintelligence

Next week at AI Research Week, hosted by the MIT-IBM Watson AI Lab in Cambridge, MA, we will publish the first major release of the Adversarial Robustness 360 Toolbox (ART). Initially released in April 2018, ART is an open-source library for adversarial machine learning that provides researchers and developers with state-of-the-art tools to defend and verify AI models against adversarial attacks. ART v1.0 marks a milestone in AI security, introducing new features that extend ART to conventional machine learning models and a variety of data types beyond images: The number of reports on real-world exploitations using adversarial attacks against AI is growing, as in the case of anti-virus software, highlighting the importance of understanding, improving and monitoring the adversarial robustness of AI models. ART provides a comprehensive and growing set of tools to systematically assess and improve the robustness of AI models against adversarial attacks, including evasion and poisoning. In evasion attacks, the adversary crafts small changes to the original input to an AI model in order to influence its behaviour.


Writers try out their creative ideas on AI storytelling platform - TechTribe Oxford

#artificialintelligence

"Part of what we want is to educate the writing community in a really open way. So we have set this up to find and incubate new writing talent and get them up to speed with what we do." To qualify for The Writers' Room, a track record of screen credits was preferred but not essential.


Leverage new tech opportunities for SDGs achievement in Africa UNDP in Africa

#artificialintelligence

The Assistant Secretary General and Director of the Regional Bureau for Africa of the United Nations Development Programme (UNDP), Ms. Ahunna Eziakonwa, called on African countries to take advantage of the opportunities offered by digital technologies such as artificial intelligence (AI), blockchains and machine learning, and deploy these in various sectors for the achievement of the 17 Sustainable Development Goals (SDGs). She made the call during a panel session at a side event at the 7th Tokyo International Conference on African Development (TICAD7) in Yokohama, Japan. The event, titled "From Idea to Action: Harnessing the Potential of Science, Technology and Innovation (STI) in Africa's Development", was organized by the Japan International Cooperation Agency (JICA) and the World Bank. Ms. Eziakonwa noted that, Africa needs to harness the potential of STI for development by prioritizing policies and making investments to increase access to state-of-the-art technologies such as e-governance, finance and digital literacy and skills โ€“ at secondary and TVET (Technical and Vocational Education and Training) level. She called for the adoption of innovative financing schemes that combine both public and private sector resources and technical expertise for the achievement of the three dimensions of sustainable development: economic, social and environment.


AI Generation: Learnings from Alliance4AI's First 100 Startups in Africa

#artificialintelligence

Those who raise questions about Africa's preparedness for the fourth industrial revolution should look no further than the continent's young entrepreneurs, transcending tough resource constraints to lead a burgeoning AI startup ecosystem. Studies show that young people are more enthusiastic about technology. With the youngest and fastest-growing population on earth (Africa has a median age of 19 years compared to Europe's 41.8 years), there could be no better time for Africa than now. Young people in Africa are rising above infrastructure and resource constraints to create ingenious processes to adopt and apply the fourth industrial revolution technologies like artificial intelligence (AI) to generate more value for their localities. Since we founded the Alliance for Africa's Intelligence (Alliance4ai) one year ago, we have interacted with more than 100 AI startups to learn about their work and support them with a platform where they exchange knowledge and opportunities with students, schools and other players in the ecosystem.


Alliance For AI โ€“ One-stop for everything AI in Africa

#artificialintelligence

Researchers argue global warming boosts population and insect appetite, and fastens the metabolic rate of insect pests, thereby causing them to consume more. It is estimated that with a 2 rise in temperature, insect pests could destroy maize--Africa's most essential food crop--by as much as 30% more than they do today.


The Pentagon's top AI official explains 'computer vision'

#artificialintelligence

SHANAHAN: Without question there are some of those. Computer vision is well-established in commercial industry. However, I have not seen in any case yet [where] you just take a commercial capability and immediately apply it to a military problem. First of all, the data set ... you've got to train it against the different kind of datasets. With Maven, we had to get real, full-motion video from the Middle East, tens of thousands of hours of it, curate it, label it, train against it.


FIRESIDE CHAT WIRED meets the UK Partnership on AI The AI Summit London

#artificialintelligence

During The AI Summit London 2019, Terah Lyons, Founding Executive Director of the Partnership on AI, was joined onstage by WIRED Editor Greg Williams to discuss the AI landscape today, the challenges facing organizations implementing AI, the ethical use of AI, and much, much more. With flagship shows in San Francisco, London, New York, Munich, Hong Kong, Singapore, and Cape Town, 2019 will see over 30,000 delegates from businesses globally joining the AI revolution through The AI Summit events. The AI Summit series uniquely has the support of tech's elite, with our 2019 Industry Partners featuring Agorai, AWS, IBM Watson, Microsoft, Oracle, Google, HCL, Publicis Sapient, Genpact, Intel alongside 300 sponsors and partners. Exclusive, inspirational insights from acclaimed speakers are frequently reported by the world's foremost press including official media partners CBS, Reuters, BBC, The Times, Quartz, Tech Radar.