Africa
The Predictive Forward-Forward Algorithm
Ororbia, Alexander, Mali, Ankur
The algorithm known as backpropagation of errors [59, 32], or "backprop" for short, has long faced criticism concerning its neurobiological plausibility [10, 14, 56, 35, 15]. Despite powering the tremendous progress and success behind deep learning and its every-growing myriad of promising applications [57, 12], it is improbable that backprop is a viable model of learning in the brain, such as in cortical regions. Notably, there are both practical and biophysical issues [15, 35], and, among these issues, there is a lack of evidence that: 1) neural activities are explicitly stored to be used later for synaptic adjustment, 2) error derivatives are backpropagated along a global feedback pathway to generate teaching signals, 3) the error signals move back along the same neural pathways used to forward propagate information, and, 4) inference and learning are locked to be largely sequential (instead of massively parallel). Furthermore, when processing temporal data, it is certainly not the case that the neural circuitry of the brain is unfolded backward through time to adjust synapses [42] (as in backprop through time). Recently, there has been a growing interest in the research domain of brain-inspired computing, which focuses on developing algorithms and computational models that attempt to circumvent or resolve critical issues such as those highlighted above. Among the most powerful and promising ones is predictive coding (PC) [18, 48, 13, 4, 51, 41], and among the most recent ones is the forward-forward (FF) algorithm [19]. These alternatives offer different means of conducting credit assignments with performance similar to backprop, but to the contrary, are more likely consistent with and similar to real biological neuron learning (see Figure 1 for a graphical depiction and comparison of respective credit assignment setups). This paper will propose a novel model and learning process, the predictive forward-forward (PFF) process, that generalizes and combines FF and PC into a robust stochastic neural system that simultaneously learns a representation and generative model in a biologically-plausible fashion. Like the FF algorithm, the PFF procedure offers a promising, potentially helpful model of biological neural circuits, a potential candidate system for low-power analog hardware and neuromorphic circuits, and a potential backprop-alternative worthy of future investigation and study.
High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance
Balasubramanian, Krishnakumar, Ghosal, Promit, He, Ye
We derive high-dimensional scaling limits and fluctuations for the online least-squares Stochastic Gradient Descent (SGD) algorithm by taking the properties of the data generating model explicitly into consideration. Our approach treats the SGD iterates as an interacting particle system, where the expected interaction is characterized by the covariance structure of the input. Assuming smoothness conditions on moments of order up to eight orders, and without explicitly assuming Gaussianity, we establish the high-dimensional scaling limits and fluctuations in the form of infinite-dimensional Ordinary Differential Equations (ODEs) or Stochastic Differential Equations (SDEs). Our results reveal a precise three-step phase transition of the iterates; it goes from being ballistic, to diffusive, and finally to purely random behavior, as the noise variance goes from low, to moderate and finally to very-high noise setting. In the low-noise setting, we further characterize the precise fluctuations of the (scaled) iterates as infinite-dimensional SDEs. We also show the existence and uniqueness of solutions to the derived limiting ODEs and SDEs. Our results have several applications, including characterization of the limiting mean-square estimation or prediction errors and their fluctuations which can be obtained by analytically or numerically solving the limiting equations.
Ukraine decries 'symbolic blow' as Russia assumes UN presidency
Ukraine has branded Russia's presidency of the UN Security Council for the month of April "a symbolic blow," joining a chorus of outrage from Western countries. Moscow assumes the presidency as part of its monthly rotation between the Security Council's 15 member states, with ties with the West at their lowest point since the Cold War over Russia's invasion of Ukraine. Andriy Yermak, the Ukrainian president's chief of staff, said Russia's tenure was a "symbolic blow." It is another symbolic blow to the rules-based system of international relations," he wrote on Twitter. Ukraine's Foreign Minister Dmytro Kuleba said Russia assuming the presidency was "a slap in the face to the international community". "I urge the current UNSC members to thwart any Russian attempts to abuse its presidency," he wrote on Twitter on Saturday, calling Russia "an outlaw on the UNSC". Moscow last chaired the council in February 2022, the same month it invaded Ukraine โ prompting Kyiv to call for Russia's removal from the council. Russia will hold little influence on decisions but will be in charge of the agenda. Moscow has said Foreign Minister Sergey Lavrov is planning to chair a UN Security Council meeting this month on "effective multilateralism". Russian foreign ministry spokeswoman Maria Zakharova also said that Lavrov would lead a debate on the Middle East on April 25. The Kremlin said on Friday it planned to "exercise all its rights" in the role. The White House urged Russia to "conduct itself professionally" when it assumes the role, saying there was no means to block Moscow from the post. "A country that flagrantly violates the UN Charter and invades its neighbour has no place on the UN Security Council," White House spokesperson Karine Jean-Pierre said on Friday. "Unfortunately, Russia is a permanent member of the Security Council and no feasible international legal pathway exists to change that reality," she added, calling the presidency "a largely ceremonial position". The Baltic states also expressed their concern. Estonia's UN envoy Rein Tammsaar, speaking also on behalf of Latvia and Lithuania, warned the Security Council Friday as it met to discuss Russia's plans to deploy tactical nuclear weapons in neighbouring Belarus. "Isn't it telling that tomorrow, on the anniversary of the Bucha killings, Russia will assume the Presidency of the UN Security Council?
How the world will look in 2050, according to experts
Futurists of the 1990s predicted that we'd be living underwater or riding flying cars by this point -- but now experts are warning of a much scarier future. Other predictions include making contact with aliens -- but whether or not that's a bad thing remains unknown. It's not all doom and gloom, though, with technology expected to have made the afterlife possible. AI'overlords' could turn everyone into serfs Right now, people are focused on AI potentially causing job losses - but the reality could be far worse. That's according to George Stakhov, chief strategy officer for the global ad agency DDB EMEA who created an AI tool named'The Uncreative Agency'.
Chart: In AI We Trust
Artificial intelligence in some shape or form has been a part of everyday life for years, but the meteoric rise of ChatGPT and the resulting aggressive development pace of conversational and generative AI models is, for the first time ever, putting the underlying technology into the hands of the general public. Even though current large language models are primarily able to guess the best-fitting next word in a sentence based on the corpus of content they were fed, CEOs, researchers and AI experts are now urging the industry to pump the brakes on training and developing models more capable than OpenAI's GPT-4. The company's latest large language model is currently available in a limited capacity for ChatGPT Plus subscribers and will soon be integrated into Microsoft productivity and security products. According to an open letter signed by influential figures like Elon Musk and Stability AI CEO Emad Mostaque, "powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable." The letter was released by the Future of Life Institute, a non-governmental organization founded in 2014 by MIT professor Max Tegmark and Skype co-founder Jaan Tallinn, among others.
Medical Pathologies Prediction : Systematic Review and Proposed Approach
Taoussi, Chaimae, Hafidi, Imad, Metrane, Abdelmoutalib
The healthcare sector is an important pillar of every community, numerous research studies have been carried out in this context to optimize medical processes and improve care quality and facilitate patient management. In this article we have analyzed and examined different works concerning the exploitation of the most recent technologies such as big data, artificial intelligence, machine learning, and deep learning for the improvement of health care, which enabled us to propose our general approach concentrating on the collection, preprocessing and clustering of medical data to facilitate access, after analysis, to the patients and health professionals to predict the most frequent pathologies with better precision within a notable timeframe. keywords: Healthcare, big data, artificial intelligence, automatic language processing, data mining, predictive models.
NeuroDAVIS: A neural network model for data visualization
Maitra, Chayan, Seal, Dibyendu B., De, Rajat K.
The task of dimensionality reduction and visualization of high-dimensional datasets remains a challenging problem since long. Modern high-throughput technologies produce newer high-dimensional datasets having multiple views with relatively new data types. Visualization of these datasets require proper methodology that can uncover hidden patterns in the data without affecting the local and global structures within the data. To this end, however, very few such methodology exist, which can realise this task. In this work, we have introduced a novel unsupervised deep neural network model, called NeuroDAVIS, for data visualization. NeuroDAVIS is capable of extracting important features from the data, without assuming any data distribution, and visualize effectively in lower dimension. It has been shown theoritically that neighbourhood relationship of the data in high dimension remains preserved in lower dimension. The performance of NeuroDAVIS has been evaluated on a wide variety of synthetic and real high-dimensional datasets including numeric, textual, image and biological data. NeuroDAVIS has been highly competitive against both t-Distributed Stochastic Neighbor Embedding (t-SNE) and Uniform Manifold Approximation and Projection (UMAP) with respect to visualization quality, and preservation of data size, shape, and both local and global structure. It has outperformed Fast interpolation-based t-SNE (Fit-SNE), a variant of t-SNE, for most of the high-dimensional datasets as well. For the biological datasets, besides t-SNE, UMAP and Fit-SNE, NeuroDAVIS has also performed well compared to other state-of-the-art algorithms, like Potential of Heat-diffusion for Affinity-based Trajectory Embedding (PHATE) and the siamese neural network-based method, called IVIS. Downstream classification and clustering analyses have also revealed favourable results for NeuroDAVIS-generated embeddings.
BuzzFeed is using AI to write SEO-bait travel guides - The Verge
You can see the full list of travel articles from BuzzFeed's "Buzzy" AI tool right here. Right now, there are 44 posts covering destinations like Morocco, Stockholm, and Cape May, New Jersey. The articles are "written with the help of Buzzy the Robot (aka our Creative AI Assistant) but powered by human ideas," BuzzFeed says on Buzzy's profile. The top of each story I've seen includes a line noting that an article was "collaboratively written" by a human and Buzzy.
New advances in artificial intelligence applications in higher education
International Journal of Educational Technology in Higher Education is calling for submissions to our Collection on New advances in artificial intelligence applications in higher education. There has been growing interest in the educational potential of Artificial Intelligence (AI) applications within the field of educational technology for the past decade. Despite the recent peak of excitement towards advanced features and techniques of AI-driven language models and OpenAI's ChatGPT, their actual impact on higher education (HE) institutions and participants have been largely unknown. Thus, the discussions in the field have continuously remained, mainly consisting of overstated hype and untested hypotheses, either optimistic or pessimistic, about the impact of AI applications. About three years ago, the editors of the ETHE Special Issue "Can artificial intelligence transform higher education?" However, a lot has happened since then.
Pharmacy Benefit Management Market Size
For instance, according to the Centers for Medicare & Medicaid Services, in December 2021, it was reported that the total national health expenditure in the U.S. increased to USD 4.1 trillion in 2020, which was a growth of 9.7% as compared to the previous year. Thus, a significant number of insurance providers are relying on the service providers to negotiate the drug price with retail pharmacy units and lower the price of the listed drugs in the insurance coverage. Furthermore, increasing initiatives, such as extending mail order delivery services and strengthening distribution network in remote areas, were responsible for the growing adoption of these services. Hence, these initiatives by the major players coupled with increasing demand for specialty drugs boosted the pharmacy benefit management market growth during the COVID-19 pandemic. Request a Free sample to learn more about this report.