Goto

Collaborating Authors

 johannesburg


Linear Correlation in LM's Compositional Generalization and Hallucination

Peng, Letian, An, Chenyang, Hao, Shibo, Dong, Chengyu, Shang, Jingbo

arXiv.org Artificial Intelligence

The generalization of language models (LMs) is undergoing active debates, contrasting their potential for general intelligence with their struggles with basic knowledge composition (e.g., reverse/transition curse). This paper uncovers the phenomenon of linear correlations in LMs during knowledge composition. For explanation, there exists a linear transformation between certain related knowledge that maps the next token prediction logits from one prompt to another, e.g., "X lives in the city of" $\rightarrow$ "X lives in the country of" for every given X. This mirrors the linearity in human knowledge composition, such as Paris $\rightarrow$ France. Our findings indicate that the linear transformation is resilient to large-scale fine-tuning, generalizing updated knowledge when aligned with real-world relationships, but causing hallucinations when it deviates. Empirical results suggest that linear correlation can serve as a potential identifier of LM's generalization. Finally, we show such linear correlations can be learned with a single feedforward network and pre-trained vocabulary representations, indicating LM generalization heavily relies on the latter.


Design of a Smart Waste Management System for the City of Johannesburg

Komane, Beauty L., Mathonsi, Topside E.

arXiv.org Artificial Intelligence

Every human being in this world produces waste. South Africa is a developing country with many townships that have limited waste resources. Over-increasing population growth overpowers the volume of most municipal authorities to provide even the most essential services. Waste in townships is produced via littering, dumping of bins, cutting of trees, dumping of waste near rivers, and overrunning of waste bins. Waste increases diseases, air pollution, and environmental pollution, and lastly increases gas emissions that contribute to the release of greenhouse gases. The ungathered waste is dumped widely in the streets and drains contributing to flooding, breeding of insects, rodent vectors, and spreading of diseases. Therefore, the aim of this paper is to design a smart waste management system for the city of Johannesburg. The city of Johannesburg contains waste municipality workers and has provided some areas with waste resources such as waste bins and trucks for collecting waste. But the problem is that the resources only are not enough to solve the problem of waste in the city. The waste municipality uses traditional ways of collecting waste such as going to each street and picking up waste bins. The traditional way has worked for years but as the population is increasing more waste is produced which causes various problems for the waste municipalities and the public at large. The proposed system consists of sensors, user applications, and a real-time monitoring system. This paper adopts the experimental methodology.


Data Architect at Luno - Johannesburg

#artificialintelligence

Our engineering team is split into organisations which we call Fleets. Each Fleet focuses on a core customer journey (onboarding, security, payments, support, new business, growth, and marketing, etc.). Each of these fleets contains multiple smaller teams called Pods, each of which focuses on a specific aspect of the product. Pods will include a product owner, product designer, back-end engineers, Android, iOS, and Web developers, who each bring a unique perspective to the problem you are all contributing towards. Luno offers a "Remote but Reachable" working approach.


Engineer, Machine Learning at Standard Bank Group - Johannesburg, South Africa

#artificialintelligence

Standard Bank Group is a leading Africa-focused financial services group, and an innovative player on the global stage, that offers a variety of career-enhancing opportunities – plus the chance to work alongside some of the sector's most talented, motivated professionals. Our clients range from individuals, to businesses of all sizes, high net worth families and large multinational corporates and institutions. Bringing true, meaningful value to our clients and the communities we serve and creating a real sense of purpose for you. To work with business stakeholders to identify and deliver on new AI initiatives. To apply deep domain expertise to shape/influence the AI-thinking in the organisation through thought leadership; enabling the successful adoption and acceleration of AI and ML across Standard Bank Group (SBG), ensuring the needs of stakeholders are correctly understood and addressed.


SAP CML Developer at Standard Bank Group - Johannesburg, South Africa

#artificialintelligence

Degree in Information Technology Experience Required 5-7 years - Broad experience in translating business and functional requirements into technical specifications and developing the programming code to create the solutions.


Manager, Data Science at Standard Bank Group - Johannesburg, South Africa

#artificialintelligence

To assist with advanced analytics and deep insight by being a proactive partner in providing customer centric data analytics, including alternative methods of aggregating raw data (internal and external), which will ultimately influence the way in which we view and act on customer behaviour and customer health, i.e. identifying risks and opportunities. Implementing the use of machine learning to challenge and improve predictive modelling techniques, the available characteristic universe across the customer life cycle and optimising segmentation to enhance model performance. Solutions should satisfy customer centricity and digitisation objectives. Including but not limited to Extracting meaningful insights from data, Predictive modelling and machine learning, Stakeholder Engagement, Leadership and People Management.


Engineer, Data at Standard Bank Group - Johannesburg, South Africa

#artificialintelligence

The purpose of this role is to construct data acquisition, warehousing and reporting solutions. The role is expected to provide technical solutions in response to the needs of stakeholders by interpreting business requirements; defining solution; defining build and test tasks; constructing solutions; performing testing; participating in the deployment of solutions and ensure the systems meet immediate business requirements by providing third tier support and constructing enhancements to systems in Production.


Data Analyst, Execution, CTR at Standard Bank Group - Johannesburg, South Africa

#artificialintelligence

To conduct regulatory monitoring within Consumer and High Net Worth on a specific set of regulatory requirements (e.g., PEPS, Sanctions, EDD, FIC Amendment Bill, CTR, Waterfall (KYC), AML Training, Quality Assurance, etc.) as prescribed by the Regulatory Monitoring framework and drives first level of defence remediation of breaches. To provide insights on the state of regulatory adherence within allocated portfolio and prepare appropriate reports as input into overall regulatory reporting.


Internship - Data Science (For Current Students) at Visa - Johannesburg, South Africa

#artificialintelligence

As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce. At Visa, your individuality fits right in.


Head, Data Engineering at Standard Bank Group - Johannesburg, South Africa

#artificialintelligence

Standard Bank Group is a leading Africa-focused financial services group, and an innovative player on the global stage, that offers a variety of career-enhancing opportunities – plus the chance to work alongside some of the sector's most talented, motivated professionals. Our clients range from individuals, to businesses of all sizes, high net worth families and large multinational corporates and institutions. Bringing true, meaningful value to our clients and the communities we serve and creating a real sense of purpose for you. To own and account for a large application platform or a collection of application platforms that deliver a capability/service. To deliver deep specialist technical expertise, leadership in the design, build, securing, monitoring of data pipelines and data stores to applicable architecture, solution designs, standards, and governance requirements.