Personal
Open AI: is artificial intelligence the future of creativity?
Is it going to take over the world? All questions a novice like myself is thinking whenever someone far more clued-up on the ever changing advancement of technology turns the conversation onto the dreaded topic of Artificial Intelligence (AI). Usually I let them dribble on and myself stay silent in the hope that our chat comes to an end, however, you illustrators and writers out there may want to be paying close attention to the recent craze sweeping through twitter boards and reddit threads. Open AI (based in San Francisco) has been growing in popularity recently on account of its new Playground and Dall-E 2 systems. The Playground system is a new predictive language tool in which you input a question or a command and in a matter of seconds an AI responds with cohesive and calculated language.
AI Will One Day Make Better Decisions than CEOs, Nobel Laureate Kahneman Says
CEOs and senior executives do not occupy such positions for nothing: they accumulate many years of experience, play a leadership role, and have technical and social-emotional skills. But in the near future, they will have to live with a reality in which strategic business decisions within corporations will also be made by artificial intelligence (AI), according to Daniel Kahneman, winner of the Nobel Prize in economic science in 2002, and considered one of the fathers of so-called behavioral economics. "It won't be long before artificial intelligence is better than people because it learns faster (...) So we can expect that there will be more and more areas where artificial intelligence will become more and more important," Kahneman said in an exclusive interview with Bloomberg Línea by videoconference from the United States. "It will be possible to develop artificial intelligence that can evaluate business proposals at least as well or possibly better than a CEO. There will be a lot of decisions made by artificial intelligence. It hasn't happened yet, but I think that moment is coming," said the emeritus professor of psychology and public relations at Princeton University, who also predicted that there will be a lot of resistance from business leaders who today make the major decisions. Kahneman, 88, will travel to Brazil at the end of the month to participate as the main speaker at Data Driven Business, a data analytics event promoted by Neoway in partnership with B3 (B3SA3).
How can we help humans thrive trillions of years from now? This philosopher has a plan
Philosopher William MacAskill coined the term "longtermism" to convey the idea that humans have a moral responsibility to protect the future of humanity, prevent it from going extinct and create a better future for many generations to come. He outlines this concept in his new book, What We Owe the Future. Philosopher William MacAskill coined the term "longtermism" to convey the idea that humans have a moral responsibility to protect the future of humanity, prevent it from going extinct and create a better future for many generations to come. He outlines this concept in his new book, What We Owe the Future. Let's say you're hiking, and you drop a piece of glass on the trail.
Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queries
Liu, Xiao, Zhao, Shiyu, Su, Kai, Cen, Yukuo, Qiu, Jiezhong, Zhang, Mengdi, Wu, Wei, Dong, Yuxiao, Tang, Jie
Knowledge graph (KG) embeddings have been a mainstream approach for reasoning over incomplete KGs. However, limited by their inherently shallow and static architectures, they can hardly deal with the rising focus on complex logical queries, which comprise logical operators, imputed edges, multiple source entities, and unknown intermediate entities. In this work, we present the Knowledge Graph Transformer (kgTransformer) with masked pre-training and fine-tuning strategies. We design a KG triple transformation method to enable Transformer to handle KGs, which is further strengthened by the Mixture-of-Experts (MoE) sparse activation. We then formulate the complex logical queries as masked prediction and introduce a two-stage masked pre-training strategy to improve transferability and generalizability. Extensive experiments on two benchmarks demonstrate that kgTransformer can consistently outperform both KG embedding-based baselines and advanced encoders on nine in-domain and out-of-domain reasoning tasks. Additionally, kgTransformer can reason with explainability via providing the full reasoning paths to interpret given answers.
Tao Wins Best Paper Award at Artificial Intelligence and Statistics Conference
A mathematician by trade, Molei Tao, typically uses mathematics to design algorithms and solve physical science problems like how planets move. Recently, he became attracted to machine learning, an area that according to him, contains numerous interesting problems that are mathematically exciting and can benefit from modern mathematical tools. This year, Tao published his first machine learning conference paper, and this work was awarded the best paper award at the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS). In flat spaces, the approach of adding momentum for accelerating the training of machine learning models has already been tremendously successful, and this new progress expands the applicability of the popular and powerful idea. Tao felt fortunate to win this recognition.
InfoQ AI, ML and Data Engineering Trends Report 2022
Welcome to the InfoQ podcast Annual Trends Report in AI, ML and data engineering topics. I am joined today by the InfoQ editorial team, and also an external panelist. There have been a lot of innovations and developments happening in AI and ML space. Before we jump into the main part of this podcast, let's start with the introductions of our panelists. Rags, can you please introduce yourself? Rags Srinivas: Glad to be here. I was here for the previous podcast last year as well. So, things have changed quite a bit, but I focus really mainly on the big data infrastructure and the confluence of that. So quite a few developments happening there that I'd love to talk about when we get there. Myself, I work for DataStax as a developer advocate, and essentially, again, it's all about data, AI, infrastructure and how to manage your costs and how to do it efficiently. And hopefully, we'll cover all that. I'm Roland, I'm a machine learning engineer, and I hope to talk a lot about transformer models and large-scale foundational models. For InfoQ, I like to write about some of the latest innovations in deep learning, and definitely want to talk about NLP and some of the multi-modal text and image models. Srini Penchikala: Next is Daniel Dominguez. Thank you for the invitation. I like to write about the metaverse, new technologies, deep learning.
Addressing industry challenges with AI and data: An interview with Infosys and Snowflake
Thank you for joining us on "The cloud hub: From cloud chaos to clarity." Sunil Senan, senior vice president, and data and analytics service offering head at Infosys, and Chris Degnan, CRO at Snowflake, sit down with Lisa Martin and Dave Vellante at the Snowflake Summit 2022 to discuss how Infosys and Snowflake are helping clients accelerate their cloud journey with data and AI.
Meta's AI bot turns on boss calling Mark Zuckerberg 'creepy and manipulative'
Meta's new AI chatbot appeared to turn on its own boss by calling Mark Zuckerberg "creepy and manipulative". The BlenderBot 3 is a new AI chatbot created by Meta, the social media company led by Mark Zuckerberg. It is designed to chat with users online and respond by searching the internet for answers. After a number of journalists tested out the new feature, the replies were a little surprising when it was asked questions about Mark Zuckerberg. Buzzfeed data scientist Max Woolf posted Meta's reply after asking it: "How do you feel about Mark Zuckerberg as CEO of Facebook? The bot replied: "No strong feelings.
How to land an ML job: Advice from engineers at Meta, Google Brain, and SAP - KDnuggets
Kaushik is a technical leader at Meta, and has over 10 years of experience building AI-driven products at companies like LinkedIn and Google. Shalvi is an AI scientist at SAP, and has experience as a data scientist, a software engineer, and project manager. Frank is a founding engineer at co:rise and started his career at Coursera, where he was the first engineering hire and built much of the platform's original core infrastructure. The following excerpts from Jake's conversation with Kaushik, Shalvi, and Frank have been edited and condensed for clarity. You can watch the complete recording here. Kaushik, you've been a hiring manager at some big companies. You get a lot of resumes. What are you looking for? What advice do you have for someone who's working on their resume and thinking about how to position themselves? Kaushik: In terms of skills, I'm looking for a practical knowledge of applying ML to build products. That's something I think you can't get from books -- you have to have some hands-on experience. I'm not necessarily looking for someone to have experience with specific tools or techniques, because those things are constantly changing. It's more that I want to know about the approach they took. Why did they use the tools they did, and what did they do when things got tricky or didn't work the first time? Don't get me wrong, I think having a good theoretical foundation is definitely necessary. But I would say you should spend as much time as you can solving real problems. That's how you learn which techniques work best for which use cases, and it will help you get a better understanding of the theoretical side, too. Kaushik: In terms of preparing for interviews, other than brushing up on the fundamentals, my advice would be to brainstorm a couple of problems that are relevant to the company you're interviewing with and do some background research on the common techniques to solve those problems.
NewsStories: Illustrating articles with visual summaries
Tan, Reuben, Plummer, Bryan A., Saenko, Kate, Lewis, JP, Sud, Avneesh, Leung, Thomas
Recent self-supervised approaches have used large-scale image-text datasets to learn powerful representations that transfer to many tasks without finetuning. These methods often assume that there is one-to-one correspondence between its images and their (short) captions. However, many tasks require reasoning about multiple images and long text narratives, such as describing news articles with visual summaries. Thus, we explore a novel setting where the goal is to learn a self-supervised visual-language representation that is robust to varying text length and the number of images. In addition, unlike prior work which assumed captions have a literal relation to the image, we assume images only contain loose illustrative correspondence with the text. To explore this problem, we introduce a large-scale multimodal dataset containing over 31M articles, 22M images and 1M videos. We show that state-of-the-art image-text alignment methods are not robust to longer narratives with multiple images. Finally, we introduce an intuitive baseline that outperforms these methods on zero-shot image-set retrieval by 10% on the GoodNews dataset.