Goto

Collaborating Authors

Results


Controllable Generation from Pre-trained Language Models via Inverse Prompting

arXiv.org Artificial Intelligence

Large-scale pre-trained language models have demonstrated strong capabilities of generating realistic text. However, it remains challenging to control the generation results. Previous approaches such as prompting are far from sufficient, which limits the usage of language models. To tackle this challenge, we propose an innovative method, inverse prompting, to better control text generation. The core idea of inverse prompting is to use generated text to inversely predict the prompt during beam search, which enhances the relevance between the prompt and the generated text and provides better controllability. Empirically, we pre-train a large-scale Chinese language model to perform a systematic study using human evaluation on the tasks of open-domain poem generation and open-domain long-form question answering. Our results show that our proposed method substantially outperforms the baselines and that our generation quality is close to human performance on some of the tasks. Narrators can try our poem generation demo at https://pretrain.aminer.cn/apps/poetry.html, while our QA demo can be found at https://pretrain.aminer.cn/app/qa. For researchers, the code is provided in https://github.com/THUDM/InversePrompting.


What's Ahead for a Cooperative Regulatory Agenda on Artificial Intelligence?

#artificialintelligence

In her first major speech to a U.S. audience after the U.S. presidential election, European Commission President Ursula von der Leyen laid out priority areas for transatlantic cooperation. She proposed building a new relationship between Europe and the United States, one that would encompass transatlantic coordination on digital technology issues, including working together on global standards for regulating artificial intelligence (AI) aligned with EU values. A reference to cooperation on standards for AI was included in the New Transatlantic Agenda for Global Change issued by the Commission on December 2, 2020. In remarks to Parliament on January 22, 2021, President von der Leyen called for "creating a digital economy rule book" with the United States that is "valid worldwide." Some would say Europe's new outreach on issues of tech governance and the suggestion of establishing an "EU-U.S. Trade and Technology Council" is incongruous to the current regulatory war being waged against ...


Dow's Machine Learning Journey In International Trade

#artificialintelligence

A ccontainer vessel leaves the port in Singapore on July 16, 2020. Dow Chemical is in the midst of a digital transformation. They have set up Centers to test out new and emerging technologies. They have had success in developing valuable intellectual property in the area of trade classifications. Dr. John Wassick, Integrated Supply Chain Technology Fellow, Dow Inc. DD, was on a supply chain panel at the ARC Industry Forum in Orlando.


Determination of Latent Dimensionality in International Trade Flow

arXiv.org Machine Learning

Currently, high-dimensional data is ubiquitous in data science, which necessitates the development of techniques to decompose and interpret such multidimensional (aka tensor) datasets. Finding a low dimensional representation of the data, that is, its inherent structure, is one of the approaches that can serve to understand the dynamics of low dimensional latent features hidden in the data. Nonnegative RESCAL is one such technique, particularly well suited to analyze self-relational data, such as dynamic networks found in international trade flows. Nonnegative RESCAL computes a low dimensional tensor representation by finding the latent space containing multiple modalities. Estimating the dimensionality of this latent space is crucial for extracting meaningful latent features. Here, to determine the dimensionality of the latent space with nonnegative RESCAL, we propose a latent dimension determination method which is based on clustering of the solutions of multiple realizations of nonnegative RESCAL decompositions. We demonstrate the performance of our model selection method on synthetic data and then we apply our method to decompose a network of international trade flows data from International Monetary Fund and validate the resulting features against empirical facts from economic literature.


We Need a Drastic Rethink on Export Controls for AI

#artificialintelligence

Dave Aitel is the founder and CTO of Immunity. You can follow him @daveaitel. Export control on AI and machine learning algorithms is becoming a more important part of national security strategy as the world moves to a great-power competition landscape and technological changes force accommodation and rapid change to many national interests. However, like security software before it, AI presents unique challenges to how export control has traditionally worked, and these should be considered before being codified into international regulatory frameworks. As an example, on January 6, 2020, The Bureau of Industry and Security (BIS) in the U.S. Department of Commerce released the following rule, which imposed a license requirement on a particular kind of software useful for automatically identifying objects from drone or other imagery: "Geospatial imagery "software" "specially designed" for training a Deep Convolutional Neural Network to automate the analysis of geospatial imagery and point clouds, and having all of the following: Technical Note: A point cloud is a collection of data points defined by a given coordinate system. A point cloud is also known as a digital surface model."


Five Predictions for Supply Chains in 2020 - Dataconomy

#artificialintelligence

The year 2019 seemed to be the year of unpredictability, not the least of which was the seemingly ever-changing foreign trade policy of major world economies. Interestingly, it's that same unpredictable nature of foreign trade policy that serves as a springboard for supply chain predictions for 2020. Here are the top five predictions that will have a major impact on the world's global supply chains. Historically, digital transformation of the supply chain has taken place by targeting various functional silos within their own walls. This approach lacked the ability to evaluate the interconnected nature of supply chain decisions.


Spread-gram: A spreading-activation schema of network structural learning

arXiv.org Machine Learning

Network representation learning has exploded recently. However, existing studies usually reconstruct networks as sequences or matrices, which may cause information bias or sparsity problem during model training. Inspired by a cognitive model of human memory, we propose a network representation learning scheme. In this scheme, we learn node embeddings by adjusting the proximity of nodes traversing the spreading structure of the network. Our proposed method shows a significant improvement in multiple analysis tasks based on various real-world networks, ranging from semantic networks to protein interaction networks, international trade networks, human behavior networks, etc. In particular, our model can effectively discover the hierarchical structures in networks. The well-organized model training speeds up the convergence to only a small number of iterations, and the training time is linear with respect to the edge numbers.


The Impact of Artificial Intelligence on International Trade - TradeVistas

#artificialintelligence

Artificial intelligence (AI) stands to have a transformative impact on international trade. Already, specific applications in areas such as data analytics and translation services are reducing barriers to trade. At the same time, there are challenges in the development of AI that international trade rules could address. General AI refers to systems that can self-learn from experience with "humanlike breadth" and surpass human performance on tasks. General AI raises broad existential concerns, but remains a technology in the distant future.


Top-10 Artificial Intelligence Startups in Mexico

#artificialintelligence

While some people might think Cinco de Mayo is about Mexican independence, it's actually a holiday that celebrates the day three Americans fought and defeated El Guapo at the Battle of Santa Poco. And it's just one of the many things Mexico is famous for. Her rich cultural heritage has resulted in some of the world's best cuisine that has been exported to every corner of the planet. Then there are the other exports, like those depicted in the recent third season of Narcos, a gripping thriller about the country's cartels in the 1980s. Mexico also plays a key role in regional international trade as the US' neighbor and second largest export market.


How to get started with AI--before it's too late - Be Ready Content Hub

#artificialintelligence

AI and machine learning are going to start making a lot more decisions. They probably still won't be used in the near future to make "big" decisions like whether to put a 25 percent tariff on a commodity and start a trade war with a partner. However, nearly anything you've stuck in Excel and massaged, coded, or sorted is a good clustering, classification, or learning-to-rank problem. Anything that is a set of values that can be predicted is a good machine learning problem. Anything that is a pattern or shape or object that you just go through and "look for" is a good deep learning problem.