Generative Pre-Trained Transformer models have been shown to be surprisingly effective at a variety of natural language processing tasks -- including generating computer code. We evaluate the effectiveness of open source GPT models for the task of automatic identification of the presence of vulnerable code syntax (specifically targeting C and C++ source code). This task is evaluated on a selection of 36 source code examples from the NIST SARD dataset, which are specifically curated to not contain natural English that indicates the presence, or lack thereof, of a particular vulnerability. The NIST SARD source code dataset contains identified vulnerable lines of source code that are examples of one out of the 839 distinct Common Weakness Enumerations (CWE), allowing for exact quantification of the GPT output classification error rate. A total of 5 GPT models are evaluated, using 10 different inference temperatures and 100 repetitions at each setting, resulting in 5,000 GPT queries per vulnerable source code analyzed. Ultimately, we find that the GPT models that we evaluated are not suitable for fully automated vulnerability scanning because the false positive and false negative rates are too high to likely be useful in practice. However, we do find that the GPT models perform surprisingly well at automated vulnerability detection for some of the test cases, in particular surpassing random sampling, and being able to identify the exact lines of code that are vulnerable albeit at a low success rate. The best performing GPT model result found was Llama-2-70b-chat-hf with inference temperature of 0.1 applied to NIST SARD test case 149165 (which is an example of a buffer overflow vulnerability), which had a binary classification recall score of 1.0 and a precision of 1.0 for correctly and uniquely identifying the vulnerable line of code and the correct CWE number.

Fujitsu and MIT scientists are working on an artificial intelligence technology that can think like a human. Robot models that have been projected onto us in science fiction movies for years raise our expectations every time. Although it takes some time, we are getting closer and closer to the smart and functional robots we see in the movies. The Ameca robot, which has surprised us recently, is one of these examples. Now, artificial intelligence technology has taken another step in this regard.

The way you think about a problem and the conceptual process you go through to find a solution may be guided by your personal skills or the type of problem at hand. Many mental models exist representing a variety of thinking patterns -- and as a Data Scientist, appreciating different…

"Success in creating effective A.I.," said the late Stephen Hawking, "could be the biggest event in the history of our civilization. Are we creating the instruments of our own destruction or exciting tools for our future survival? Once we teach a machine to learn on its own--as the programmers behind AlphaGo have done, to wondrous results--where do we draw moral and computational lines? In this program, leading specialists in A.I., neuroscience, and philosophy tackle the very questions that may define the future of humanity. This program is part of the BIG IDEAS SERIES, made possible with support from the JOHN TEMPLETON FOUNDATION.

Edmond de Belamy, created using artificial intelligence, will be auctioned at Christie's on Thursday. Edmond de Belamy, created using artificial intelligence, will be auctioned at Christie's on Thursday. A new portrait that is vaguely reminiscent of something painted by an old master is headed to Christie's New York auction block later this week, making it the first computer-generated artwork up for sale at a prestigious art house. The print, called Edmond de Belamy, is a blurry depiction of what could be a "man of the church" against a dark background, floating in the upper left corner of a gilt frame. It was created by Obvious, a Paris-based art collective that has been using artificial intelligence to make a series of "paintings" since they began the project last year.

The latest installment in the "Resident Evil" horror franchise topped China's box office last week, debuting with a massive $94 million in ticket sales in just three days. Produced by the German entertainment giant Constantin Film, "Resident Evil: The Final Chapter" debuted with $33 million on its opening day in China, eclipsing its North American total of $26.5 million after four weeks running, according to film industry consulting firm Artisan Gateway. By comparison, "Star Wars: Rogue One" made $31 million in China on its opening weekend. Directed by Paul W.S. Anderson, the action horror film distributed by Sony/Screen Gems is the sixth and allegedly final installment in the "Resident Evil" film series, which is based on the video game "Resident Evil." Although the film only got an approval rating of 33% on Rotten Tomatoes -- the lowest of its six installments -- it's estimated to be the series' highest-grossing sequel, when factoring in the Chinese market's boost.