Goto

Collaborating Authors

 Government


What is Wrong with Topic Modeling? (and How to Fix it Using Search-based Software Engineering)

arXiv.org Artificial Intelligence

Context: Topic modeling finds human-readable structures in unstructured textual data. A widely used topic modeler is Latent Dirichlet allocation. When run on different datasets, LDA suffers from "order effects" i.e. different topics are generated if the order of training data is shuffled. Such order effects introduce a systematic error for any study. This error can relate to misleading results;specifically, inaccurate topic descriptions and a reduction in the efficacy of text mining classification results. Objective: To provide a method in which distributions generated by LDA are more stable and can be used for further analysis. Method: We use LDADE, a search-based software engineering tool that tunes LDA's parameters using DE (Differential Evolution). LDADE is evaluated on data from a programmer information exchange site (Stackoverflow), title and abstract text of thousands ofSoftware Engineering (SE) papers, and software defect reports from NASA. Results were collected across different implementations of LDA (Python+Scikit-Learn, Scala+Spark); across different platforms (Linux, Macintosh) and for different kinds of LDAs (VEM,or using Gibbs sampling). Results were scored via topic stability and text mining classification accuracy. Results: In all treatments: (i) standard LDA exhibits very large topic instability; (ii) LDADE's tunings dramatically reduce cluster instability; (iii) LDADE also leads to improved performances for supervised as well as unsupervised learning. Conclusion: Due to topic instability, using standard LDA with its "off-the-shelf" settings should now be depreciated. Also, in future, we should require SE papers that use LDA to test and (if needed) mitigate LDA topic instability. Finally, LDADE is a candidate technology for effectively and efficiently reducing that instability.


Polaris Alpha: Data Scientist

@machinelearnbot

Polaris Alpha is a highly technical industry leader uniquely positioned to address customers' most complex challenges across the full spectrum of air, land, sea, cyber and space domains. Polaris Alpha provides cutting edge solutions development based on the latest advances in open software design and integration. The company is best known for not only understanding our customer's needs, but also consistently exceeding their expectations. ISS develops sophisticated data visualization, event analysis, pattern detection, mission planning and mobile software using net centric and enterprise architectures. Their flagship product, WebTAS, is a suite of data visualization, trend analysis, and data integration tools made available to analysts throughout the Intelligence Community.


An artificial intelligence has officially been granted residency

#artificialintelligence

Tokyo, Japan may have just become the first city to officially grant residence to an artificial intelligence (AI). The intelligence's name is Shibuya Mirai and exists only as a chatbot on the popular Line messaging app. Mirai, which translates to'future' from Japanese, joins Hanson Robotic's "Sophia" as pioneering AI gaining statuses previously reserved for living, biological entities. The Kingdom of Saudi Arabia granted Sophia citizenship last month. The Shibuya Ward of Tokyo released a statement through Microsoft saying, "His hobbies are taking pictures and observing people. And he loves talking with peopleโ€ฆ Please talk to him about anything."


Lockheed Martin to build giant US Navy robosub

Daily Mail - Science & tech

It could be the biggest robot craft ever made. Lockheed Martin has won a lucrative $43.2 million US Navy contract to built a radical new giant submarine - without a human on board. Called Orca, the Navy hopes to use up to nine of the giant submarines on secret mission. They will be able to stay underwater for months at a time, communicating remotely from enemy waters. Called Orca, the Navy hopes to use up to nine of the giant submarines on secret mission. They will be able to stay underwater for months at a time, communicating remotely from enemy waters.


Lockheed Martin developing high-energy laser for jets

Daily Mail - Science & tech

Lockheed Martin is working to develop a high-power fiber laser for fighter jets. Under a $26.3 million contract from the Air Force Research Lab, the firm will design and produce a directed energy system for aircraft, with plans to test the technology by 2021. The move comes after a series of successful tests with similar systems in ground-based platforms โ€“ but, the experts say developing a laser for a smaller, airborne design will be a challenge. Lockheed Martin is working to develop a high-power fiber laser for fighter jets. Under a $26.3 million contract from the Air Force Research Lab, the firm will design and produce a directed energy system for aircraft, with plans to test it by 2021.


The wealthy get the biggest benefit from House Republican tax plan, analysis finds

Los Angeles Times

Trump opens Asia trip with Japan's Abe against backdrop of tensions with North Korea Just one in three Americans trust Trump to handle North Korean tensions well Japan's Abe treats Trump to a day of personal diplomacy, including golf and trucker hats Brazile says Democratic primaries weren't'rigged' though some see evidence in her new book Trump is silent on Saudi king's purge though he and Salman spoke by phone Japan's Abe treats Trump to a day of personal diplomacy, including golf and trucker hats Brazile says Democratic primaries weren't'rigged' though some see evidence in her new book Trump is silent on Saudi king's purge though he and Salman spoke by phone The greatest benefit from the House Republican tax bill would go to upper-income households, according to an analysis released Monday by the nonpartisan Tax Policy Center. Middle-income taxpayers -- those earning between $48,600 and $86,100 annually -- would receive an average tax cut of $700 next year, or about 1% of their after-tax income, the analysis said. The top 20% of the nation's earners -- those making more than $149,400 a year -- would receive an average tax cut of $4,850, or about 1.4% of after-tax income. Those top earners would also receive 60% of the total tax benefits under the plan. Of that, the top 1% of earners, defined as those making more than $730,000 a year, receive about 22% of the total amount of tax cuts in 2018, the Tax Policy Center said.


TAMING DNS DATA: STACKING MACHINE LEARNING ALGORITHMS TO FIND DGA MALWARE ACTIVITIES - Cybersecurity Insiders

#artificialintelligence

The very first layer deals with information contained in the structure of the domain name string. Depending on the DGA malware the names of the generated domains could be random alphanumeric strings or concatenation of english words. In any case, being generated they tend to be different from the common names used for domains. One could use natural language processing (NLP) algorithms to trained on large corpus of the domain names requested by normal users to assign string information score that reflects likelihood for a domain name to be anomalous. That string information score is assigned to all DNS requests and used as classification feature in the next level.


The U.S. Air Force wants to introduce AI to its intelligence gathering efforts

@machinelearnbot

Artificial intelligence (AI) is able to handle massive amounts of data much more efficiently than an individual or even an entire group of people. This, by extension, means AI can also quickly identify patterns and highlight things of interest -- two skills that makes AI an enticing tool to the U.S. Air Force. As reported by Defense One, Air Force Lt. Gen Jack Shanahan is attempting to integrate AI into the organization's various tasks. Shanahan, who is also the Director for Defense Intelligence (Warfighter Support) at the Pentagon, launched Project Maven in April, which aims to use machine learning to better utilize drone surveillance footage and turn it into useful information. Currently, analysts spend a significant number or hours scrubbing through footage to find something of interest.


Localis report warns of job losses because of robots

Daily Mail - Science & tech

England's poorest towns are set to be hit hardest by the rise of robots and automation, a new report today warns. Large swathes of the country face potentially devastating job losses because of a failure to equip workers with the skills for industries of the future, the paper says. The report, by the think-tank Localis, warned of a'staggering gulf' in how well-prepared different parts of the country are to adapt to the looming change in jobs. And it called for the government to devolve polices like apprenticeships and skills training to help different areas re-train people in a bid to prevent mass job losses. The report said England's economic prosperity faces a triple threat from automation, poor skills and a potential drop in migrant labour after Brexit. The vast bulk of funding is poured into the'golden triangle' of London, Oxford and Cambridge - leaving them well-equipped to take advantage of the change.


NHS begins new trial that offers consultations via phone

Daily Mail - Science & tech

Millions of NHS patients are being offered an appointment with their GP by video on their smartphones under a controversial new scheme. The service, which has left experts concerned, is to be trialed at five surgeries in London but it is predicted it will become the standard way to'see' a doctor. Patients will be able to get a GP appointment within minutes using the new service, which will work 24 hours a day, seven days a week. The technology has been developed for use in private medicine by Babylon. It will be paid from the public purse to run the trial of the'GP at Hand' service.