scott
The Implicit Bias of Gradient Descent on Separable Multiclass Data
Implicit bias describes the phenomenon where optimization-based training algorithms, without explicit regularization, show a preference for simple estimators even when more complex estimators have equal objective values. Multiple works have developed the theory of implicit bias for binary classification under the assumption that the loss satisfies an exponential tail property. However, there is a noticeable gap in analysis for multiclass classification, with only a handful of results which themselves are restricted to the cross-entropy loss. In this work, we employ the framework of Permutation Equivariant and Relative Margin-based (PERM) losses [Wang and Scott, 2024] to introduce a multiclass extension of the exponential tail property. This class of losses includes not only cross-entropy but also other losses. Using this framework, we extend the implicit bias result of Soudry et al. [2018] to multiclass classification.
Data Complexity in Expressive Description Logics With Path Expressions
We investigate the data complexity of the satisfiability problem for the very expressive description logic ZOIQ (a.k.a. ALCHb Self reg OIQ) over quasi-forests and establish its NP-completeness. This completes the data complexity landscape for decidable fragments of ZOIQ, and reproves known results on decidable fragments of OWL2 (SR family). Using the same technique, we establish coNEXPTIME-completeness (w.r.t. the combined complexity) of the entailment problem of rooted queries in ZIQ.
Estimating the class prior and posterior from noisy positives and unlabeled data
We develop a classification algorithm for estimating posterior distributions from positive-unlabeled data, that is robust to noise in the positive labels and effective for high-dimensional data. In recent years, several algorithms have been proposed to learn from positive-unlabeled data; however, many of these contributions remain theoretical, performing poorly on real high-dimensional data that is typically contaminated with noise. We build on this previous work to develop two practical classification algorithms that explicitly model the noise in the positive labels and utilize univariate transforms built on discriminative classifiers. We prove that these univariate transforms preserve the class prior, enabling estimation in the univariate space and avoiding kernel density estimation for high-dimensional data. The theoretical development and parametric and nonparametric algorithms proposed here constitute an important step towards wide-spread use of robust classification algorithms for positive-unlabeled data.
I just watched Biggie Smalls perform 'live' in the metaverse
Holograms, however, are inherently limited. They require audiences to sit at a specific angle to get the illusion of the artist performing in 3D. The metaverse offers a way for people to see a more lifelike avatar and even potentially interact with it--something the team behind Smalls's gig hopes to be able to offer in the near future. What's remarkable about Smalls's performance on Friday was the realism. His moves, mannerisms, and facial expressions were stunningly lifelike.
Possible Effects of AI Writing Systems on the Quality of Online Content
In a previous article I described the problems and progress of AI reading comprehension systems. In the last few years, AI writing systems have also improved significantly because of the emergence of an AI neural network called GPT-3. It's barely two years since GPT-3 was created but the number use cases. It has paved a path for numerous business start-ups including, story writing, blog writing, chatbots, news report writing and even quiz generation. The list is continuing to grow as developers become aware of its potential.
Scott's Legal on LinkedIn: #realestate #compliance #data
Legal Considerations for PropTech Startups Below we will highlight some legal considerations that proptech startups should begin to pay attention to as this can either make or mar their potential to scale and reap the benefits that technology has provided in the property and real estate space. New types of contract -It is clichรฉ to say that the real estate sector is undergoing a tremendous digital change. With the advent of smart buildings, real estate fintechs, the use of digital printing, robotics, drones, property management solutions, a shared economy which is always ready to match users of space with sellers through digital platforms and other technical innovations. It goes without saying that there will be a need for smarter contracts different from the legacy property agreements. There will be a need for legal agreements that can inclusively cover technologies such as AI, IoT, Data protection clauses, intellectual property concerns, blockchain and other innovative augmentation that proptech will require to deliver on its promises. Data protection - As with the majority of emerging technologies, the use of data in the property tech space is inevitable.
"Alien: Covenant" Bursts with Pomposity
In space, no one can hear you laugh. Ridley Scott's extraterrestrial adventure "Alien: Covenant" is deadly serious about matters that he takes deadly seriously, and the only things that he derides with any irony--muffled and sardonic though it may be--are the movie's snippets of art greater than his own, by artists greater than himself--starting with Richard Wagner, whose "Entry of the Gods into Valhalla" is heard in the first and last scene. The movie's lack of irony is all the more ironic since its subject is the recklessness of mankind in daring to synthesize humans androidally in order to extend our own control over the universe. The pleasure of classic low-budget science-fiction films--the threadbare apocalypses of the nineteen-fifties--is the fusion of authentic fear with the earnestness inherent in comic-book-like creatures and effects. They were movies that, in their exuberant exaggerations, wore their own absurdity with a fiercely straight face, even as they touched on underlying terrors--largely also focussed on the hubris of recklessly manipulating nature.
Human-Level AI Are Probably A Lot Closer Than You Think
Although some thinkers use the term "singularity" to refer to any dramatic paradigm shift in the way we think and perceive our reality, in most conversations The Singularity refers to the point at which AI surpasses human intelligence. What that point looks like, though, is subject to debate, as is the date when it will happen. In a recent interview with Inverse, Stanford University business and energy and earth sciences graduate student Damien Scott provided his definition of singularity: the moment when humans can no longer predict the motives of AI. Many people envision singularity as some apocalyptic moment of truth with a clear point of epiphany. Scott doesn't see it that way. "We'll start to see narrow artificial intelligence domains that keep getting better than the best human," Scott told Inverse.
Killer artificial intelligence returns in 'Alien: Covenant'
LOS ANGELES โ Modern movie culture would have you believe artificial intelligence is out to kill us all. In "2001: A Space Odyssey," Hal, the AI computer aboard a space flight to Jupiter, develops a mind of its own and turns against the crew. "The Terminator" makes his mission clear in the movie's title. Ava, the pretty-faced android in "Ex Machina," has a killer instinct. David, the pretty-faced android in "Prometheus," also doesn't have the best intentions for human survival.
Planet enlists machine learning experts to parse a treasure trove of Amazon basin data
Planet, the satellite imaging company that operate the largest commercial Earth imaging constellation in existence, is hosting a new data science competition on the Kaggle platform, with the specific aim of developing machine learning techniques around forestry research. Planet will open up access to thousands of image'chips,' or blocks covering around 1 sauce kilometre, and will give away a total of $60,000 to participants who place in the top three when coming up with new methods for analyzing the data available in these images. Planet notes that each minute, we lose a portion of forest the size of approximately 48 football fields, which is a heck of a lot of forest. The hope is that by releasing this data and hosting this competition, Planet can encourage academics and researchers worldwide to apply advances in machine learning that have been put to great use in efforts like facial recognition and detect, to this pressing ecological problem. "We're putting together this competition as a way to get people excited about the kinds of data that Planet provides," explained Planet machine learning engineer Kat Scott in an interview. "Particularly when you're analyzing imaging and that sort of thing, everyone works off the same sort of jpgs, but our satellites have these sort of superpowers.