Coreset isusually asmall weighted subset ofninput points inRd,thatprovably approximates their loss function for a given set of queries (models, classifiers, etc.).
It also illustrates that ergodicity is an important component for obtaining time-uniform bounds - which might not be achieved for convex or non-convex losses unless additional noise is injected to the iterates.