Query complexity of adversarial attacks
Głuch, Grzegorz, Urbanke, Rüdiger
The decision boundary of a learning algorithm applied to a given task can be viewed as the outcome of a random process: (i) generate a training set and, (ii) apply to it the, potentially randomized, learning algorithm. Recall, see Definitions 4 and 5, that a query-bounded adversary does not know the sample on which the model was trained nor the randomness used by the learner. This means that if the decision boundary has high entropy then the adversary needs to ask many questions to recover the boundary to a high degree of precision. This suggest that high-entropy decision boundaries are robust against query-bounded adversaries since intuitively it is clear that an approximate knowledge of the decision boundary is a prerequisite for a successful attack. Following this reasoning, we present two instances where high entropy of the decision boundary leads to security.
Oct-2-2020
- Country:
- North America > United States > California (0.46)
- Genre:
- Research Report (0.64)
- Industry:
- Government > Military (0.41)
- Information Technology > Security & Privacy (0.50)
- Technology: