Indexat a

Llicència i ús

Citacions

Cited 2 times in

Cited 2 times in

Altmetrics

Grant support

This material is based upon work supported by the Air Force Office of Scientific Research under award number FA9550-17-1-0287, the EU (FEDER), and the Spanish MINECO under grant TIN 2015-69175-C4-1-R, the Generalitat Valenciana PROMETEOII/2015/013. F. Martinez-Plumed was also supported by INCIBE under grant INCIBEI-2015-27345 (Ayudas para la excelencia de los equipos de investigacion avanzada en ciberseguridad). J. H-Orallo also received a Salvador de Madariaga grant (PRX17/00467) from the Spanish MECD for a research stay at the CFI, Cambridge, and a BEST grant (BEST/2017/045) from the GVA for another research stay at the CFI.

Anàlisi d'autories institucional

Compartir

Identifying the Machine Learning Family from Black-Box Models

Publicat a:Lecture Notes In Computer Science. 11160 55-65 - 2018-01-01 11160(), DOI: 10.1007/978-3-030-00374-6_6

Autors: Fabra-Boluda, Raul; Ferri, Cesar; Hernandez-Orallo, Jose; Martinez-Plumed, Fernando; Jose Ramirez-Quintana, Maria

Afiliacions

Resum

We address the novel question of determining which kind of machine learning model is behind the predictions when we interact with a black-box model. This may allow us to identify families of techniques whose models exhibit similar vulnerabilities and strengths. In our method, we first consider how an adversary can systematically query a given black-box model (oracle) to label an artificially-generated dataset. This labelled dataset is then used for training different surrogate models (each one trying to imitate the oracle's behaviour). The method has two different approaches. First, we assume that the family of the surrogate model that achieves the maximum Kappa metric against the oracle labels corresponds to the family of the oracle model. The other approach, based on machine learning, consists in learning a meta-model that is able to predict the model family of a new black-box model. We compare these two approaches experimentally, giving us insight about how explanatory and predictable our concept of family is.

Paraules clau