University of Minho School of Engineering Algoritmi Centre Uma Escola a Reinventar o Futuro –...

1
University of Minho School of Engineering Algoritmi Centre Uma Escola a Reinventar o Futuro – Semana da Escola de Engenharia - 20 a 26 de Outubro de 2011 Keywords Security, authentication, biometry, gesture dynamics, cognitive biometrics, skin conductivity, multimodal. Motivation There different ways to recognize an individual. The latter methods are known as biometrics, which overcomes the problem of transmissibility that the first two ways have. Biometrics classification: However, biometrics is not foolproof because it can be replicated. Today there are several fraudulent ways to replicate a biometric characteristic, and this raises new challenges. A potential solution lies in cognitive biometrics, which uses biological signals representative of the mental and emotional states for the authentication of users. VÍTOR JÚLIO DA SILVA E SÁ * Supervisor: Henrique Dinis dos Santos * [email protected] GESTURE DYNAMICS WITH SKIN CONDUCTIVITY - A MULTIMODAL APPROACH TO BIOMETRIC AUTHENTICATION Problem In the current solution we have identified the following problems: replicability is possible even with the common biometric technology; requirement of continuous authentication; constant need to improve the accuracy of the systems (information systems with more users imply a need to lower error rates); constant need (inherent in the existence of a business) to lower the cost; need to keep the mobility of the systems, with restrictions on the type of hardware needed (dimension, energy, etc.) and on the use conditions (light, noise, etc.). There is recent work in cognitive biometrics, particularly in the conductivity of the skin that seems to indicate that this technology has potential (with or without activation of the knowledge component). The current size of the conductivity sensors enables its integration into mobile devices. There is also work done and consolidated in gesture dynamics. Thus, we intend to prove the following: it is possible to implement, with comparative advantages, a multimodal biometric authentication solution using gesture dynamics with skin conductivity. Methodological Approach Given the nature of this work the research methodology is based on a proof of concept with a study of acceptance. For that, it will be developed a prototype for graphical data collection and a prototype for dermoelectric data collection, for further definition of algorithms that determine authentication patterns. The main challenges will be to find a good algorithm for each of the biometrics and find the thresholds that combine successfully these same algorithms. This does not correspond to the simple junction of the two since it will take advantage of the synergistic multimodal integration or even, in some situations, the alternate one. Later we will proceed to the test of the defined algorithms, with half of the data to test and half of them to attack. Developed the solution, the aim is also to evaluate Research Plan For better exposure of the tasks involved, results, goals, resources and timing, the research plan was developed in a project management tool, with the corresponding set of deliverables, activities, effort, duration, dependencies and milestones. Publications Borges, D.; Sá, V. J. ; Magalhães, S. T.; Santos, H. D. 2011. “Study of the perception on the biometric technology by the Portuguese citizens”. Proceedings of the 7th ICGS3 / 4th e-Democracy Joint Conferences , Salónica, Grécia. Cerqueira, I.; Sá, V. J. ; Magalhães, S. T. 2011. “Study of The Perception on The Portuguese Citizen Card and Electronic Signature”. Proceedings of the 7th ICGS3 / 4th e-Democracy Joint Conferences , Salónica, Grécia. Faria, L.; Sá, V. J. ; Magalhães, S. T. 2011. “Biometrias Multimodais Cognitivas - Uma nova abordagem no reconhecimento de utilizadores”. In Actas da 6ª Conferência Ibérica de Sistemas e Tecnologias de Informação, Chaves, Portugal. Hildebrand, A. and Sá, V. J. 2001. “EMBASSI: Electronic Multimedia and Service Assistance”. In: Heuer, A., Kirste, T. (eds.) Intelligent Interactive Assistance and Mobile Multimedia Computing , ISBN 3-935319- 75-4, pp. 50-59, Neuer Hochschulschriftenverlag, Rostock. Sá, V. J. ; Malerczyk, C.; Schnaider, M. (2002). Vision Based Interaction Within a Multimodal Framework. Selected Readings in Computer Graphics 2001 , ISBN: 3-8167-6163-1, Fraunhofer IRB Verlag, Stuttgart. ID ID N om e da tarefa D ep. D uração 1 1 R evisão de literatura detalhada 4 m ons 2 2 R evisão de patentes 5 days 3 3 D esenvolvido do protótipo 61 days 4 4 A plicação Gráfica 21 days 5 5 C riara BD 3 days 6 6 C om pora im agem 5 3 days 7 7 Interface de autenticação 6 15 days 8 8 A rtigo sobre protótipo gráfico 4 10 days 9 9 A plicação de recolha da actividade derm oeléctrica 4 30 days 10 10 E studo da AP Ido ED R 5 days 11 11 D esenho do softw are 10 10 days 12 12 C odificação 11 15 days 13 13 A rtigo sobre protótipo derm oelétrico 9 10 days 14 14 R ecolha de dados 13 14 days 15 15 D ados da recolha gráfica 14 days 16 16 D ados da recolha derm oeléctrica 14 days 17 17 D efinição dos algorítm os (com m etade dos dados para treino) 14 6 m ons 18 18 Testes dos algoritm o definidos (com a m etade dos dados para teste) 14 8 m ons 19 19 Q uestionário 5 days 20 20 Inquérito de aceitação 19 2 m ons 21 21 Escrita da tese 18;20 100 days 22 22 D escrição da análise dos resultados 1 m on 23 23 D escrição dos algorítm os 22 1 m on 24 24 D escrição da precisão 23 1 m on 25 25 C onclusões 24 1 m on 26 26 R evisão geral 25 1 m on 27 27 A rtigo com os principais resultados do doutoram ento 25 1 m on 28 28 M ilestones 304 days 29 29 P ublicação do protótipo gráfico 8 0 days 30 30 P ublicação do protótipo derm oelétrico 13 0 days 31 31 P ublicação dos algorítm os 18 0 days 32 32 P ublicação dos resultados do doutoram ento em revista 25 0 days 33 33 E ntrega da tese 21 0 days 26-09 07-11 06-07 26-10 23-11 Aug S ep O ct N ov D ec Jan Feb M ar Apr M ay Jun Jul Aug S ep O ct N ov D ec Jan Feb M ar Apr M ay , 2011 Q tr4, 2011 Q tr1, 2012 Q tr2, 2012 Q tr3, 2012 Q tr4, 2012 Q tr1, 2013 Q tr2, 2013

Transcript of University of Minho School of Engineering Algoritmi Centre Uma Escola a Reinventar o Futuro –...

Page 1: University of Minho School of Engineering Algoritmi Centre Uma Escola a Reinventar o Futuro – Semana da Escola de Engenharia - 20 a 26 de Outubro de 2011.

University of Minho School of Engineering Algoritmi Centre

Uma Escola a Reinventar o Futuro – Semana da Escola de Engenharia - 20 a 26 de Outubro de 2011

Keywords

Security, authentication, biometry, gesture dynamics, cognitive biometrics, skin conductivity, multimodal.

Motivation

There different ways to recognize an individual.

The latter methods are known as biometrics, which overcomes the problem of transmissibility that the first two ways have.

Biometrics classification:

However, biometrics is not foolproof because it can be replicated. Today there are several fraudulent ways to replicate a biometric characteristic, and this raises new challenges.

A potential solution lies in cognitive biometrics, which uses biological signals representative of the mental and emotional states for the authentication of users.

VÍTOR JÚLIO DA SILVA E SÁ *

Supervisor: Henrique Dinis dos Santos

* [email protected]

GESTURE DYNAMICS WITH SKIN CONDUCTIVITY - A MULTIMODAL APPROACH TO BIOMETRIC AUTHENTICATION

Problem

In the current solution we have identified the following problems: replicability is possible even with the common biometric technology; requirement of continuous authentication; constant need to improve the accuracy of the systems (information systems with more users imply a need to lower error rates); constant need (inherent in the existence of a business) to lower the cost; need to keep the mobility of the systems, with restrictions on the type of hardware needed (dimension, energy, etc.) and on the use conditions (light, noise, etc.).

There is recent work in cognitive biometrics, particularly in the conductivity of the skin that seems to indicate that this technology has potential (with or without activation of the knowledge component). The current size of the conductivity sensors enables its integration into mobile devices. There is also work done and consolidated in gesture dynamics.

Thus, we intend to prove the following: it is possible to implement, with comparative advantages, a multimodal biometric authentication solution using gesture dynamics with skin conductivity.

Methodological Approach

Given the nature of this work the research methodology is based on a proof of concept with a study of acceptance. For that, it will be developed a prototype for graphical data collection and a prototype for dermoelectric data collection, for further definition of algorithms that determine authentication patterns.

The main challenges will be to find a good algorithm for each of the biometrics and find the thresholds that combine successfully these same algorithms. This does not correspond to the simple junction of the two since it will take advantage of the synergistic multimodal integration or even, in some situations, the alternate one.Later we will proceed to the test of the defined algorithms, with half of the data to test and half of them to attack.Developed the solution, the aim is also to evaluate the user acceptance of such a system. We plan to use the Technology Acceptance Model (TAM) for its wide dissemination and acceptance in this context.

Research Plan

For better exposure of the tasks involved, results, goals, resources and timing, the research plan was developed in a project management tool, with the corresponding set of deliverables, activities, effort, duration, dependencies and milestones.

Publications

Borges, D.; Sá, V. J.; Magalhães, S. T.; Santos, H. D. 2011. “Study of the perception on the biometric technology by the Portuguese citizens”. Proceedings of the 7th ICGS3 / 4th e-Democracy Joint Conferences, Salónica, Grécia.

Cerqueira, I.; Sá, V. J.; Magalhães, S. T. 2011. “Study of The Perception on The Portuguese Citizen Card and Electronic Signature”. Proceedings of the 7th ICGS3 / 4th e-Democracy Joint Conferences, Salónica, Grécia.

Faria, L.; Sá, V. J.; Magalhães, S. T. 2011. “Biometrias Multimodais Cognitivas - Uma nova abordagem no reconhecimento de utilizadores”. In Actas da 6ª Conferência Ibérica de Sistemas e Tecnologias de Informação, Chaves, Portugal.

Hildebrand, A. and Sá, V. J. 2001. “EMBASSI: Electronic Multimedia and Service Assistance”. In: Heuer, A., Kirste, T. (eds.) Intelligent Interactive Assistance and Mobile Multimedia Computing, ISBN 3-935319-75-4, pp. 50-59, Neuer Hochschulschriftenverlag, Rostock.

Sá, V. J.; Malerczyk, C.; Schnaider, M. (2002). Vision Based Interaction Within a Multimodal Framework. Selected Readings in Computer Graphics 2001, ISBN: 3-8167-6163-1, Fraunhofer IRB Verlag, Stuttgart.

ID ID Nom e da tarefa Dep. Duração

1 1 Revisão de literatura detalhada 4 m ons

2 2 Revisão de patentes 5 days

3 3 Desenvolvido do protótipo 61 days

4 4 Aplicação Gráfica 21 days

5 5 Criar a BD 3 days

6 6 Com por a imagem 5 3 days

7 7 Interface de autenticação 6 15 days

8 8 Artigo sobre protótipo gráfico 4 10 days

9 9 Aplicação de recolha da actividade dermoeléctrica 4 30 days

10 10 Estudo da API do EDR 5 days

11 11 Desenho do s oftware 10 10 days

12 12 Codificação 11 15 days

13 13 Artigo sobre protótipo dermoelétrico 9 10 days

14 14 Recolha de dados 13 14 days

15 15 Dados da recolha gráfica 14 days

16 16 Dados da recolha dermoeléctrica 14 days

17 17 Definição dos algorítmos (com m etade dos dados para treino) 14 6 m ons

18 18 Tes tes dos algoritmo definidos (com a metade dos dados para tes te) 14 8 m ons

19 19 Questionário 5 days

20 20 Inquérito de aceitação 19 2 m ons

21 21 Escrita da tese 18;20 100 days

22 22 Descrição da análise dos resultados 1 m on

23 23 Descrição dos algorítmos 22 1 m on

24 24 Descrição da precisão 23 1 m on

25 25 Conclusões 24 1 m on

26 26 Revisão geral 25 1 m on

27 27 Artigo com os principais resultados do doutoramento 25 1 m on

28 28 Milestones 304 days

29 29 Publicação do protótipo gráfico 8 0 days

30 30 Publicação do protótipo dermoelétrico 13 0 days

31 31 Publicação dos algorítm os 18 0 days

32 32 Publicação dos resultados do doutoram ento em revis ta 25 0 days

33 33 Entrega da tese 21 0 days

26-09

07-11

06-07

26-10

23-11

Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun JulQtr 3, 2011 Qtr 4, 2011 Qtr 1, 2012 Qtr 2, 2012 Qtr 3, 2012 Qtr 4, 2012 Qtr 1, 2013 Qtr 2, 2013