Behavioral Activity Recognition Based on Gaze Ethograms
dc.contributor.author | De Lope Asiaín, Javier | |
dc.contributor.author | Graña Romay, Manuel María | |
dc.date.accessioned | 2021-02-03T09:18:30Z | |
dc.date.available | 2021-02-03T09:18:30Z | |
dc.date.issued | 2020-07 | |
dc.identifier.citation | International Journal of Neural Systems 30(7) : (2020) // Article ID 2050025 | es_ES |
dc.identifier.issn | 0129-0657 | |
dc.identifier.issn | 1793-6462 | |
dc.identifier.uri | http://hdl.handle.net/10810/50005 | |
dc.description.abstract | Noninvasive behavior observation techniques allow more natural human behavior assessment experiments with higher ecological validity. We propose the use of gaze ethograms in the context of user interaction with a computer display to characterize the user's behavioral activity. A gaze ethogram is a time sequence of the screen regions the user is looking at. It can be used for the behavioral modeling of the user. Given a rough partition of the display space, we are able to extract gaze ethograms that allow discrimination of three common user behavioral activities: reading a text, viewing a video clip, and writing a text. A gaze tracking system is used to build the gaze ethogram. User behavioral activity is modeled by a classifier of gaze ethograms able to recognize the user activity after training. Conventional commercial gaze tracking for research in the neurosciences and psychology science are expensive and intrusive, sometimes impose wearing uncomfortable appliances. For the purposes of our behavioral research, we have developed an open source gaze tracking system that runs on conventional laptop computers using their low quality cameras. Some of the gaze tracking pipeline elements have been borrowed from the open source community. However, we have developed innovative solutions to some of the key issues that arise in the gaze tracker. Specifically, we have proposed texture-based eye features that are quite robust to low quality images. These features are the input for a classifier predicting the screen target area, the user is looking at. We report comparative results of several classifier architectures carried out in order to select the classifier to be used to extract the gaze ethograms for our behavioral research. We perform another classifier selection at the level of ethogram classification. Finally, we report encouraging results of user behavioral activity recognition experiments carried out over an inhouse dataset. | es_ES |
dc.description.sponsorship | This work has been supported by FEDER funds through MINECO project TIN2017-85827-P. This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 777720. Additional support comes from grant IT1284-19 of the Basque Country Government. | es_ES |
dc.language.iso | eng | es_ES |
dc.publisher | World Scientific Publishing | es_ES |
dc.relation | info:eu-repo/grantAgreement/MINECO/TIN2017-85827-P | es_ES |
dc.relation | info:eu-repo/grantAgreement/EC/H2020/777720 | es_ES |
dc.rights | info:eu-repo/semantics/openAccess | es_ES |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/3.0/es/ | * |
dc.subject | neuroethology | es_ES |
dc.subject | activity recognition | es_ES |
dc.subject | gaze tracking | es_ES |
dc.subject | gaze ethograrn | es_ES |
dc.subject | screen-based eye tracker | es_ES |
dc.subject | noninvasive eye tracker | es_ES |
dc.subject | eye | es_ES |
dc.subject | direction | es_ES |
dc.subject | science | es_ES |
dc.title | Behavioral Activity Recognition Based on Gaze Ethograms | es_ES |
dc.type | info:eu-repo/semantics/article | es_ES |
dc.rights.holder | This is an Open Access article published by World Scientific Publishing Company. It is distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 (CC BY-NC-ND) License which permits use, distribution and reproduction, provided that the original work is properly cited, the use is non-commercial and no modifications or adaptations are made. | es_ES |
dc.rights.holder | Atribución-NoComercial-SinDerivadas 3.0 España | * |
dc.relation.publisherversion | https://www.worldscientific.com/doi/abs/10.1142/S0129065720500252 | es_ES |
dc.identifier.doi | 10.1142/S0129065720500252 | |
dc.contributor.funder | European Commission | |
dc.departamentoes | Ciencia de la computación e inteligencia artificial | es_ES |
dc.departamentoeu | Konputazio zientziak eta adimen artifiziala | es_ES |
Files in this item
This item appears in the following Collection(s)
Except where otherwise noted, this item's license is described as This is an Open Access article published by World Scientific Publishing Company. It is distributed under the terms
of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 (CC BY-NC-ND) License which permits use,
distribution and reproduction, provided that the original work is properly cited, the use is non-commercial and no
modifications or adaptations are made.