Publication: Extracción de preguntas a partir de imágenes para personas con problemas de memoria mediante técnicas de DeepLearning
Loading...
Official URL
Full text at PDC
Publication Date
2021-07-02
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Citations
Exportar
Abstract
El Alzheimer es una enfermedad que afecta a la memoria, el pensamiento y el comportamiento1. Se estima que entre el 60 % y el 70 % de las personas con demencia a nivel mundial sufren Alzheimer.
Este proyecto nace con el objetivo de ayudar a estas personas a recordar aspectos de su vida utilizando técnicas de Deep Learning como redes convolucionales y recurrentes. Para lograrlo desarrollamos un sistema capaz de extraer preguntas de fotografías que puedan representar recuerdos para las personas con problemas de memoria utilizando un bot que simula una sesión de terapia de reminiscencia.
El usuario tendrá que enviarle las fotografías al bot y este se encargará de enviarle, una a una, las preguntas generadas por la red neuronal. En este momento, el usuario deberá recordar todo lo posible sobre la imagen para poder responder a las preguntas y conseguir ejercitar su memoria.
La reminiscencia es una técnica que favorece la evocación de recuerdos y sucesos del pasado para conectarlos con el presente y fortalecer así la propia identidad de la persona frente a esta enfermedad.
lzheimer’s is a disease that affects memory, thinking, and behavior. It is estimated that between 60% and 70% of people with dementia worldwide suffer from Alzheimer’s. This project was born with the aim of helping these people to remember aspects of their lives using Deep Learning techniques such as convolutional and recurrent networks. To achieve this we developed a system capable of extracting questions from photographs that can represent memories for people with memory problems using a bot that simulates a reminiscence therapy session. The user has to send the photographs to the bot and the bot will be in charge of sending him, one by one, the questions generated by the neural network. At this time, the user must remember as much as possible about the image in order to answer the questions and be able to exercise his memory. Reminiscence is a technique that favors the evocation of memories and events of the past to connect them with the present and thus strengthen the person’s own identity in the face of this disease.
lzheimer’s is a disease that affects memory, thinking, and behavior. It is estimated that between 60% and 70% of people with dementia worldwide suffer from Alzheimer’s. This project was born with the aim of helping these people to remember aspects of their lives using Deep Learning techniques such as convolutional and recurrent networks. To achieve this we developed a system capable of extracting questions from photographs that can represent memories for people with memory problems using a bot that simulates a reminiscence therapy session. The user has to send the photographs to the bot and the bot will be in charge of sending him, one by one, the questions generated by the neural network. At this time, the user must remember as much as possible about the image in order to answer the questions and be able to exercise his memory. Reminiscence is a technique that favors the evocation of memories and events of the past to connect them with the present and thus strengthen the person’s own identity in the face of this disease.
Description
Trabajo de Fin de Grado en Ingeniería del Software, Facultad de Informática UCM, Departamento de Ingeniería del Software e Inteligencia Artificial, Curso 2020/2021, todos los recursos del proyecto, ejecutables y código se pueden encontrar en: https://github.com/NILGroup/TFG2021RecuerdosMultimedia