Highlight your achievements on People@HES-SO More info
PEOPLE@HES-SO – Directory and Skills inventory
PEOPLE@HES-SO – Directory and Skills inventory

PEOPLE@HES-SO
Directory and Skills inventory

Help
language
  • fr
  • en
  • de
  • fr
  • en
  • de
  • SWITCH edu-ID
  • Administration
« Back
Carrino Francesco

Carrino Francesco

Professeur-e HES Assistant-e

Main skills

Data Science

Human Computer Interaction

Mixed Reality (Virtual & Augmented)

User Experience

  • Contact

  • Publications

  • Conferences

Main contract

Professeur-e HES Assistant-e

Phone: +41 58 606 92 64

Desktop: ENP.23.N312

HES-SO Valais-Wallis - Haute Ecole d'Ingénierie
Rue de l'Industrie 23, 1950 Sion, CH
HEI - VS
Faculty
Technique et IT
Main Degree Programme
Systèmes industriels
Institute
Institut Systèmes industriels
No data to display for this section

2024

L'usine du futur : Digital - Dark - Adaptive - Creative
Book chapter

Ouerhani Nabil, Sokhn Maria, Carrino Francesco, al. et

,  L'usine du futur : Digital - Dark - Adaptive - Creative. 2024,  Suisse : Georg Éditeur

Summary:

Cet ouvrage propose une discussion autour de l'usine du futur et de son développement, soutenu notamment par l'IA. 

De la "Dark Factory" à la "Créative Factory", l’histoire industrielle peut se résumer comme une longue quête de l’automatisation de la fabrication. Les machines de plus en plus sophistiquées et digitalisées permettront d’achever cette quête. Aujourd’hui déjà, des usines industrielles fonctionnent toutes seules pendant des heures, voire des jours. Ce qu'il sera intéressant de découvrir dans la prochaine phase de la révolution industrielle, c'est à quel point nous ferons appel à l’IA pour inventer le monde de demain.

2023

Dynamic project planning with digital twin
Scientific paper ArODES

Silvan Zahno, Jérôme Corre, Darko Petrovic, Gilles Mottiez, Loïc Fracheboud, Axel Amand, Steve Devènes, Gilbert Maître, Francesco Carrino

Frontiers in Manufacturing Technology,  3

Link to the publication

Summary:

The digital twin (DT) concept plays a crucial role in Industry 4.0 and the digitalization of manufacturing processes. A DT is a virtual representation of a physical object, system, or process, designed to accurately reflect its real-world counterpart. In manufacturing, existing process data are often incomplete and do not qualify as a DT. However, with the help of specialized communication frameworks and cheaper, easier-to-use sensors, it is possible to integrate the existing manufacturing execution system (MES) and enterprise resource planning (ERP) data with the missing data gathered from the shop floor to create a comprehensive DT. In this paper, we present a digital shop floor decision support system (DSS) for non-linear aluminum manufacturing production. The system is split into five main components: digitization of shop floor orders; merging and sorting of MES, ERP, and shop floor data; custom and genetic optimization algorithms for the aging furnace production step; layout construction mechanism for optimal placement and stacking of orders in the furnace; and a user-friendly graphical user interface (GUI). The system’s performance was evaluated through three tests. The first test measured the efficiency of digitization, the second aimed to quantify time saved in finding packets in the hall, and the last test measured the impact of the optimizer on furnace productivity. The results revealed a 23.5% improvement in furnace capacity, but limitations were identified due to usability and human intervention.

ID Tech :
Scientific paper ArODES
a virtual reality simulator training for teenagers with intellectual disabilities

Marine Capallera, Geneviève Piérart, Francesco Carrino, Robin Cherix, Amélie Rossier, Elena Mugellini, Abou Khaled Omar

Applied Sciences,  2023, vol. 13, no. 3679, pp. 1-15

Link to the publication

Summary:

People with intellectual disability (ID) should routinely train themselves to carry out a variety of daily challenging tasks while being supervised by one or more supervisors. Virtual reality (VR) technology enables the simulation of certain learning scenarios that would be risky or difficult to set up or repeatedly replicate in the actual world. This paper introduces a VR simulator created for this aim with the assistance of social educators. The purpose is to use VR to conduct learning exercises with teenagers with ID and assess the extent to which the abilities learned in VR can be transferred to the real world. This project focuses mainly on urban mobility with three types of exercise. A study was conducted with 18 students in five institutions for 7 months. Post-tests were also carried out after 1 month with 11 teenagers. In the end, four teenagers are completely autonomous in their travels: two travel on foot and two travel by public transport. Regarding the impact analysis, the results are stable over time regarding self-reported ease, satisfaction, and fatigability. Finally, the system received valuable feedback from the educators.

Dynamic project planning with digital twin
Scientific paper

Zahno Silvan, Carrino Francesco, Petrovic Darko, Devènes Steve, Gilles Mottiez, Loïc Fracheboud, Maître Gilbert, Jérôme Corre, Amand Axel

Fontiers in Manufacturing, 2023

Link to the publication

Summary:

The digital twin (DT) concept plays a crucial role in Industry 4.0 and the digitalization of manufacturing processes. A DT is a virtual representation of a physical object, system, or process, designed to accurately reflect its real-world counterpart. In manufacturing, existing process data are often incomplete and do not qualify as a DT. However, with the help of specialized communication frameworks and cheaper, easier-to-use sensors, it is possible to integrate the existing manufacturing execution system (MES) and enterprise resource planning (ERP) data with the missing data gathered from the shop floor to create a comprehensive DT. In this paper, we present a digital shop floor decision support system (DSS) for non-linear aluminum manufacturing production. The system is split into five main components: digitization of shop floor orders; merging and sorting of MES, ERP, and shop floor data; custom and genetic optimization algorithms for the aging furnace production step; layout construction mechanism for optimal placement and stacking of orders in the furnace; and a user-friendly graphical user interface (GUI). The system’s performance was evaluated through three tests. The first test measured the efficiency of digitization, the second aimed to quantify time saved in finding packets in the hall, and the last test measured the impact of the optimizer on furnace productivity. The results revealed a 23.5% improvement in furnace capacity, but limitations were identified due to usability and human intervention.

2020

Personage VR – A Virtual Reality Story-Telling Tool to Raise Awareness About Ageism.
Book chapter

Carrino Francesco, Moullet Valentin, Abou Khaled Omar, Mugellini Elena, Maggiori Christian

Dans T. Ahram, R. Taiar, V. Gremeaux-Bader & K. Aminian,  Human Interaction, Emerging Technologies and Future Applications II. 2020,  Cham, Switzerland : Advances in Intelligent Systems and Computing

Étude exploratoire pour un programme de sensibilisation vis-à-vis de l’âgisme
Report
Rapport intermédiaire

Maggiori Christian, Mugellini Elena, Carrino Francesco, F. Angelini, Curty Gaël

2020,  Lausanne, Suisse : Fondation Leenaards,  000  p.

2017

Bien-être psychologique avec l'âge
Professional paper ArODES

Leonardo Angelini, Francesco Carrino, Maurizio Caon, Elena Mugellini, Omar Abou Khaled, Nadine Couture

Angewandte GERONTOLOGIE Appliquée,  2017, vol. 2

Link to the publication

Summary:

La perte progressive de mobilité chez les seniors peut avoir de lourdes conséquences, pas seulement physiques, mais aussi psychiques et cognitives due à un isolement social croissant. La fenêtre interactive est un outil permettant la communication à distance. Elle est issue d’un projet de recherche qui vise à réduire l’isolement social des seniors en utilisant de nouvelles technologies de manière innovante.

2016

iNUIT :
Scientific paper ArODES
Internet of Things for Urban Innovation

Francesco Carrino, Elena Mugellini, Omar Abou Khaled, Nabil Ouerhani, Juergen Ehrensberger

Future Internet,  2016, vol. 8, no. 18

Link to the publication

Summary:

Internet of Things (IoT) seems a viable way to enable the Smart Cities of the future. iNUIT (Internet of Things for Urban Innovation) is a multi-year research program that aims to create an ecosystem that exploits the variety of data coming from multiple sensors and connected objects installed on the scale of a city, in order to meet specific needs in terms of development of new services (physical security, resource management, etc.). Among the multiple research activities within iNUIT, we present two projects: SmartCrowd and OpEc. SmartCrowd aims at monitoring the crowd’s movement during large events. It focuses on real-time tracking using sensors available in smartphones and on the use of a crowd simulator to detect possible dangerous scenarios. A proof-of-concept of the application has been tested at the Paléo Festival (Switzerland) showing the feasibility of the approach. OpEc (Optimisation de l’Eclairage public) aims at using IoT to implement dynamic street light management and control with the goal of reducing street light energy consumption while guaranteeing the same level of security of traditional illumination. The system has been tested during two months in a street in St-Imier (Switzerland) without interruption, validating its stability and resulting in an overall energy saving of about 56%.

Testing the tangible interactive window with older adults
Scientific paper ArODES

Leonardo Angelini, Francesco Carrino, Maurizio Caon, Frédéric Lemaréchal, Nadine Couture, Omar Abou Khaled, Elena Mugellini

GeroPsych,  2016, vol. 29, no. 4, pp. 215-224

Link to the publication

Summary:

Social relationships are crucial for older adults’ well-being. Past research demonstrated that video-communication technology could reduce social isolation. However, most commercial telecommunication systems have interfaces that are too complex to be operated by older adults without assistance. In this paper, we present a system that exploits the tangible affordances of a physical window to provide a natural interface for an always-on video-communication system. In addition, we present a case study focused on the system accessibility and user acceptance with 8 older adults living in a retirement home. We also describe the preliminary findings based on an observation study and on a semistructured interview. Finally, we discuss the possible improvements and impact this system might have on older adults’ life.

iNUIT: Internet of Things for Urban Innovation
Scientific paper

Ouerhani Nabil, Carrino Francesco, Abou Khaled Omar, Mugellini Elena, Ehrensberger Jürgen

Future Internet Journal, 2016

2024

La réalité virtuelle permet-elle d'apprendre ?
Conference

Rossier Amélie, Piérart Geneviève, Capallera Marine, Cherix Robin, Carrino Francesco, Abou Khaled Omar

Congrès Transformations des pratiques et nouvelles représentations du handicap, 28.08.2024 - 28.08.2024, Université du Québec à Montréal, Québec, Canada

2022

Virtual reality simulator training for teenagers with intellectual disabilities
Conference ArODES

Marine Capallera, Robin Cherix, Francesco Carrino, Geneviève Périart, Amélie Rossier, Omar Abou Khaled

Proceedings of GSGS'22 : 7th International Conference on Gamification Serious Game, 29 June - 1st July 2022, Geneva, Switzerland

Link to the conference

Summary:

People with intellectual disabilities (ID) need to train regularly to perform several complex daily tasks while being accompanied by one or more supervisors. The use of virtual reality (VR) allows the simulation of these learning situations that would be difficult to set up or reproduce systematically in the real world. This paper presents an enhancement to a VR simulator designed for this purpose with the help of social educators. The goal is to use virtual reality to perform learning exercises with teenagers with ID. The main exercises are: (a) walking on the sidewalk and crossing crosswalks, (b) taking one or more buses and getting off at the right stops, (c) taking the right train at the station and getting off at the right stop. The simulation also proposes tomanage social interactions thanks to the use of avatars in these scenarios. Each scenario is customized for the students' learning objectives.

ID Tech Project
Conference
Virtual Reality Simulator Training for Teenagers with Intellectual Disabilities

Piérart Geneviève, Capallera Marine, Cherix Robin, Carrino Francesco, Rossier Amélie, Abou Khaled Omar

Gamification and Serious Games 2022 (GSGS'22), 29.06.2022 - 01.07.2022, Sion

Optimization of sensor placement for birds acoustic detection in complex fields
Conference ArODES

Damien Goetschi, Valère Martin, Richard Baltensperger, Marc Vonlanthen, Donatien Roziers, Francesco Carrino

Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - ICPRAM, 3-5 February 2022, Online Streaming

Link to the conference

Summary:

Birds nest in multifunctional semi-natural environments. Intensification of agriculture and forestry prevents their successful breeding, threatening globally their survival. Early bird detection allows for targeted conservation actions, such as local (temporary) habitat protection. The conservationist thus looks for at detecting priority bird species as soon as a territory is occupied, for instance using acoustic surveillance network. We present a comprehensive method to optimize acoustic coverage with a minimum number of sensors in the network. Our method includes a sound propagation model and algorithms for optimized sensor placement. Relevant parameters (e.g., topography, soil type, height of vegetation, weather, etc.) for the sound propagation model are automatically extracted from an area of interest. We implemented and compared Particle Swarm Optimization and Genetic Algorithms-based approaches to solve the optimisation problem.

2021

Inclusion design and functionalities of a personalized virtual coach for wellbeing to facilitate a universal access for older adults
Conference ArODES

Mira El Kamali, Leonardo Angelini, Maurizio Caon, Francesco Carrino, Carlo Emilio Standoli, Paolo Perego, Giuseppe Andreoni, Filippo Palumbo, Alfonso Mastropietro, Omar Abou Khaled, Elena Mugellini

Proceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)

Link to the conference

Summary:

The current research proposes a technological system "NESTORE" designed for and with older adults in four different countries in order to improve and sustain their wellbeing. The system personalized activities and architecture, co-designed interfaces, and its multilingual aspect aim to establish an ‘inclusion’ criterion based on the user’s sociocultural profile and health condition.

A study on the acceptance towards blockchain-based access to biobanks’ services using UTAUT2 with ITM and perceived risk
Conference ArODES

Francesco Carrino, Omar Abou Khaled, Elena Mugellini, Maurizio Caon

Proceedings of the 21st Congress of the International Ergonomics Association (IEA 2021)

Link to the conference

Summary:

The blockchain technology offers reliability, decentralization, security and credibility. Blockchain solutions can be based on smart contracts and on the use of utility tokens which may represent a utility of a company like limited fashion items, cars, car parts or even human biological samples stored in biobanks. However, decentralization comes with responsibilities: people must take care of storing those tokens in a safe place (commonly denominated as “wallets”) knowing that losing a wallet or wallet key means losing the owned tokens. This concept is still new to people and might sound scary. The success of such services relies on the extent of customers intending to adopt them and very few studies target this intention. The current research proposes a model combining of the unified theory of acceptance and usage of technology (UTAUT2) with the initial trust model (ITM) and the perceived risk construct in order to evaluate the factors affecting the behaviour and use intention of people towards a blockchain technology that enables access to biobank services. An online questionnaire was built and sent to swiss university students. The 72 results showed that simplifying the access to blockchain-based technologies will facilitate inclusion, enabling people with lower digital literacy to access these technologies.

2020

Bombuscar :
Conference ArODES
gamification design of a carpolling-based freight transport

Francesco Carrino, Quentin Vaucher, Richard Pasquier, Vincent Bourquin, Omar Abou Khaled, Elena Mugellini, Stéphane Gobron

Proceedings of GSGS'20 : 5th Gamification & Serious Game Symposium, September-November 2020, Switzerland

Link to the conference

Summary:

The environmental and societal cost of traditional logistics, based on the "Hub and spoke" model, is increasingly unfavorable. Digitization allows new approaches that have proved effective in people transportation (e.g., Uber, BlaBlaCar). This project proposes the creation of a smart distribution network for the goods transport by exploiting existing transport capabilities. We present the gamification design of the user interface (UI) to foster users’ motivation and trust to the platform.

Training pedestrian safety skills in youth with intellectual disabilities using fully immersive virtual reality :
Conference ArODES
a feasibility study

Robin Cherix, Francesco Carrino, Geneviève Piérart, Omar Abou Khaled, Elena Mugellini, Dominique Wunderle

Lecture Notes in Computer Science ; Proceedings of HCII 2020, HCI in Mobility, Transport, and Automotive Systems. Driving Behavior, Urban and Smart Mobility, Second International Conference, Held as Part of the 22nd HCI International Conference, 19-24 July 2020, Copenhagen, Denmark

Link to the conference

Summary:

The possibility to move independently outdoor has a huge impact on the quality of life. However, it requires complex skills, difficult to acquire for youth with intellectual disabilities (ID). They need an engaging and varied environment in which they can safely train these skills for all the time they may need. We present an exploratory study that aims to evaluate the usability of virtual reality (immersive headset) as learning tool for youth with ID. We developed a simulator of a pedestrian crossing able to reproduce different environmental conditions (i.e., weather, day-time/night-time, and drivers’ kindness). We tested our simulator with 15 people (9–18 years old) with ID. The tests showed good acceptability and a learning effect was visible after only four consecutive sessions, for a total of sixteen simulated crossings. However, additional studies are required (i) to assess in which measure this effect is imputable to actually learned crossing road skills or to a better control over the tool, (ii) to measure the transfer of the learning from virtual reality to real word conditions.

Personage VR :
Conference ArODES
a virtual reality story-telling tool to raise awareness about ageism

Francesco Carrino, Valentin Moullet, Omar Abou Khaled, Elena Mugellini, Christian Maggiori

Advances in Intelligent Systems and Computing ; Proceedings of IHIET 2020 : 2nd International Conference on Human Interaction Emerging Technologies: Future Applications, 23-25 April 2020, Lausanne, Switzerland

Link to the conference

Summary:

The PersonAge VR project has the two-folded goal of using Virtual Reality (VR) and interactive storytelling to divulge the research and knowledge in the field of ageism and, in the process, to raise awareness about ageism in the population. The system we conceived and developed allows experiencing ageism under three different points of view: the victim, the perpetrator, and the witness. We performed preliminary usability tests (formative usability) with 8 participants from the point of view of the victim. The system was found to be easy to use and the participants provided feedback about the emotions felt when playing the role of an elderly person. The participants felt strong anger and surprise. These feelings could be associated with a situation of discrimination.

2019

Bus simulator in virtual reality for young adults with intellectual disabilities
Conference ArODES

Francesco Carrino, Robin Cherix, Abou Khaled Omar, Elena Mugellini, Dominique Wunderle

Proceedings of the 4th Gamification Serious Games Symposium (GSGS 19)

Link to the conference

Summary:

Virtual Reality (VR) can be used to simulate training scenarios that may be too dangerous or too expensive to be recreated in real life. Currently, people with intellectual disability (ID) train complex everyday situations in the real world under the strict supervision of one (or more) accompanying person until they become autonomous. However, these real-life simulations present risks, can be complicated to set up, and mobilizing the involved people requires time and money. This paper presents a VR simulator conceived with the help of social educators and intended for teenagers and young adults with a light or moderate ID. The simulation enables the users to train different conditions in the scenario of a public transport bus in an urban area.

2018

IMPACT :
Conference ArODES
immersive mirror for pain control and treatment

Francesco Carrino, Omar Abou Khaled, Elena Mugellini

Lecture Notes in Computer Science, Proceedings of the International Conference on Aumented Reality, Virtual Reality and Computer Graphics (AVR 2018), 24-27 June 2018, Ottranto, Italy

Link to the conference

Summary:

We present an overview of IMPACT, a system that uses virtual and augmented reality to enhance the mirror therapy for the treatment of phantom limb pain and stroke rehabilitation. The system tracks users’ movements and the head position using a combination of depth cameras and inertial sensors. This information is then fused together in a 3D full-body human model able to adapt to the patient’s characteristics (e.g., skin color, limb size) and avoid unnatural movements due to possible bad tracking (e.g., a joint bended in an unnatural way). IMPACT includes three serious games that can be played in first-person point of view and that allow different levels of immersion according to the needs of the treatment.

IMPACT :
Conference ArODES
a serious game in virtual and augmented reality to enhance mirror therapy

Francesco Carrino, Charlotte Junod, Omar Abou Khaled, Elena Mugellini

Proceedings of GSGS'18: 3rd Gamification Serious Game Symposium, 5-6 July 2018, Neuchâtel, Switzerland

Link to the conference

2016

Comparing gesture, speech and touch interaction modalities for in-vehicle infotainment systems
Conference ArODES

Leonardo Angelini, Jürgen Baumgartner, Francesco Carrino, Stefano Carrino, Maurizio Caon, Omar Abou Khaled, Jürgen Sauer, Denis Lalanne, Elena Mugellini, Andreas Sonderegger

Actes de la 28e conférence francophone sur l'Interaction Homme-Machine on - IHM '16, 25-28 octobre 2016, Fribourg, Suisse

Link to the conference

Summary:

This paper compares an emergent interaction modality for the In-Vehicle Infotainment System (IVIS), i.e., gesturing on the steering wheel, with two more popular modalities in modern cars: touch in the central dashboard and speech. We conducted a between-subjects experiment with 20 participants for each modality to assess the interaction performance with the IVIS and the impact on the driving performance. Moreover, we compared the three modalities in terms of usability, subjective workload and emotional response. The results showed no statically significant differences between the three interaction modalities regarding the various indicators for the driving task performance, while significant differences were found in measures of IVIS interaction performance: users performed less interactions to complete the secondary tasks with the speech modality, while, in average, a lower task completion time was registered with the touch modality. The three interfaces were comparable in terms of perceived usability, mental workload and emotional response.

2015

Crowd monitoring :
Conference ArODES
critical situations prevention using smartphones and group detection

Joseph El Mallah, Francesco Carrino, Omar Abou Khaled, Elena Mugellini

Proceedings of International Conference on Distributed, Ambient, and Pervasive Interactions, DAPI 2015: Distributed, Ambient, and Pervasive Interactions, 2-7 August 2015, Los Angeles, CA, USA

Link to the conference

Summary:

Festivals and big scale events are becoming more and more popular, they can attract thousands of spectators. Ensuring the safety of the crowd has become a top priority to many organisers after the multitude of dramatic accidents that resulted in losses in human lives. Monitoring the crowd via smartphones is a relatively new technique that emerged recently with the capabilities of mobile phones to transmit their GPS location data. We present a novel approach, based on the local crowd pressure, combined with the detection of groups in a crowd, to detect critical situations and propose evacuation plans that does not separate groups of people that are together. Groups were detected using DBSCAN clustering algorithm with 80 % accuracy. Location acquisition was tested during the Campus Fever event, and 87 % of the collected data had an accuracy lower than 10 m while 29 % of the total data had 5 m of accuracy. During 2 h of monitoring, activity of the application, reduced the battery of 20 %.

2014

Augmented reality treatment for phantom limb pain
Conference ArODES

Francesco Carrino, Didier Rizzotti, Claudia Gheorghe, Patrick Kabusu Bakajuka, Frédérique Francescotti-Paquier, Elena Mugellini

Proceedings of the 6th International Conference, VAMR 2014, Held as Part of HCI International 2014, 22-27 June 2014, Heraklion, Crete, Greece

Link to the conference

Summary:

Mirror therapy is used from many years to treat phantom limb pain in amputees. However, this approach presents several limitations that could be overcome using the possibilities of new technologies. In this paper we present a novel approach based on augmented reality, 3D tracking and 3D modeling to enhance the capabilities of the classic mirror therapy. The system was conceived to be integrated in a three steps treatment called “Graded motor imagery” that includes: limb laterality recognition, motor imagery and, finally, mirror therapy. Aiming at a future home care therapy, we chose to work with low-cost technologies studying their advantages and drawbacks. In this paper, we present the conception and a first qualitative evaluation of the developed system.

2013

Opportunistic synergy :
Conference ArODES
a classifier fusion engine for micro-gesture recognition

Leonardo Angelini, Francesco Carrino, Stefano Carrino, Maurizio Caon, Denis Lalanne, Omar Abou Khaled, Elena Mugellini

Proceedings of AutomotiveUI'13 : Automotive User Interfaces and Interactive Vehicular Applications, 28-30 October 2013, Eindhoven, Netherlands

Link to the conference

Summary:

In this paper, we present a novel opportunistic paradigm for in-vehicle gesture recognition. This paradigm allows using two or more subsystems in a synergistic manner: they can work in parallel but the lack of some of them does not compromise the functioning of the whole system. In order to segment and recognize micro-gestures performed by the user on the steering wheel, we combine a wearable approach based on the electromyography of the user's forearm muscles, with an environmental approach based on pressure sensors integrated directly on the steering wheel. We present and analyze several fusion methods and gesture segmentation strategies. A prototype has been developed and evaluated with data from nine subjects. The results prove that the proposed opportunistic system performs equal or better than each stand-alone subsystem while increasing the interaction possibilities.

WheelSense :
Conference ArODES
enabling tangible gestures on the steering wheel for in-car natural interaction

Leonardo Angelini, Maurizio Caon, Francesco Carrino, Stefano Carrino, Denis Lalanne, Omar Abou Khaled, Elena Mugellini

Proceedings of the 15th International Conference, HCI International 2013, 21-26 July 2013, Las Vegas, NV, USA, Pt. II

Link to the conference

Summary:

This paper presents WheelSense, a system for non-distracting and natural interaction with the In-Vehicle Information and communication System (IVIS). WheelSense embeds pressure sensors in the steering wheel in order to detect tangible gestures that the driver can perform on its surface. In this application, the driver can interact by means of four gestures that have been designed to allow the execution of secondary tasks without leaving the hands from the steering wheel. Thus, the proposed interface aims at minimizing the distraction of the driver from the primary task. Eight users tested the proposed system in an evaluation composed of three phases: gesture recognition test, gesture recognition test while driving in a simulated environment and usability questionnaire. The results show that the accuracy rate is 87% and 82% while driving. The system usability scale scored 84 points out of 100.

Gesture vs. gesticulation :
Conference ArODES
a test protocol

Francesco Carrino, Antonio Ridi, Rolf Ingold, Omar Abou Khaled, Elena Mugellini

Human-Computer Interaction: Towards Intelligent and Implicit Interaction : Proceedings of the 15th International Conference, HCI International 2013, 21-26 July 2013, Las Vegas, NV, USA, part IV

Link to the conference

Summary:

In the last years, gesture recognition has gained increased attention in Human-Computer Interaction community. However, gesture segmentation, which is one of the most challenging tasks in gesture recognition applications, is still an open issue. Gesture segmentation has two main objectives: first, detecting when a gesture begins and ends; second, recognizing whether a gesture is meant to be meaningful for the machine or is a non-command gesture (such as gesticulation). This paper proposes a novel test protocol for the evaluation of different techniques separating command gestures from non-command gestures. Finally, we show how we adapted adopted our test protocol to design a touchless, always available interaction system, in which the user communicates directly with the computer through a wearable and “intimate” interface based on electromyographic signals.

Kinesiologic electromyography for activity recognition
Conference ArODES

Maurizio Caon, Francesco Carrino, Antonio Ridi, Yong Yue, Omar Abou Khaled, Elena Mugellini

Proceedings of PETRA '13: Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, 29-31 May 2013, Rhodes, Greece

Link to the conference

Summary:

This paper presents a wearable system based on kinesiologic electromyography that recognizes the user activity in real time. In particular, the system recognizes the following five activities: "walking", "running", "cycling", "sitting" and "standing". We conducted a study in order to select the opportune muscles and sensors placement. Furthermore, we evaluated the system conducting two analyses: impersonal and subjective. The impersonal analysis evaluated the system behavior when it was trained on several users' data; on the opposite, the subjective analysis evaluated the system when it was specialized on a single subject data. In the impersonal analysis, the accuracy rate was 96.8% for the 10-fold cross-validation and 91.8% for the leave one subject out. The system accuracy rate for the subjective analysis was 99.4%.

Optimization of an electromyography-based activity recognition system
Conference ArODES

Francesco Carrino, Antonio Ridi, Maurizio Caon, Omar Abou Khaled, Elena Mugellini

Proceedings of the 2013 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC), 18-20 February 2013, Rio de Janeiro, Brazil

Link to the conference

Summary:

We present the optimization of a wearable surface electromyography-based system for activity recognition in relation with the number of sensed muscles. The muscles of interest were four: Gastrocnemius, Tibialis Anterior, Vastus Lateralis and Erector Spinae. In particular, the system has been tested for the recognition of five everyday activities: “walking”, “running”, “cycling”, “sitting” and “standing”. We conducted two types of analysis: impersonal and subjective. The impersonal analysis aimed to evaluate the recognition rate when the system was trained over different users. On the opposite, during the subjective analysis the system has been trained using the data coming from a single user. Moreover, we computed the relative computational costs. Among the results, we can highlight that using the signals sensed from three opportunely selected muscles (Gastrocnemius, Tibialis Anterior and Vastus Lateralis) instead of four did not entail a sensible loss of accuracy, whereas it reduced the computational cost of the 24.1 %. In particular, sensing four and three muscles we achieved an activity recognition accuracy higher than 96% for the impersonal analysis; for the subjective analysis, the attained accuracy was higher than 99%.

Achievements

Media and communication
Contact us
Follow the HES-SO
linkedin instagram facebook twitter youtube rss
univ-unita.eu www.eua.be swissuniversities.ch
Legal Notice
© 2021 - HES-SO.

HES-SO Rectorat