Geri Dön

Gesture recognition for human-machine interaction in aviation

Havacılıkta insan-makine etkileşimi için el hareketi sezme

  1. Tez No: 720819
  2. Yazar: TUĞBA ZEYBEK
  3. Danışmanlar: DOÇ. DR. UFUK SAKARYA
  4. Tez Türü: Yüksek Lisans
  5. Konular: Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrol, Elektrik ve Elektronik Mühendisliği, Havacılık Mühendisliği, Computer Engineering and Computer Science and Control, Electrical and Electronics Engineering, Aeronautical Engineering
  6. Anahtar Kelimeler: Human-Machine Interaction, gesture recognition, spatio-temporal, Support Vector Machine, dominant set clustering, Human-Machine Interaction, gesture recognition, spatio-temporal, Support Vector Machine, dominant set clustering
  7. Yıl: 2022
  8. Dil: İngilizce
  9. Üniversite: Yıldız Teknik Üniversitesi
  10. Enstitü: Fen Bilimleri Enstitüsü
  11. Ana Bilim Dalı: Aviyonik Mühendisliği Ana Bilim Dalı
  12. Bilim Dalı: Aviyonik Mühendisliği Bilim Dalı
  13. Sayfa Sayısı: 61

Özet

With the developing technology, human-machine interaction (HMI) is very significant in aviation, as in every area. Hand gestures are accepted in HMI applications. Because the human hand is quite adept at controlling a device. Gesture recognition problems in HMI also have some problems due to their nature. Not every human performs the same movement in space in the same way. Even the same person cannot perform the same movement in the exact same manner. This complicates the recognition problem. Due to large in-class differences between users, the efficiency of features derived from different sensors is compared in user-independent situations. The spatio-temporal nature of gesture signals is considered for recognition and a simple statistical feature-based approach is presented that works on transformed signals. With this approach, it is time-independent and allows the transition to the energy domain. With the wavelet-based statistical feature method, the size of the new data increases considerably. It becomes difficult to analyze high-dimensional data and to find meaningful data in the data set. Linear dimension reduction techniques are applied to solve the new problem. The scenario created in the motion classes is classified after the combination of dimension reduction and classification techniques. These results are linked to the flight simulator tool. In this thesis study, in cases where the pilots are insufficient for the increasing number of UAVs, the dominant set clustering method is recommended in order to provide UAV control with less trained pilots. This method is flexible as it can be used in both civil and military fields. In critical situations, more than one intermediately trained pilot may act like a well-trained pilot. In other cases, already moderately trained pilots will suffice.

Özet (Çeviri)

With the developing technology, human-machine interaction (HMI) is very significant in aviation, as in every area. Hand gestures are accepted in HMI applications. Because the human hand is quite adept at controlling a device. Gesture recognition problems in HMI also have some problems due to their nature. Not every human performs the same movement in space in the same way. Even the same person cannot perform the same movement in the exact same manner. This complicates the recognition problem. Due to large in-class differences between users, the efficiency of features derived from different sensors is compared in user-independent situations. The spatio-temporal nature of gesture signals is considered for recognition and a simple statistical feature-based approach is presented that works on transformed signals. With this approach, it is time-independent and allows the transition to the energy domain. With the wavelet-based statistical feature method, the size of the new data increases considerably. It becomes difficult to analyze high-dimensional data and to find meaningful data in the data set. Linear dimension reduction techniques are applied to solve the new problem. The scenario created in the motion classes is classified after the combination of dimension reduction and classification techniques. These results are linked to the flight simulator tool. In this thesis study, in cases where the pilots are insufficient for the increasing number of UAVs, the dominant set clustering method is recommended in order to provide UAV control with less trained pilots. This method is flexible as it can be used in both civil and military fields. In critical situations, more than one intermediately trained pilot may act like a well-trained pilot. In other cases, already moderately trained pilots will suffice.

Benzer Tezler

  1. Emotion recognition using deep learning focusing on the hand and facial expressions

    El ve yüz ifadelerine odaklanan derin oğrenmeyi kullanarak duygu tanıma

    HASANAIN JAWAD RADEEF

    Yüksek Lisans

    İngilizce

    İngilizce

    2024

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve KontrolAnkara Üniversitesi

    Bilgisayar Mühendisliği Ana Bilim Dalı

    YRD. DOÇ. DR. YILMAZ AR

  2. Recognition and monitoring of human motions using RF signals

    İnsan hareketlerinin RF sinyalleri kullanarak tanımlanması ve izlenmesi

    CAN UYSAL

    Doktora

    İngilizce

    İngilizce

    2020

    Elektrik ve Elektronik MühendisliğiEskişehir Teknik Üniversitesi

    Elektrik-Elektronik Mühendisliği Ana Bilim Dalı

    DOÇ. DR. TANSU FİLİK

  3. Hand gesture recognition for Turkish sign language using electromyography for human-robot interaction

    İnsan-robot etkileşimi için elektromyografi kullanarak Türk işaret dili için el hareketi tanıma

    MUSTAFA SEDDIQI

    Yüksek Lisans

    İngilizce

    İngilizce

    2021

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrolİstanbul Teknik Üniversitesi

    Bilgisayar Mühendisliği Ana Bilim Dalı

    DOÇ. DR. HATİCE KÖSE

  4. Hand gesture recognition for music player system using convolutional neural network

    Evrensel sinir ağı kullanarak müzik çalar sistemi için el jestleri tanıma

    ANWAR DIYAA AWAD AL MOHAMMEDI

    Yüksek Lisans

    İngilizce

    İngilizce

    2022

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve KontrolAltınbaş Üniversitesi

    Bilişim Teknolojileri Ana Bilim Dalı

    YRD. DOÇ. DR. HAKAN KOYUNCU

  5. Machine learning techniques for surface electromyography based hand gesture recognition

    Yüzey elektromiyografi temelli el jesti tanıma için makine öğrenmesi teknikleri

    ENGİN KAYA

    Yüksek Lisans

    İngilizce

    İngilizce

    2018

    Bilgisayar Mühendisliği Bilimleri-Bilgisayar ve Kontrolİstanbul Teknik Üniversitesi

    Kontrol ve Otomasyon Mühendisliği Ana Bilim Dalı

    DOÇ. DR. TUFAN KUMBASAR