Logo des Repositoriums

Auflistung nach Schlagwort "convolutional neural network"

1 - 3 von 3
  • Konferenzbeitrag
    Detection of snow-coverage on PV-modules with images based on CNN-techniques
    (EnviroInfo 2022, 2022) Hepp, Dennis; Hempelmann, Sebastian; Behrens, Grit; Friedrich, Werner
    The transition from fossil fuels to renewable energy is considered as very meaningful to mitigate climate change. To integrate weather-dependent energies firmly into the power grid, a forecast of the energy yield is very important. This paper is about renewable energy generation by photovoltaic (PV) systems. The yield of PV-systems depends not only on weather conditions, but in wintertime also on the additional factor “snow cover”. The aim of this work is to detect snow cover on photovoltaic plants to support the energy yield forecast. For this purpose, images of a PV-plant with and without snow cover are used for feature extraction and then analyzed by using a convolutional neural network (CNN).
  • Konferenzbeitrag
    Explainable AI: Leaf-based medicinal plant classification using knowledge distillation
    (44. GIL - Jahrestagung, Biodiversität fördern durch digitale Landwirtschaft, 2024) Mengisti Berihu Girmay, Samuel Obeng
    Medicinal plants are used in a variety of ways in the pharmaceutical industry in many parts of the world to obtain medicines. They are traditionally used especially in developing countries, where they provide cost-effective treatments. However, accurate identification of medicinal plants can be challenging. This study uses a deep neural network and knowledge distillation approach based on a dataset of 4,026 images of 8 species of leaf-based Ethiopian medicinal plants. Knowledge from a ResNet50 teacher model was applied to a lightweight 2-layer student model. The student model, optimized for efficiency, achieved 96.91% accuracy and came close to the 98.98% accuracy of the teacher model on unseen test data. The training was built on optimization strategies, including oversampling, data augmentation, and learning rate adjustment. To understand the model's decisions, LIME (Local Interpretable Model-agnostic Explanations) and degree Grad-CAM (Gradient-weighted Class Activation Mapping) post-hoc explanation techniques were used to highlight influential image regions that contributed to classification.
  • Konferenzbeitrag
    KnuckleTouch: Enabling Knuckle Gestures on Capacitive Touchscreens using Deep Learning
    (Mensch und Computer 2019 - Tagungsband, 2019) Schweigert, Robin; Leusmann, Jan; Hagenmayer, Simon; Weiß, Maximilian; Le, Huy Viet; Mayer, Sven; Bulling, Andreas
    While mobile devices have become essential for social communication and have paved the way for work on the go, their interactive capabilities are still limited to simple touch input. A promising enhancement for touch interaction is knuckle input but recognizing knuckle gestures robustly and accurately remains challenging. We present a method to differentiate between 17 finger and knuckle gestures based on a long short-term memory (LSTM) machine learning model. Furthermore, we introduce an open source approach that is ready-to-deploy on commodity touch-based devices. The model was trained on a new dataset that we collected in a mobile interaction study with 18 participants. We show that our method can achieve an accuracy of 86.8% on recognizing one of the 17 gestures and an accuracy of 94.6% to differentiate between finger and knuckle. In our evaluation study, we validate our models and found that the LSTM gestures recognizing archived an accuracy of 88.6%. We show that KnuckleTouch can be used to improve the input expressiveness and to provide shortcuts to frequently used functions.