Abstract:Abstract: One of the main challenges in digital image processing is limited resolution, which makes it difficult to preserve visual details when images are enlarged. Conventional methods such as Bilinear Interpolation are…
e commonly used for image upscaling; however, these approaches often produce blurred images, lose fine textures, and fail to reconstruct complex visual structures. This study aims to enhance digital image resolution by employing a deep learni based approach using a Low-Light Convolutional Neural Network (LLCNN) built upon a Deep Neural Network (DNN) architecture. The dataset used in this study is the DIV2K dataset, which consists of 1,000 high-resolution images. These images were downsampled using scaling factors of ×2, ×3, and ×4 to generate paired Low Resolution–High Resolution (LR–HR) data for training and evaluation. The proposed LLCNN is designed to extract important features such as edges, textures, and local patterns through multiple convolutional layers, followed by non-linear mapping to reconstruct high-resolution images more accurately. Quantitative performance evaluation was conducted using the Peak Signal-to-Noise Ratio (PSNR) and the Structural Similarity Index (SSIM). Model performance was evaluated quantitatively using the Peak Signal-to-Noise Ratio (PSNR) metric. Experimental results showed that the proposed method improved image quality compared to the bilinear method. These results indicate that the deep learning based approach effectively improves image sharpness and structural fidelity, thereby demonstrating its potential for digital image resolution enhancement.
Keywords: deep neural network; image resolution; low-light convolutional neural network; machine learning
Abstrak: Permasalahan utama dalam pengolahan citra digital adalah keterbatasan resolusi yang menyebabkan detail visual sulit dipertahankan ketika citra diperbesar. Metode konvensional seperti Bilinear Interpolation masih banyak digunakan, namun sering menghasilkan citra buram, kehilangan tekstur halus, serta tidak mampu merekonstruksi struktur visual yang kompleks. Penelitian ini bertujuan untuk meningkatkan kualitas resolusi citra digital dengan memanfaatkan pendekatan deep learning berbasis Low-Light Convolutional Neural Network (LLCNN) yang dibangun di atas arsitektur Deep Neural Network (DNN). Data yang digunakan dalam penelitian ini berasal dari dataset DIV2K, yang terdiri dari 1000 citra beresolusi tinggi. Citra tersebut diturunkan menjadi resolusi rendah menggunakan faktor downsampling ×2, ×3, dan ×4 untuk membentuk pasangan data Low Resolution–High Resolution (LR–HR) sebagai data pelatihan dan pengujian. LLCNN dirancang untuk mengekstraksi fitur-fitur penting seperti tepi, tekstur, dan pola lokal melalui beberapa lapisan konvolusi, kemudian melakukan pemetaan non-linear guna merekonstruksi citra resolusi tinggi secara lebih presisi. Evaluasi performa model dilakukan secara kuantitatif menggunakan metrik Peak Signal-to-Noise Ratio (PSNR). Hasil eksperimen menunjukkan bahwa metode yang diusulkan mampu meningkatkan kualitas citra dibandingkan metode bilinear. Hasil ini membuktikan bahwa pendekatan berbasis deep learning efektif dalam meningkatkan ketajaman dan kesesuaian struktur citra digital.
Kata kunci: deep neural network; low-light convolutional neural network; machine learning; resolusi citra
Abstract:Abstract: The policy to increase the Rural and Urban Land and Building Tax (PBB-P2) in Indonesia often elicits mixed reactions from the public. Some support it because they believe it can strengthen regional fiscal capacity,…
ity, while others reject it because they are concerned that it will increase the economic burden on the community. Understanding public sentiment towards this policy is important for evaluating the effectiveness of the policy and formulating appropriate communication strategies. This study aims to analyze public sentiment towards the PBB-P2 increase policy using data uploaded on Platform X (Twitter). The data were collected through crawling with the keyword “building tax,” then processed through several preprocessing stages before classifying tweets into positive and negative sentiments. Two models were used: Support Vector Machine (SVM) and Bidirectional Long Short-Term Memory (BiLSTM). Results show that SVM outperformed BiLSTM, achieving training accuracy of 99.4% and testing accuracy of 85.9%, with accuracy 0.8595, precision 0.8536, recall 0.8595, and F1-score 0.8449. Meanwhile, BiLSTM achieved training accuracy of 86.9% and testing accuracy of 82.9%, with accuracy 0.8294, precision 0.8150, recall 0.8294, and F1-score 0.8080. These findings suggest SVM is more effective in classifying public sentiment and can support better evaluation of regional tax policies.
Keywords: sentiment analysis; PBB-P2; BiLSTM; SVM; X platform
Abstrak: Kebijakan kenaikan tarif Pajak Bumi dan Bangunan Perdesaan dan Perkotaan (PBB-P2) di In-donesia sering memunculkan beragam reaksi dari masyarakat. Sebagian mendukung karena dianggap dapat memperkuat kapasitas fiskal daerah, sementara lainnya menolak karena kha-watir menambah beban ekonomi masyarakat. Pemahaman terhadap sentimen publik atas ke-bijakan tersebut penting untuk mengevaluasi efektivitas kebijakan dan merumuskan strategi komunikasi yang tepat. Penelitian ini bertujuan menganalisis sentimen masyarakat terhadap kebijakan kenaikan PBB-P2 menggunakan data unggahan di Platform X (Twitter). Data dik-umpulkan melalui proses crawling dengan kata kunci “pajak bangunan” kemudian diproses melalui beberapa tahap preprocessing sebelum diklasifikasikan menjadi sentimen positif dan negatif. Dua model digunakan dalam penelitian ini, yaitu Support Vector Machine (SVM) dan Bidirectional Long Short-Term Memory (BiLSTM). Hasil penelitian menunjukkan bahwa SVM memiliki kinerja lebih baik dibandingkan BiLSTM, dengan akurasi pelatihan 99,4% dan akurasi pengujian 85,9%. Nilai akurasi 0,8595, precision 0,8536, recall 0,8595, dan F1-score 0,8449. Sementara itu, BiLSTM memperoleh akurasi pelatihan 86,9% dan akurasi pengujian 82,9%, dengan akurasi 0,8294, precision 0,8150; recall 0,8294; dan F1-score 0,8080. Temuan ini menunjukkan bahwa SVM lebih efektif dalam mengklasifikasikan sentimen publik serta dapat mendukung evaluasi kebijakan pajak daerah dengan lebih baik.
Kata kunci: analisis sentimen; PBB-P2; BiLSTM; SVM; platform X
Abstract:Abstract: The rapid growth of the digital music industry requires accurate music genre classification systems to enhance user experience in streaming services. This study compares a domain-specific Long Short-Term Memory…
(LSTM) network with three Large Language Models (LLMs)—HuBERT, WavLM, and WAV2Vec 2.0—for Music Genre Classification (MGC). The LSTM model was trained using Mel-spectrograms transformed from the GTZAN dataset, while the LLMs were fine-tuned using a smaller set of raw audio samples due to computational constraints. All models were tested on datasets with identical genre labels to ensure a fair evaluation. Results show that the LSTM model achieved the highest accuracy of 97.10%, outperforming HuBERT (86.00%), WavLM (83.00%), and WAV2Vec 2.0 (80.00%). The LSTM demonstrated superior generalization and stability without overfitting, while the LLMs struggled to differentiate between genres with similar acoustic characteristics. These findings indicate that general-purpose pre-trained models, although powerful, are less effective in music-specific tasks due to domain mismatch. Therefore, incorporating music-specific features and architectures remains essential for achieving higher accuracy and reliability in automatic genre classification systems.
Keywords: audio large language models; comparative deep learning; music genre classification.
Abstrak: Pertumbuhan industri musik digital yang pesat menuntut sistem klasifikasi genre musik yang akurat untuk meningkatkan pengalaman pengguna dalam layanan streaming. Penelitian ini dilatarbelakangi oleh perkembangan pesat model pembelajaran mendalam, khususnya jaringan LSTM dan model bahasa berskala besar LLM seperti HuBERT, WavLM, dan WAV2Vec 2.0, yang telah menunjukkan kemampuan representasi audio yang kuat. Tujuan penelitian ini ini membandingkan jaringan Long Short-Term Memory (LSTM) khusus domain dengan tiga model Large Language Models (LLM)—HuBERT, WavLM, dan WAV2Vec 2.0—untuk tugas Klasifikasi Genre Musik (MGC). Metode penelitian melibatkan pelatihan LSTM menggunakan data Mel-spectrogram hasil transformasi dari dataset GTZAN, sementara LLM disesuaikan (fine-tuning) menggunakan data audio mentah dalam jumlah lebih kecil karena keterbatasan komputasi. Seluruh model diuji pada dataset dengan label genre yang sama untuk memastikan evaluasi yang adil. Hasil penelitian menunjukkan bahwa model LSTM mencapai akurasi tertinggi sebesar 97,10%, sedangkan model HuBERT, WavLM, dan WAV2Vec 2.0 masing-masing memperoleh 86,00%, 83,00%, dan 80,00%. Model LSTM menunjukkan kemampuan generalisasi yang lebih baik tanpa overfitting, sedangkan model LLM cenderung kesulitan membedakan genre dengan karakteristik akustik yang mirip. Kesimpulan penelitian ini adalah ketidaksesuaian domain secara signifikan membatasi performa model umum saat diterapkan pada tugas berbasis musik. Oleh karena itu, penggunaan fitur dan arsitektur khusus musik sangat penting dalam membangun sistem klasifikasi genre yang lebih akurat.
Kata kunci: klasifikasi genre musik; model bahasa besar; perbandingan pembelajaran mendalam.
Abstract:Abstract: Asthma is a chronic respiratory disease that affects millions of people worldwide, making early detection crucial to prevent complications. This study aims to compare the performance of the Decision Tree and Random…
ndom Forest algorithms in classifying asthma based on clinical symptom data. The data were processed through feature selection and model training stages, then evaluated using accuracy, precision, recall, and F1-score.The experimental analysis revealed that the Random Forest algorithm surpassed the Decision Tree in all metrics, achieving 95.19% accuracy, 90.43% precision, 95.00% recall, and 93.00% F1-score. In contrast, the Decision Tree obtained 89.14% accuracy, 90.60% precision, 88.70% recall, and 89.70% F1-score. These results suggest that Random Forest is more robust and dependable, especially in managing complex and imbalanced medical datasets.
Keywords: asthma detection; decision tree; random forest; machine learning.
Abstrak: Asma merupakan penyakit pernapasan kronis yang memengaruhi jutaan orang di seluruh dunia sehingga deteksi dini sangat penting untuk mencegah komplikasi. Penelitian ini bertujuan membandingkan kinerja algoritma Decision Tree dan Random Forest dalam mengklasifikasikan asma berdasarkan data gejala klinis. Data diproses melalui tahapan seleksi fitur dan pelatihan model, kemudian dievaluasi menggunakan akurasi, presisi, recall, dan F1-score. Hasil penelitian menunjukkan bahwa Random Forest memberikan performa terbaik dengan akurasi 90.43%, presisi 95.00%, recall 95.00%, dan F1-score 93.00%. Sebaliknya, Decision Tree memperoleh akurasi 89.14%, presisi 90.60%, recall 88.70%, dan F1-score 89.70%. Hasil ini menunjukkan bahwa Random Forest lebih kuat dan dapat diandalkan, terutama dalam mengelola kumpulan data medis yang kompleks dan tidak seimbang.
Kata kunci: deteksi asma; decision tree; random forest; pembelajaran mesin.
Abstract:Abstract: MBG is a strategic program of the Prabowo-Gibran administration. This program has become a widely discussed issue in the public. To better understand public perception of this program, sentiment analysis is necessary.…
essary. This study aims to compare the performance of algorithms machine learning SVM, RF, And BERT with preprocessing data analyzing public sentiment of the MBG program in media X. The total dataset for this study was 39,858 out of 42,465 successfully crawled tweets. The research methods included data collection, preprocessing data (cleaning, case folding, word normalization, stopword removal and stemming), feature extraction, model training (fine-tuning), handling class imbalance with SMOTE, and evaluation using accuracy, precision, recall, and f1-score. The research results show that without SMOTE, the best performing models are BERT with 89% accuracy, SVM 87%, and RF 78.4%. After SMOTE, the best algorithms were SVM with 92.94%, BERT with 88.3%, and RF with 86.59%. The results confirmed that SVM is the best algorithm if at leastclass imbalance. BERT is the best algorithm before and after SMOTE, because BERT is more effective in capturing the nuances of language on social media, so BERT is the most recommended in MBG sentiment analysis.
Keywords: sentiment analysis; machine learning; SVM, RF, and BERT
Abstrak: MBG merupakan program strategis pemerintahan Prabowo - Gibran. Program ini menjadi isu yang banyak diperbincangkan publik. Untuk mengetahui lebih dalam persepsi masyrakat tentang program ini, perlu dilakukan analisis sentiment. Penelitian ini bertujuan membandingkan kinerja algoritma machine learning SVM, RF, dan BERT dengan preprocessing data menganalisis sentiment public program MBG di media X. Total dataset penelitian ini adalah 39.858 dari 42.465 tweet yang berhasil di crawling. Metode penelitian mencakup pengumpulan data, preprocessing data (cleaning, case folding, normalisasi kata, stopword removal dan stemming), ekstraksi fitur, pelatihan model (fine-tuning), penanganan class imbalance dengan SMOTE, dan evaluasi menggunakan akurasi, presisi, recall, dan f1-score. Hasil peneltian menunjukkan, tanpa SMOTE model dengan kinerja terbaik adalah BERT dengan akurasi 89%, SVM 87%, dan RF 78,4%. Setelah SMOTE algoritma terbaik adalah SVM 92,94%, BERT 88,3% dan RF 86,59%. Hasil penelitian menegaskan bahwa SVM adalah algoritma terbaik jika minimal class imbalance. BERT adalah algoritma terbaik sebelum dan sesudah SMOTE, karena BERT lebih efektif dalam menangkap nuansa bahasa pada media sosial, sehingga BERT paling di rekomendasikan dalam analisis sentimen MBG.
Kata kunci: analisis sentimen; machine learning; SVM, RF, dan BERT
Abstract:Abstract: Stroke is one of the leading causes of death and disability in various parts of the world, including in Indonesia. Along with the development of digital technology, the use of Machine Learning in the health sector…
tor is growing, one of which is in an effort to predict the occurrence of stroke. This study aims to implement the Logistic Regression algorithm in predicting the likelihood of a person having a stroke based on data from the Brain Stroke dataset. The research process includes data preprocessing (missing value handling, normalization, and label encoding), dividing the data into 80% training data and 20% test data, as well as model training. The model was then evaluated using several measures such as accuracy, precision, recall, F1-score, and ROC-AUC, as well as a confusion matrix. The results of the study showed that Logistic Regression was able to provide stroke classification results with an accuracy of 82.4%, precision of 80.1%, recall of 78.6%, F1-score of 79.3%, and a ROC-AUC value of 0.87. Then, the model is integrated into applications that use Streamlit, so it can be used interactively to predict stroke risk in new data. The results of this study show that the combination of Machine Learning and web-based applications has the potential to support efforts to detect early stroke risk.
Keywords: logistic regression; machine learning; prediction; streamlit; stroke.
Abstrak: Stroke adalah salah satu penyebab utama kematian dan kecacatan di berbagai belahan dunia, termasuk di Indonesia. Seiring perkembangan teknologi digital, penggunaan Machine Learning dalam bidang kesehatan semakin berkembang, salah satunya dalam upaya memprediksi terjadinya penyakit stroke. Penelitian ini bertujuan untuk mengimplementasikan algoritma Logistic Regression dalam memprediksi kemungkinan seseorang mengalami stroke berdasarkan data dari dataset Brain Stroke. Proses penelitian meliputi preprocessing data (penanganan missing value, normalisasi, dan label encoding), membagi data menjadi 80% data latih dan 20% data uji, serta pelatihan model. Model kemudian dievaluasi menggunakan beberapa ukuran seperti akurasi, precision, recall, F1-score, dan ROC-AUC, serta confusion matrix. Hasil penelitian menunjukkan bahwa Logistic Regression mampu memberikan hasil klasifikasi penyakit stroke dengan akurasi sebesar 82,4%, precision 80,1%, recall 78,6%, F1-score 79,3%, dan nilai ROC-AUC sebesar 0,87. Kemudian, model tersebut diintegrasikan ke dalam aplikasi yang menggunakan Streamlit, sehingga dapat digunakan secara interaktif untuk memprediksi risiko stroke pada data baru. Hasil penelitian ini menunjukkan bahwa kombinasi Machine Learning dan aplikasi berbasis web berpotensi mendukung upaya deteksi dini risiko stroke.
Kata kunci: logistic regression; machine learning; prediksi; streamlit; stroke.
Abstract:Abstract: In the era of the Internet of Things (IoT), cyber threats are increasingly complex and dynamic, thus demanding an adaptive and intelligent network security system. This study proposes a Convolutional Neural Network…
work (CNN)-based Intrusion Detection System (IDS) implemented through a Federated Learning (FL) approach in a Non-Independent and Identically Distributed (Non-IID) data environment. This approach allows the model to be trained in a distributed manner across multiple IoT devices without having to collect sensitive data to a central server, thereby maintaining data privacy while increasing the efficiency of the training process. The experiment used the CIC IoT 2023 dataset, which represents various modern IoT network traffic patterns. The results show that the proposed CNN–FL model achieves an overall accuracy of 0.99, with excellent performance in detecting various types of network traffic. The model obtains a perfect recall value (1.00) for normal traffic (Benign), as well as a very high F1-score for DDoS (0.99) and DoS (0.99) attacks. Stable and consistent performance across all five federation rounds demonstrates that this approach is a reliable, efficient, and accurate solution for detecting threats in distributed and privacy-preserving IoT networks.
Keywords: cnn; federated_learning; ids; non-iid; ciciot2023
Abstrak: Dalam era Internet of Things (IoT), ancaman siber semakin kompleks dan dinamis, sehingga menuntut sistem keamanan jaringan yang adaptif dan cerdas. Penelitian ini mengusulkan Intrusion Detection System (IDS) berbasis Convolutional Neural Network (CNN) yang diterapkan melalui pendekatan Federated Learning (FL) pada lingkungan data yang bersifat Non-Independent and Identically Distributed (Non-IID). Pendekatan ini memungkinkan model dilatih secara terdistribusi di berbagai perangkat IoT tanpa harus mengumpulkan data sensitif ke server pusat, sehingga mampu menjaga privasi data sekaligus meningkatkan efisiensi proses pelatihan. Eksperimen menggunakan dataset CIC IoT 2023, yang merepresentasikan berbagai pola lalu lintas jaringan IoT modern. Hasil penelitian menunjukkan bahwa model CNN–FL yang diusulkan mencapai akurasi keseluruhan sebesar 0.99, dengan performa yang sangat baik dalam mendeteksi berbagai jenis lalu lintas jaringan. Model memperoleh nilai recall sempurna (1.00) untuk lalu lintas normal (Benign), serta nilai F1-score yang sangat tinggi untuk serangan DDoS (0.99) dan DoS (0.99). Kinerja yang stabil dan konsisten di seluruh lima putaran federasi membuktikan bahwa pendekatan ini merupakan solusi yang andal, efisien, dan akurat untuk mendeteksi ancaman pada jaringan IoT yang bersifat terdistribusi dan menjaga privasi (privacy-preserving).
Kata kunci: cnn; federated_learning; ids; non-iid; ciciot2023
Abstract:Abstract: This study applies an integrated approach to optimize heart failure classification. The main objective is to address the challenge of class imbalance in medical datasets and to improve the accuracy, sensitivity,…
, and generalization of the classification model. The urgency of this issue is emphasized by statistics showing that cardiovascular diseases cause approximately 17.9 million deaths worldwide each year. Using a quantitative experimental approach, this study analyzes the "Heart Failure Prediction Dataset" from Kaggle, which consists of 918 records. The data were processed through normalization and encoding, followed by the application of SMOTE on the training set to balance class distribution. This step successfully increased model accuracy from 88.41% to 90.22% and minority class recall from 0.82 to 0.88. Furthermore, Bayesian Optimization was employed to refine the hyperparameters of SVM, resulting in a final model with an accuracy of 89.13% that demonstrated better generalization. This integrated approach significantly enhances the stability, sensitivity, and generalization of the model, making it a reliable tool for clinical decision support systems in predicting heart failure.
Keywords: bayesian optimization; heart failure; machine learning; SMOTE; SVM.
Abstrak: Penelitian ini menerapkan pendekatan terintegrasi untuk mengoptimalkan klasifikasi gagal jantung. Tujuan utama studi ini adalah untuk mengatasi tantangan ketidakseimbangan kelas dalam dataset medis dan meningkatkan akurasi, sensitivitas, serta generalisasi model klasifikasi. Urgensi ini ditegaskan oleh statistik yang menunjukkan bahwa penyakit kardiovaskular menyebabkan sekitar 17,9 juta kematian setiap tahun secara global. Menggunakan pendekatan eksperimental kuantitatif, penelitian ini menganalisis "Heart Failure Prediction Dataset" dari Kaggle, yang terdiri dari 918 catatan. Data diproses dengan normalisasi dan encoding, lalu SMOTE diterapkan pada data pelatihan untuk menyeimbangkan distribusi kelas. Langkah ini berhasil meningkatkan akurasi dari 88,41% menjadi 90,22% dan recall kelas minoritas dari 0,82 menjadi 0,88. Selanjutnya, Bayesian Optimization menyempurnakan hyperparameter SVM, menghasilkan model akhir dengan akurasi 89,13% yang menunjukkan generalisasi lebih baik. Pendekatan terintegrasi ini secara signifikan meningkatkan stabilitas, sensitivitas, dan generalisasi model. Hasil penelitian ini menjadikannya alat yang andal untuk sistem pendukung keputusan klinis dalam prediksi gagal jantung.
Kata kunci: bayesian optimization; gagal jantung; machine learning; SMOTE; SVM
Abstract:Abstract: This study aims to develop a Deep Learning-based Traffic Flow Detector to automatically and accurately observe traffic flow. Conventional traffic observation is often conducted manually or via CCTV, but it is prone…
rone to human error and difficult to use for real-time trend analysis. In this study, the YOLOv4 method is used to detect four types of vehicles (cars, motorcycles, buses, trucks). To continuously track vehicle movement and address occlusion issues, the Deep SORT algorithm is implemented. The YOLOv4 model used is a pre-trained model and was tested on seven CCTV video recordings obtained from the official website of the Pekanbaru City Transportation Department. The system was implemented on a limited device, the Nvidia Jetson Nano, as a simulation of direct CCTV integration. Test results showed a highest precision of 98%, but the maximum accuracy achieved was only 26%. This low accuracy is influenced by several factors, including video resolution, detection model quality, and lighting conditions. Nevertheless, the system demonstrates potential to support future traffic management and engineering decisions but still requires further optimization, including improving video resolution and quality, retraining the model with a more representative local dataset, using lighter and more accurate detection models, and optimizing the tracking algorithm.
Keywords: deep learning; deepsort; NVIDIA Jetson NANO; traffic flow; YOLOv4
Abstrak: Penelitian ini bertujuan mengembangkan Traffic Flow Detector berbasis Deep Learning untuk mengobservasi arus lalu lintas secara otomatis dan akurat. Observasi lalu lintas konvensional sering dilakukan secara manual atau melalui CCTV, namun rentan terhadap human error dan sulit digunakan untuk menganalisis tren secara real-time. Pada penelitian ini digunakan metode YOLOv4 untuk mendeteksi empat jenis kendaraan (mobil, motor, bus, truk). Untuk melacak pergerakan kendaraan secara berkelanjutan dan mengatasi masalah occlusion, digunakan algoritma Deep SORT. Model YOLOv4 yang digunakan merupakan pre-trained model dan diujikan pada tujuh rekaman video CCTV yang diambil dari situs resmi Dinas Perhubungan Kota Pekanbaru. Sistem ini diimplementasikan pada perangkat terbatas Nvidia Jetson Nano sebagai simulasi penerapan langsung pada CCTV. Hasil pengujian menunjukkan presisi tertinggi mencapai 98%, namun akurasi tertingginya hanya sebesar 26%. Rendahnya akurasi dipengaruhi oleh beberapa faktor seperti resolusi video, kualitas model deteksi, serta kondisi pencahayaan. Meski demikian, sistem ini menunjukkan potensi untuk membantu pengambilan keputusan dalam manajemen dan rekayasa lalu lintas di masa depan, namun masih membutuhkan optimasi lebih lanjut, seperti peningkatan kualitas video input, pelatihan ulang model dengan dataset lokal, penggunaan model deteksi yang lebih ringan dan akurat serta pengoptimalan algoritma pelacakan.
Kata kunci: deep learning deepsort; Nvidia Jetson Nano; traffic flow; YOLOv4
Abstract:Abstract: Face recognition based on deep learning has become an important technology in many areas. However, these systems often face challenges in real-world conditions, such as when the face is partially covered by accessories…
essories such as masks or glasses. This study aims to evaluate the effect of data augmentation by adding facial accessories (masks, glasses, and a combination of both) and geometric augmentation on the accuracy of face recognition systems. There are three types of datasets used in this method: the original dataset (category 1), the dataset with facial accessories augmentation (category 2), and the dataset with geometric augmentation (category 3). Data augmentation was performed on the training dataset to increase diversity, followed by the face detection process using SCRFD and feature extraction with ArcFace. The model was then trained using Multi-Layer Perceptron (MLP). Based on the results, adding face accessories (category 2) made the model a lot more accurate, hitting 99% accuracy. In category 3, adding geometric features improved accuracy to 91%. Other evaluation metrics, such as precision, recall, and F1-score, also showed improvement after augmentation. This study concludes that facial accessories augmentation is more effective in improving the accuracy and robustness of face recognition models compared to geometric augmentation.
Keywords: augmentation; deep learning; face recognition; glasses.
Abstrak: Pengenalan wajah berbasis deep learning telah menjadi salah satu teknologi penting dalam berbagai aplikasi. Namun, sistem ini sering kali menghadapi tantangan dalam kondisi dunia nyata, seperti saat wajah tertutup sebagian oleh aksesori seperti masker atau kacamata. Penelitian ini bertujuan untuk mengevaluasi pengaruh augmentasi data dengan menambahkan aksesori wajah (masker, kacamata, dan kombinasi keduanya) serta augmentasi geometris terhadap akurasi sistem pengenalan wajah. Metode yang digunakan melibatkan tiga kategori dataset: dataset asli tanpa augmentasi (kategori 1), dataset dengan augmentasi aksesoris wajah (kategori 2), dan dataset dengan augmentasi geometris (kategori 3). Augmentasi data dilakukan pada dataset pelatihan untuk meningkatkan keberagaman, diikuti dengan proses deteksi wajah menggunakan SCRFD dan ekstraksi fitur dengan ArcFace. Model kemudian dilatih menggunakan Multi-Layer Perceptron (MLP). Hasil penelitian menunjukkan bahwa augmentasi aksesoris wajah (kategori 2) memberikan peningkatan signifikan pada akurasi model, mencapai 99%, sedangkan kategori 3 dengan augmentasi geometris mencapai akurasi 91%. Metrik evaluasi lainnya, seperti precision, recall, dan F1-score, juga menunjukkan peningkatan setelah augmentasi. Penelitian ini menyimpulkan bahwa augmentasi aksesoris wajah lebih efektif dalam meningkatkan akurasi dan ketahanan model pengenalan wajah dibandingkan dengan augmentasi geometris.
Kata kunci: augmentasi; deep learning; kacamata; pengenalan wajah.