Search Articles & Publications

Showing 33 articles found for "Deep Learning"

DIGITAL IMAGE QUALITY OPTIMIZATION USING DEEP NEURAL NETWORK

Arifanto, Bachtiar, Abdul Chamid , Ahmad, Nindyasari , Ratih
Abstract: Abstract: One of the main challenges in digital image processing is limited resolution, which makes it difficult to preserve visual details when images are enlarged. Conventional methods such as Bilinear Interpolation are… e commonly used for image upscaling; however, these approaches often produce blurred images, lose fine textures, and fail to reconstruct complex visual structures. This study aims to enhance digital image resolution by employing a deep learni based approach using a Low-Light Convolutional Neural Network (LLCNN) built upon a Deep Neural Network (DNN) architecture. The dataset used in this study is the DIV2K dataset, which consists of 1,000 high-resolution images. These images were downsampled using scaling factors of ×2, ×3, and ×4 to generate paired Low Resolution–High Resolution (LR–HR) data for training and evaluation. The proposed LLCNN is designed to extract important features such as edges, textures, and local patterns through multiple convolutional layers, followed by non-linear mapping to reconstruct high-resolution images more accurately. Quantitative performance evaluation was conducted using the Peak Signal-to-Noise Ratio (PSNR) and the Structural Similarity Index (SSIM). Model performance was evaluated quantitatively using the Peak Signal-to-Noise Ratio (PSNR) metric. Experimental results showed that the proposed method improved image quality compared to the bilinear method. These results indicate that the deep learning based approach effectively improves image sharpness and structural fidelity, thereby demonstrating its potential for digital image resolution enhancement.             Keywords: deep neural network; image resolution; low-light convolutional neural network; machine learning   Abstrak: Permasalahan utama dalam pengolahan citra digital adalah keterbatasan resolusi yang menyebabkan detail visual sulit dipertahankan ketika citra diperbesar. Metode konvensional seperti Bilinear Interpolation masih banyak digunakan, namun sering menghasilkan citra buram, kehilangan tekstur halus, serta tidak mampu merekonstruksi struktur visual yang kompleks. Penelitian ini bertujuan untuk meningkatkan kualitas resolusi citra digital dengan memanfaatkan pendekatan deep learning berbasis Low-Light Convolutional Neural Network (LLCNN) yang dibangun di atas arsitektur Deep Neural Network (DNN). Data yang digunakan dalam penelitian ini berasal dari dataset DIV2K, yang terdiri dari 1000 citra beresolusi tinggi. Citra tersebut diturunkan menjadi resolusi rendah menggunakan faktor downsampling ×2, ×3, dan ×4 untuk membentuk pasangan data Low Resolution–High Resolution (LR–HR) sebagai data pelatihan dan pengujian. LLCNN dirancang untuk mengekstraksi fitur-fitur penting seperti tepi, tekstur, dan pola lokal melalui beberapa lapisan konvolusi, kemudian melakukan pemetaan non-linear guna merekonstruksi citra resolusi tinggi secara lebih presisi. Evaluasi performa model dilakukan secara kuantitatif menggunakan metrik Peak Signal-to-Noise Ratio (PSNR). Hasil eksperimen menunjukkan bahwa metode yang diusulkan mampu meningkatkan kualitas citra dibandingkan metode bilinear. Hasil ini membuktikan bahwa pendekatan berbasis deep learning efektif dalam meningkatkan ketajaman dan kesesuaian struktur citra digital.   Kata kunci: deep neural network; low-light convolutional neural network; machine learning; resolusi citra

A COMPARATIVE ANALYSIS OF OPTIMIZED NEURAL NETWORK AND LARGE-SCALE LANGUAGE MODELS FOR MUSIC GENRE CLASSIFICATION

Marzuqi, Ahmad Naufal Luthfan, Nastiti , Vinna Rahmayanti Setyaning
Abstract: Abstract: The rapid growth of the digital music industry requires accurate music genre classification systems to enhance user experience in streaming services. This study compares a domain-specific Long Short-Term Memory… (LSTM) network with three Large Language Models (LLMs)—HuBERT, WavLM, and WAV2Vec 2.0—for Music Genre Classification (MGC). The LSTM model was trained using Mel-spectrograms transformed from the GTZAN dataset, while the LLMs were fine-tuned using a smaller set of raw audio samples due to computational constraints. All models were tested on datasets with identical genre labels to ensure a fair evaluation. Results show that the LSTM model achieved the highest accuracy of 97.10%, outperforming HuBERT (86.00%), WavLM (83.00%), and WAV2Vec 2.0 (80.00%). The LSTM demonstrated superior generalization and stability without overfitting, while the LLMs struggled to differentiate between genres with similar acoustic characteristics. These findings indicate that general-purpose pre-trained models, although powerful, are less effective in music-specific tasks due to domain mismatch. Therefore, incorporating music-specific features and architectures remains essential for achieving higher accuracy and reliability in automatic genre classification systems. Keywords: audio large language models; comparative deep learning; music genre classification.   Abstrak: Pertumbuhan industri musik digital yang pesat menuntut sistem klasifikasi genre musik yang akurat untuk meningkatkan pengalaman pengguna dalam layanan streaming. Penelitian ini dilatarbelakangi oleh perkembangan pesat model pembelajaran mendalam, khususnya jaringan LSTM dan model bahasa berskala besar LLM seperti HuBERT, WavLM, dan WAV2Vec 2.0, yang telah menunjukkan kemampuan representasi audio yang kuat. Tujuan penelitian ini ini membandingkan jaringan Long Short-Term Memory (LSTM) khusus domain dengan tiga model Large Language Models (LLM)—HuBERT, WavLM, dan WAV2Vec 2.0—untuk tugas Klasifikasi Genre Musik (MGC). Metode penelitian melibatkan pelatihan LSTM menggunakan data Mel-spectrogram hasil transformasi dari dataset GTZAN, sementara LLM disesuaikan (fine-tuning) menggunakan data audio mentah dalam jumlah lebih kecil karena keterbatasan komputasi. Seluruh model diuji pada dataset dengan label genre yang sama untuk memastikan evaluasi yang adil. Hasil penelitian menunjukkan bahwa model LSTM mencapai akurasi tertinggi sebesar 97,10%, sedangkan model HuBERT, WavLM, dan WAV2Vec 2.0 masing-masing memperoleh 86,00%, 83,00%, dan 80,00%. Model LSTM menunjukkan kemampuan generalisasi yang lebih baik tanpa overfitting, sedangkan model LLM cenderung kesulitan membedakan genre dengan karakteristik akustik yang mirip. Kesimpulan penelitian ini adalah ketidaksesuaian domain secara signifikan membatasi performa model umum saat diterapkan pada tugas berbasis musik. Oleh karena itu, penggunaan fitur dan arsitektur khusus musik sangat penting dalam membangun sistem klasifikasi genre yang lebih akurat. Kata kunci: klasifikasi genre musik; model bahasa besar; perbandingan pembelajaran mendalam.

DEVELOPMENT RICE PLANT DISEASE CLASSIFICATION USING CNN WITH TRANSFER LEARNING

Fitrony, Fachri Ayudi, Utami, Ema
Abstract: Abstract: The rice plant, Oryza sativa, is a major food source in Indonesia. This plant is processed into rice, a staple food for the Indonesian people. Rice growth is crucial to ensure the rice produced is of good quality.… ty. One part of the rice plant that is susceptible to disease is the leaves, which can inhibit growth and reduce rice quality. Therefore, early detection and accurate classification of rice diseases are crucial to minimize these negative impacts. This has driven the development of a Deep Learning model capable of high-performance automatic classification. This study aims to create a rice leaf classification model using the CNN algorithm and several transfer learning architectures such as ResNet101, VGG16, and Xception. A dataset of 859 rice leaf images collected from the Kaggle website was then processed using augmentation techniques to a total of 2,439 images, plus 215 smartphone photos for external data validation. Thus, the total dataset increased to 2,656 images, covering four categories: leafblast, brownspot, healthy, and hispa. The model was processed in two stages: on the initial dataset (Non-Augmented Dataset) and the Augmented Dataset. The best experimental results were obtained using the ResNet architecture, with a training accuracy of 96.17% and a validation accuracy of 95.22%. Based on the research results, the rice plant disease classification model using deep learning demonstrated good performance.             Keywords: convolutional neural network; deep learning; fine-tuning; image classification; resnet; rice plant

TRAFFIC FLOW DETECTION USING YOLOV4 AND DEEPSORT ON NVIDIA JETSON NANO

Taufiq, Reny Medikawati, Syahril, Syahril, Rafdi, Faris Abi, Firdaus, Rahmad, Sunanto, Sunanto, Muarif, Putri Fadhilla
Abstract: Abstract: This study aims to develop a Deep Learning-based Traffic Flow Detector to automatically and accurately observe traffic flow. Conventional traffic observation is often conducted manually or via CCTV, but it is prone… rone to human error and difficult to use for real-time trend analysis. In this study, the YOLOv4 method is used to detect four types of vehicles (cars, motorcycles, buses, trucks). To continuously track vehicle movement and address occlusion issues, the Deep SORT algorithm is implemented. The YOLOv4 model used is a pre-trained model and was tested on seven CCTV video recordings obtained from the official website of the Pekanbaru City Transportation Department. The system was implemented on a limited device, the Nvidia Jetson Nano, as a simulation of direct CCTV integration. Test results showed a highest precision of 98%, but the maximum accuracy achieved was only 26%. This low accuracy is influenced by several factors, including video resolution, detection model quality, and lighting conditions. Nevertheless, the system demonstrates potential to support future traffic management and engineering decisions but still requires further optimization, including improving video resolution and quality, retraining the model with a more representative local dataset, using lighter and more accurate detection models, and optimizing the tracking algorithm. Keywords: deep learning; deepsort; NVIDIA Jetson NANO; traffic flow; YOLOv4     Abstrak: Penelitian ini bertujuan mengembangkan Traffic Flow Detector berbasis Deep Learning untuk mengobservasi arus lalu lintas secara otomatis dan akurat. Observasi lalu lintas konvensional sering dilakukan secara manual atau melalui CCTV, namun rentan terhadap human error dan sulit digunakan untuk menganalisis tren secara real-time. Pada penelitian ini digunakan metode YOLOv4 untuk mendeteksi empat jenis kendaraan (mobil, motor, bus, truk). Untuk melacak pergerakan kendaraan secara berkelanjutan dan mengatasi masalah occlusion, digunakan algoritma Deep SORT. Model YOLOv4 yang digunakan merupakan pre-trained model dan diujikan pada tujuh rekaman video CCTV yang diambil dari situs resmi Dinas Perhubungan Kota Pekanbaru. Sistem ini diimplementasikan pada perangkat terbatas Nvidia Jetson Nano sebagai simulasi penerapan langsung pada CCTV. Hasil pengujian menunjukkan presisi tertinggi mencapai 98%, namun akurasi tertingginya hanya sebesar 26%. Rendahnya akurasi dipengaruhi oleh beberapa faktor seperti resolusi video, kualitas model deteksi, serta kondisi pencahayaan. Meski demikian, sistem ini menunjukkan potensi untuk membantu pengambilan keputusan dalam manajemen dan rekayasa lalu lintas di masa depan, namun masih membutuhkan optimasi lebih lanjut, seperti  peningkatan kualitas video input, pelatihan ulang model dengan dataset lokal, penggunaan model deteksi yang lebih ringan dan akurat serta pengoptimalan algoritma pelacakan.   Kata kunci: deep learning deepsort; Nvidia Jetson Nano; traffic flow; YOLOv4

THE EFFECT OF FACIAL ACCESSORY AUGMENTATION ON THE ACCURACY OF DEEP LEARNING-BASED FACIAL RECOGNITION SYSTEMS

Hidayat, Ahmad Nur, Suciati, Nanik, Saikhu, Ahmad
Abstract: Abstract: Face recognition based on deep learning has become an important technology in many areas. However, these systems often face challenges in real-world conditions, such as when the face is partially covered by accessories… essories such as masks or glasses. This study aims to evaluate the effect of data augmentation by adding facial accessories (masks, glasses, and a combination of both) and geometric augmentation on the accuracy of face recognition systems. There are three types of datasets used in this method: the original dataset (category 1), the dataset with facial accessories augmentation (category 2), and the dataset with geometric augmentation (category 3). Data augmentation was performed on the training dataset to increase diversity, followed by the face detection process using SCRFD and feature extraction with ArcFace. The model was then trained using Multi-Layer Perceptron (MLP). Based on the results, adding face accessories (category 2) made the model a lot more accurate, hitting 99% accuracy. In category 3, adding geometric features improved accuracy to 91%. Other evaluation metrics, such as precision, recall, and F1-score, also showed improvement after augmentation. This study concludes that facial accessories augmentation is more effective in improving the accuracy and robustness of face recognition models compared to geometric augmentation. Keywords: augmentation; deep learning; face recognition; glasses.   Abstrak: Pengenalan wajah berbasis deep learning telah menjadi salah satu teknologi penting dalam berbagai aplikasi. Namun, sistem ini sering kali menghadapi tantangan dalam kondisi dunia nyata, seperti saat wajah tertutup sebagian oleh aksesori seperti masker atau kacamata. Penelitian ini bertujuan untuk mengevaluasi pengaruh augmentasi data dengan menambahkan aksesori wajah (masker, kacamata, dan kombinasi keduanya) serta augmentasi geometris terhadap akurasi sistem pengenalan wajah. Metode yang digunakan melibatkan tiga kategori dataset: dataset asli tanpa augmentasi (kategori 1), dataset dengan augmentasi aksesoris wajah (kategori 2), dan dataset dengan augmentasi geometris (kategori 3). Augmentasi data dilakukan pada dataset pelatihan untuk meningkatkan keberagaman, diikuti dengan proses deteksi wajah menggunakan SCRFD dan ekstraksi fitur dengan ArcFace. Model kemudian dilatih menggunakan Multi-Layer Perceptron (MLP). Hasil penelitian menunjukkan bahwa augmentasi aksesoris wajah (kategori 2) memberikan peningkatan signifikan pada akurasi model, mencapai 99%, sedangkan kategori 3 dengan augmentasi geometris mencapai akurasi 91%. Metrik evaluasi lainnya, seperti precision, recall, dan F1-score, juga menunjukkan peningkatan setelah augmentasi. Penelitian ini menyimpulkan bahwa augmentasi aksesoris wajah lebih efektif dalam meningkatkan akurasi dan ketahanan model pengenalan wajah dibandingkan dengan augmentasi geometris. Kata kunci: augmentasi; deep learning; kacamata; pengenalan wajah.

AI-BASED ALGORITHMS FOR NETWORK SECURITY: TRENDS, PER-FORMANCE, AND CHALLENGES

Marison, Sihol, Silvanus, Silvanus, Rusdiah, Rudi
Abstract: Abstract: The advancement of network security faces growing challenges as cyberattacks become more sophisticated. Traditional rule-based systems struggle with zero-day attacks and obfuscation techniques. This study examines… nes the development trends of AI-based algo-rithms, particularly machine learning and deep learning, in threat detection. A literature review evaluates AI-driven approaches, including support vector machines, random for-est, deep neural networks, convolutional neural networks, and reinforcement learning. Findings show that AI enhances detection accuracy, adaptability, and reduces false posi-tives. Machine learning efficiently classifies known attacks, while deep learning excels in identifying complex patterns such as distributed denial-of-service and advanced persis-tent threats. Unsupervised learning improves anomaly detection without labeled data. However, AI models require high-quality data, substantial computational resources, and remain vulnerable to adversarial attacks. Despite these challenges, AI provides a dynam-ic and adaptive security solution, surpassing traditional systems. Future research should enhance AI scalability and resilience for evolving cybersecurity threats.   Keywords: anomaly detection; artificial intelligence; deep learning; machine learning; network security   Abstrak: Perkembangan keamanan jaringan menghadapi tantangan yang semakin besar seiring meningkatnya kompleksitas serangan siber. Sistem berbasis aturan tradisional kesulitan mendeteksi zero-day attack dan teknik penyamaran. Penelitian ini mengkaji tren pengembangan algoritma berbasis AI, khususnya machine learning dan deep learning, dalam deteksi ancaman. Literature review mengevaluasi pendekatan berbasis AI, termasuk support vector machines, random forest, deep neural networks, convolutional neural networks, dan reinforcement learning. Hasil penelitian menunjukkan bahwa AI meningkatkan akurasi deteksi, adaptabilitas terhadap ancaman baru, serta mengurangi false positive. Machine learning efektif mengklasifikasikan serangan yang telah diketahui, sementara deep learning unggul dalam mengenali pola kompleks seperti distributed denial-of-service dan advanced persistent threats. Unsupervised learning meningkatkan deteksi anomali tanpa memerlukan data berlabel. Namun, AI masih bergantung pada data berkualitas tinggi, sumber daya komputasi besar, dan rentan terhadap adversarial attack. Meskipun demikian, AI menawarkan solusi keamanan yang lebih dinamis dan adaptif dibandingkan sistem tradisional. Penelitian selanjutnya perlu difokuskan pada peningkatan skalabilitas dan ketahanan AI dalam menghadapi ancaman siber yang terus berkembang.   Kata kunci: deteksi anomali; jaringan keamanan; kecerdasan buatan; pembelajaran dalam; pembelajaran mesin

DEEP LEARNING FOR CALCULATING BRAIN TUMOR VOLUME IN 3D MRI IMAGES USING HYBRID ACTIVE CONTOUR SEGMENTATION METHOD

Yuma, Febby Madonna, Ramadhani, Andrew
Abstract: Abstract: Brain cancer is a serious medical condition that requires intensive and meticulous care. One of the critical steps in identifying brain cancer is the accurate measurement of tumor volume. Magnetic Resonance Imaging… ging (MRI) is one of the most important diagnostic tools used in the medical field for brain visualization. In this discussion, we will explain how the Active Contour method can be used to calculate brain tumor volume in MRI images and how 3D visualization can assist doctors in making better diagnoses and treatment decisions. The Active Contour method, also known as the “Snake,” is an image processing technique used to identify the contours or edges of objects in images. This method works by defining an initial curve around the desired object and then iteratively shifting the curve to match the actual contour of the object in the image. In this study, the Active Contour method will be applied to brain MRI images to identify tumor edges. This research represents an important step in improving the care of brain cancer patients, enabling more accurate diagnoses and more effective treatments Keywords: active contour; brain cancer diagnosis; 3D visualization; tumor volume    Abstrak: Kanker otak merupakan kondisi medis yang bersifat serius dimana memerlukan perawatan yang intensif dan teliti. Salah satu langkah penting dalam mengidentifikasi kanker otak adalah dengan mengukur volume tumor secara akurat. Citra Magnetic Resonance Imaging (MRI) adalah salah satu alat diagnostik yang paling penting dalam bidang medis yang digunakan untuk visualisasi otak. Dalam pembahasan ini, akan dijelaskan bagaimana metode Active Contour dapat digunakan untuk menghitung volume tumor otak pada citra MRI dan bagaimana visualisasi 3D dapat membantu dokter dalam diagnosis dan perawatan yang lebih baik. Metode Active Contour, juga dikenal sebagai “Snake,” yaitu teknik pengolahan citra yang digunakan untuk mengidentifikasi kontur atau tepi objek dalam citra. Metode ini bekerja dengan mendefinisikan suatu kurva awal di sekitar objek yang diinginkan dan kemudian menggeser kurva tersebut secara iteratif untuk menyesuaikan dengan kontur objek yang sesungguhnya dalam citra. Dalam penelitian ini, metode Active Contour akan diterapkan pada citra MRI otak untuk mengidentifikasi tepi tumor. Penelitian ini merupakan langkah penting dalam meningkatkan perawatan pasien yang terkena kanker otak dan memungkinkan diagnosis yang lebih tepat dan perawatan yang lebih efektif. Kata kunci: active contour; diagnosis tumor otak; visualisasi 3D; volume tumor

COMPARISON OF SGD, ADADELTA, ADAM OPTIMIZATION IN GENDER CLASSIFICATION USING CNN

Mandasari, Sartika, Irfan, Desi, Wanayumini, Wanayumini, Rosnelly, Rika
Abstract: Abstract: Gender classification is one of the most important tasks of video analysis. A machine learning-based approach was presented to identify male and female facial images with a data set of 2000 images taken from kaggles. … ggles.  This method plays a role in finding the weight value that gives the best output value. This study uses the most appropriate learning rate of each optimization method as a criterion for stopping training. The results showed that the Artificial Neural Network with Adam optimization produced the highest accuracy, which was 91.5% compared to the SGD and ADADELTA optimization methods. Deep Learning techniques that are applied extensively to image recognition used utilize Adam's optimizer method.      Keywords: artificial neural networks; adadelta; adam; gender; sgm;     Abstrak: Klasifikasi gender adalah salah satu tugas analisis video yang paling penting. Pendekatan berbasis machine learning disajikan untuk mengidentifikasi gambar wajah Pria dan Wanita dengan kumpulan data sebanyak 2000 gambar yang diambil dari kaggle.  Metode ini berperan dalam menemukan nilai bobot yang memberikan nilai keluaran terbaik. Penelitian ini menggunakan learning rate yang paling sesuai dari masing-masing metode optimasi sebagai kriteria pemberhentian pelatihan. Hasil penelitian menunjukkan Jaringan Saraf Tiruan dengan optimasi Adam menghasilkan akurasi tertinggi yaitu 91,5 %  dibandingkan dengan dengan metode optimasi SGD dan ADADELTA. Teknik Deep Learning yang diterapkan secara ekstensif pada pengenalan gambar yang digunakan memanfaatkan metode optimizer Adam.   Kata kunci: Adadelta; Adam; Jaringan Syaraf; Gender; Tiruan; SGM;  

DEEP LEARNING FOR FACES ON ORPHANAGE CHILDREN FACE DETECTION

Pernando, Yonky, Febrianti, Eka Lia, Syafrinal, Ilwan, Roza, Yuni, Afifah, Ummul Fitri
Abstract: Abstract: l -The field of computer vision is research in development technology to obtain information from images and replicate or imitate human visual processes, so that they can understand the objects around them. Deep… learning is a term used to describe a new era in learning that supports computer learning from big data machines. Convolutional Neural Networks (CNN) algorithms have made significant progress in the fields of object detection, image classification, and semantic segmentation. ;Object detection is a technique used to identify the type of object in a given image and the location of the object in the image. The field of computer vision is research in development technology to obtain information from images and replicate or imitate human visual processes, so that computers can know objects around them. Deep learning is the buzzword as a new era in machine learning that trains computers to find patterns from large amounts of data. Convolutional Neural Networks (CNN) algorithms have made significant progress in the fields of object detection, image classification, and semantic segmentation. Object detection is a technique used to identify the type of object in a particular image as well as the location of the object in the image.   Keywords: CNN, Computer Vision, Deep Learning, Face Detection;     Abstrak: 1 Bidang computer vision merupakan penelitian dalam teknologi pembangunan untuk memperoleh informasi dari citra dan mereplikasi atau meniru proses visual manusia, sehingga dapat memahami objek - objek disekelilingnya. Pembelajaran mendalam adalah istilah yang digunakan untuk menggambarkan era baru dalam pembelajaran mesin yang memungkinkan komputer belajar dari sejumlah besar data. [Algoritma Convolutional Neural Networks (CNN) telah membuat kemajuan yang signifikan di bidang deteksi objek, klasifikasi gambar, dan segmentasi semantik. Deteksi objek adalah teknik yang digunakan untuk mengidentifikasi jenis objek dalam citra yang diberikan serta lokasi objek di dalam citra. Bidang computer vision merupakan penelitian dalam teknologi pembangunan untuk memperoleh informasi dari citra dan mereplikasi atau meniru proses visual manusia, sehingga komputer dapat mengetahui objek - objek disekelilingnya. Deep learning adalah kata kunci sebagai era baru dalam machine learning yang melatih komputer dalam menemukan pola dari jumlah besar data. Algoritma Convolutional Neural Networks (CNN) telah membuat kemajuan yang signifikan di bidang deteksi objek, klasifikasi gambar, dan segmentasi semantik. /Deteksi objek adalah teknik yang digunakan untuk mengidentifikasi jenis objek dalam citra tertentu serta lokasi objek di dalam citra.   Kata kunci: CNN, Computer Vision, Deep Learning, Deteksi Wajah

INTEGRATED SMART TRAFFIC CONTROL SYSTEM MENUJU PEKANBARU SEBAGAI SMART CITY

Taufiq, Reny Medikawati, Sunanto, Sunanto, Rizki, Yoze
Abstract: Abstract: Pekanbaru still using conventional traffic light control system. Pekanbaru as the capital of Riau Province is predicted  udergo the  increased of urban population by 54.5% in 2025. It is important for Pekanbaru… ru to immediately implement smart and efficient traffic management system, so that traffic congestion can be resolved quickly. This research paper provides a design solution for smart traffic light management (Smart Traffic Control System), based on object detection technology that uses deep learning to detect the number and type of vehicles. The number of vehicle is the basis for determining the green light timer automatically. The Smart Traffic Control System (STCS) is integrated with a web based geographic information system (smart map) that can display the current condition  (picture, the number of vehicle, congestion level) of each STCS location. This integrated system has been tested on a traffic light prototype, using a mini computer and a miniature vehicle. This integrated system is able to detect 9 out of 12 vehicles, and able to send data regularly to the smart map.   Keywords: deep learning; smart mobility; smart traffic control system   Abstrak: Pengaturan lampu lalu lintas di Kota Pekanbaru masih dilakukan secara  konvensional. Pekanbaru sebagai ibukota Provinsi Riau diprediksikan akan mengalami peningkatan jumlah penduduk  perkotaan sebesar 54,5% pada tahun 2025. Dengan melihat predikisi ini, penting bagi kota Pekanbaru untuk segera memiliki tata kelola lalu lintas yang cerdas dan efisien agar kemacetan dapat ditanggulangi dengan cepat. Penelitian ini memberikan rancangan solusi untuk tata kelola  lampu lalu lintas cerdas (Smart Traffic Control System), berbasis teknologi object detection  yang menggunakan deep learning untuk mendeteksi jumlah dan jenis kendaraan. Jumlah kendaraan menjadi dasar penentuan timer lampu hijau secara otomatis. Smart Traffic Control System (STCS) terintegrasi dengan sistem informasi geografis berbasis web (smart map) yang secara kontinu menerima informasi kepadatan (gambar terkini, jumlah kendaraan, level kepadatan), kemudian menampilkannya diatas peta Kota Pekanbaru. Solusi sistem terintegrasi ini telah diujikan pada sebuah prototipe lampu lalu lintas, menggunakan komputer mini  dan  miniatur kendaraan. Sistem terintegrasi ini mampu mendeteksi 9 dari 12 kendaraan, dan mampu mengirimkan data secara berkala kepada smart map.   Kata kunci: deep learning; smart mobility; smart traffic control system