Please wait ...
0% Complete
Home
/
15th International Conference on Computer and Knowledge Engineering
Adaptive Sliding Window Optimization for Multi-Dimensional Data Streams Using Reinforcement Learning
Authors :
Abolfazl Zarghani
1
1- Ferdowsi university of mashhad
Keywords :
Reinforcement Learning،Sliding Window،Multi-Dimensional Data Streams،Concept Drift،Dueling DQN
Abstract :
Multi-dimensional data streams from IoT, financial markets, and real-time analytics require adaptive processing due to their high velocity and complex dependencies. Fixed-size sliding windows struggle with concept drift and bursty patterns. We propose RL-Window, a reinforcement learning (RL) approach using a Dueling Deep Q-Network (DQN) with prioritized experience replay and noisy networks to dynamically optimize window sizes based on stream characteristics like variance, correlations, and spectral features. Evaluated on UCI HAR, PAMAP2, and Yahoo! Finance datasets, RL-Window achieves superior classification accuracy (up to 92.1\%), drift robustness (-3.2\% drop), and energy efficiency (1.1 mJ) compared to baselines like ADWIN [1] and CNN-Adaptive [2]. Comprehensive dataset characterization and qualitative analyses highlight its adaptability for real-time, resource-constrained applications. We employ dual rolling buffers (200-point temporal, 512-point spectral with 50\% overlap) to build the state; stability is reported as the standard deviation of selected window sizes (samples); and energy/latency are measured on Raspberry Pi 4 via inline power metering and end-to-end timing.
Papers List
List of archived papers
Delay Optimization of a Federated Learning-based UAV-aided IoT network
Hossein Mohammadi Firouzjaei - Javad Zeraatkar Moghaddam - Mehrdad Ardebilipour
Virus-Antiviral Prediction Using Machine and Deep Learning Methods
Shayan Majidifar - Fatemeh Nasiri - Mohsen Hooshmand
Systematic review on AI techniques in detection and navigation of agricultural machines and robots
Afsaneh Soleimani - Mohammad Boghrati - Hossein Damavandi
Optimizing MR Image Registration for Accurate Brain Volume Measurement in Children with Autism Spectrum Disorder
Shiva Sanati - Mahdi Saadatmand
An Overview of Regression Methods in Early Prediction of Movie Ratings
Houmaan Chamani - Zhivar Sourati Hassanzadeh - Behnam Bahrak
Leveraging the Power of Object Detection Models in Identifying Litter for a Significant Reduction in Environmental Pollution
Lim Zhen Xian - Ervin Gubin Moung - Jason Teo Tze Wi - Nordin Saad - Farashazillah Yahya - Tiong Lin Rui - Ali Farzamnia
Optimal PMU Placement Considering Reliability of Measurement System in Smart Grids
Mohammad Shahraeini - Shahla Khormali - Ahad Alvandi
Human vs NotebookLM for Educational Podcasts: A Controlled Experiment on Two General Topics
Ali Banihashemi - Amirali Shahriary - Yadollah Yaghoobzadeh
Hybrid navigation based on GPS data and SIFT-based place recognition using Biologically-inspired SLAM
Sahar Salimpour Kasebi - Hadi Seyedarabi - Javad Musevi Niya
Driving Violation Detection Using Vehicle Data and Environmental Conditions
Masood Ghasemi - Mahmood Fathy - Mohammad Shahverdy
more
Samin Hamayesh - Version 46.0.2