International Conference on Computer and Knowledge Engineering

Home / 15th International Conference on Computer and Knowledge Engineering

Adaptive Sliding Window Optimization for Multi-Dimensional Data Streams Using Reinforcement Learning

Authors :

Abolfazl Zarghani¹

1- Ferdowsi university of mashhad

Keywords :

Reinforcement Learning،Sliding Window،Multi-Dimensional Data Streams،Concept Drift،Dueling DQN

Abstract :

Multi-dimensional data streams from IoT, financial markets, and real-time analytics require adaptive processing due to their high velocity and complex dependencies. Fixed-size sliding windows struggle with concept drift and bursty patterns. We propose RL-Window, a reinforcement learning (RL) approach using a Dueling Deep Q-Network (DQN) with prioritized experience replay and noisy networks to dynamically optimize window sizes based on stream characteristics like variance, correlations, and spectral features. Evaluated on UCI HAR, PAMAP2, and Yahoo! Finance datasets, RL-Window achieves superior classification accuracy (up to 92.1\%), drift robustness (-3.2\% drop), and energy efficiency (1.1 mJ) compared to baselines like ADWIN [1] and CNN-Adaptive [2]. Comprehensive dataset characterization and qualitative analyses highlight its adaptability for real-time, resource-constrained applications. We employ dual rolling buffers (200-point temporal, 512-point spectral with 50\% overlap) to build the state; stability is reported as the standard deviation of selected window sizes (samples); and energy/latency are measured on Raspberry Pi 4 via inline power metering and end-to-end timing.

Papers List

List of archived papers

Data-Optimized Dry Rock Property Prediction Using Ensemble and Kernel-Based ML Methods

Esmael Makarian - Hassanreza Ghasemitabar - Alireza Behinrad - Mahdi Fathi - Andisheh Alimoradi - Ayub Elyasi

Cluster Sampling: A Cluster-Driven Sampling Strategy for Deep Metric Learning

Hamideh Rafiee - Ahmad Ali Abin - Seyed Soroush Majd

Age Estimation Based on Facial Images Using Hybrid Features and Particle Swarm Optimization

NILOUFAR MEHRABI - SAYED PEDRAM HAERI BOROUJENI

Lightweight Local Transformer for COVID-19 Detection Using Chest CT Scans

Hojat Asgarian Dehkordi - Hossein Kashiani - Amir Abbas Hamidi Imani - Shahriar Baradaran Shokouhi

Binary Classification of Capuchin Bird Calls via Spectrogram-Enhanced Frequency-Aware Convolutional Neural Networks

Samad Najjar-Ghabel - Shamim Yousefi - Reza Danandeh Bileh Savar

Multi-Digit Handwritten Recognition: A CNN-LSTM Hybrid Approach with Wavelet Transforms

Amin Kazempour - Jafar Tanha

Virus-Antiviral Prediction Using Machine and Deep Learning Methods

Shayan Majidifar - Fatemeh Nasiri - Mohsen Hooshmand

LightFedSelect: A Lightweight Framework for Byzantine-Robust Federated Learning

Seyed Saeed Razavi - Seyed Arsalan Vasegh Rahim Parvar - Soroosh Dadashi Pakdeh - Mohammad Matin Rezaeifard - Morteza Mollaie Chafi - Reza Ebrahimi Atani

Multimodal Deep Learning Framework for PTSD Detection during Sleep via EEG and Biosignal Fusion

Danial Eskandari Faruji - Amir Akhavan Saffar - Mobina Ansari Astaneh

A Deep CNN Model Based Ensemble Approach for Semantic and Instance Segmentation of Indoor Environment

Sajad Rezaei - Jafar Tanha - Zahra Jafari - SeyedEhsan Roshan - Mohammad-Amin Memar Kochebagh