A reinforcement learning approach for cost- and energy-aware mobile data offloading

Cheng Zhang, Bo Gu, Zhi Liu, Kyoko Yamori, Yoshiaki Tanaka

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    8 Citations (Scopus)

    Abstract

    With rapid increases in demand for mobile data, mobile network operators are trying to expand wireless network capacity by deploying WiFi hotspots to offload their mobile traffic. However, these network-centric methods usually do not fulfill interests of mobile users (MUs). MUs consider many problems to decide whether to offload their traffic to a complementary WiFi network. In this paper, we study the WiFi offloading problem from MU's perspective by considering delay-tolerance of traffic, monetary cost, energy consumption as well as the availability of MU's mobility pattern. We first formulate the WiFi offloading problem as a finite-horizon discrete-time Markov decision process (FDTMDP) with known MU's mobility pattern and propose a dynamic programming based offloading algorithm. Since MU's mobility pattern may not be known in advance, we then propose a reinforcement learning based offloading algorithm, which can work well with unknown MU's mobility pattern. Extensive simulations are conducted to validate our proposed offloading algorithms.

    Original languageEnglish
    Title of host publication18th Asia-Pacific Network Operations and Management Symposium, APNOMS 2016: Management of Softwarized Infrastructure - Proceedings
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9784885523045
    DOIs
    Publication statusPublished - 2016 Nov 7
    Event18th Asia-Pacific Network Operations and Management Symposium, APNOMS 2016 - Kanazawa, Japan
    Duration: 2016 Oct 52016 Oct 7

    Other

    Other18th Asia-Pacific Network Operations and Management Symposium, APNOMS 2016
    CountryJapan
    CityKanazawa
    Period16/10/516/10/7

      Fingerprint

    Keywords

    • energy-aware
    • mobile data offloading
    • reinforcement learning
    • WiFi

    ASJC Scopus subject areas

    • Information Systems and Management
    • Management Information Systems
    • Management of Technology and Innovation
    • Computer Networks and Communications
    • Hardware and Architecture

    Cite this

    Zhang, C., Gu, B., Liu, Z., Yamori, K., & Tanaka, Y. (2016). A reinforcement learning approach for cost- and energy-aware mobile data offloading. In 18th Asia-Pacific Network Operations and Management Symposium, APNOMS 2016: Management of Softwarized Infrastructure - Proceedings [7737203] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/APNOMS.2016.7737203