KLI

A Transfer Deep Q-Learning Framework for Resource Competition in Virtual Mobile Networks With Energy-Harvesting Base Stations,

Metadata Downloads
Alternative Title
A Transfer Deep Q-Learning Framework for Resource Competition in Virtual Mobile Networks With Energy-Harvesting Base Stations,
Abstract
This article considers the problem of resource sharing in a virtual mobile network with energy-harvesting base stations (BSs), where several virtual mobile operators (VMOs) lease radio resources (e.g., radio channels and green BSs) from a mobile network owner (MNO). The VMOs want to provide subscribed users with the best performance while ensuring minimal leasing costs. We aim to find the optimal resource leasing scheme for a VMO in order to maximize utility within the uncertainties of harvested energy, request arrivals, and resource prices. We first formulate the problem as a Markov decision process, during which the VMOs compete with each other for the radio resources by dynamically announcing their resource requirements to the MNO. We, then, employ a deep Q-learning algorithm so the VMO can find the optimal solution by interacting with the environment. With this algorithm, artificial neural networks are used to approximate the Q-value function, which can work effectively with large state and action spaces. We further employ the idea of transfer learning, which exploits the strategies learned in historical periods to speed up the learning process of the target task. Finally, we present comprehensive simulations to evaluate the performance of the proposed scheme under various configurations.
Author(s)
구인수도 빈 쾅
Issued Date
2021
Type
Article
Keyword
Approximation algorithmsBase stationsDeep Q-learning (DQL)energy harvestingHeuristic algorithmsMarkov processesNeural networksResource managementresource sharingWireless communicationwireless network virtualization (WNV)
DOI
10.1109/JSYST.2019.2958993
URI
https://oak.ulsan.ac.kr/handle/2021.oak/9052
https://ulsan-primo.hosted.exlibrisgroup.com/primo-explore/fulldisplay?docid=TN_cdi_crossref_primary_10_1109_JSYST_2019_2958993&context=PC&vid=ULSAN&lang=ko_KR&search_scope=default_scope&adaptor=primo_central_multiple_fe&tab=default_tab&query=any,contains,A%20Transfer%20Deep%20Q-Learning%20Framework%20for%20Resource%20Competition%20in%20Virtual%20Mobile%20Networks%20With%20Energy-Harvesting%20Base%20Stations,&offset=0&pcAvailability=true
Publisher
IEEE Systems Journal
Location
미국
Language
영어
ISSN
1932-8184
Citation Volume
15
Citation Number
1
Citation Start Page
319
Citation End Page
330
Appears in Collections:
Engineering > IT Convergence
Authorize & License
  • Authorize공개
Files in This Item:
  • There are no files associated with this item.

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.