Double Deep Q- energy aware Service allocation based on Dynamic fractional frequency reusable technique for lifetime maximization in HetNet-LTE network
DOI:
https://doi.org/10.22399/ijcesen.543Keywords:
Heterogeneous Networks, Long-Term Evolution, Mobile Communication, Double Deep Q-Network, Throughput OptimizationAbstract
The development of mobile communication in heterogeneous networks is incredible in providing various services through wireless cellular communication through advanced long-term evaluation networks. Increasing multi-concern services and frequencies in spectrum channels are highly layered to select the bandwidth to provide the fastest network without interference. Selecting the channel through macro cell selection is essential to improve network communication and provide the quickest service. Most frequency reuse techniques use service optimality and route selection-based protocols to enrich the packet flow. Still, the improper spectrum delights create more delay tolerance due to short-range service optimality due to energy loss by selecting the short spectrum signal to reuse, which doesn't support the lifetime improvement of the LTE network. To resolve these problems, we propose a Double Deep Q- energy-aware Service allocation based on a Dynamic fractional frequency reusable technique for lifetime maximization in the HetNet-LTE network. Initially, the heterogenous communication environment and node deplanement were carried out to construct the LTE network under the WCC. The communication logs are Route Table (RT), and its services are taken by all node LTE Communication Impact Rate (LTE-CIR). Then, the Backhaul Traffic Algorithm (BTA) is applied to predict the interference on traffic rate from the channel frequency margin. Select the balanced node using the Channel Interference Macro Cell Selection (CIMCS) technique. Considering frequency limits with the Double Deep Q- Network (DDQN) approach, energy-aware selects the optimal route to reuse the frequency level using Frequency Domain Packet Scheduling (FDPS) to improve communication. The proposed system improves the overall throughput by up to 97.8 % with adopted channel selection from the macro unit to improve the latency performance. Also, the interference frequency limits are dynamically reused at an energy optimal level with low-level delay tolerance to improve the link stability by up to 98.4 % with higher lifetime maximation in the LTE network.
References
Ahmed, F.Y.H.; Masli, A.A.; Khassawneh, B.; Yousif, J.H.; Zebari, D.A. (2023). Optimized Downlink Scheduling over LTE Network Based on Artificial Neural Network. Computers 2023, 12; 179. https://doi.org/10.3390/computers12090179 DOI: https://doi.org/10.3390/computers12090179
Stojčić, M.; Banjanin, M.K.; Vasiljević, M.; Nedić, D.; Stjepanović, A.; Danilović, D.; Puzić, G. (2023). Predictive Modeling of Delay in an LTE Network by Optimizing the Number of Predictors Using Dimensionality Reduction Techniques. Appl. Sci., 13;8511. https://doi.org/10.3390/app13148511 DOI: https://doi.org/10.3390/app13148511
Mao, Jingxuan, (2024). Machine Learning Based Energy Efficient Bandwidth Optimization, Electrical Engineering, Electronic Engineering, Information Engineering, p. 52.
Yang, H., Zhao, J., Lam, K., Xiong, Z., Wu, Q. & Xiao, L. (2022). Distributed deep reinforcement learning‑based spectrum and power allocation for heterogeneous networks. IEEE Transactions on Wireless Communications, 21(9);6935‑6948. https://dx.doi.org/10.1109/TWC.2022.3153175.
Yang, Y., Li, F., Zhang, X., Liu, Z., & Chan, K. Y. (2022). Dynamic power allocation in cellular network based on multi-agent double deep reinforcement learning. Computer Networks, 217, 109342. https://doi.org/10.1016/j.comnet.2022.109342 DOI: https://doi.org/10.1016/j.comnet.2022.109342
Chol Jong, Jae-Hyon Kim, Chang-Sop Pak, Chol-Man Nam, (2022). A Study on the Resource Block Allocation Method to Enhance the Total Energy Efficiency for LTE-A Networks," Wireless Personal Communications 123(11), DOI:10.1007/s11277-021-09260-y. DOI: https://doi.org/10.1007/s11277-021-09260-y
Z. Ali, S. Khaf, Z. H. Abbas, G. Abbas, F. Muhammad, and S. Kim, (2020). A Deep Learning Approach for Mobility-Aware and Energy-Efficient Resource Allocation in MEC, IEEE Access, 8;179530-179546, doi: 10.1109/ACCESS.2020.3028240. DOI: https://doi.org/10.1109/ACCESS.2020.3028240
R. Ruby, H. Yang, F. A. P. de Figueiredo, T. Huynh-The and K. Wu, (2023). Energy-Efficient Multiprocessor-Based Computation and Communication Resource Allocation in Two-Tier Federated Learning Networks, IEEE Internet of Things Journal, 10(7);5689-5703, doi: 10.1109/JIOT.2022.3153996. DOI: https://doi.org/10.1109/JIOT.2022.3153996
N. Sharma and K. Kumar, (2023). Energy Efficient Clustering and Resource Allocation Strategy for Ultra-Dense Networks: A Machine Learning Framework," IEEE Transactions on Network and Service Management, 20(2);1884-1897, doi: 10.1109/TNSM.2022.3218819. DOI: https://doi.org/10.1109/TNSM.2022.3218819
M. Merluzzi, P. D. Lorenzo and S. Barbarossa, (2021). Wireless Edge Machine Learning: Resource Allocation and Trade-Offs, IEEE Access, 9;45377-45398, doi: 10.1109/ACCESS.2021.3066559. DOI: https://doi.org/10.1109/ACCESS.2021.3066559
H. Dai, Y. Huang, Y. Xu, C. Li, B. Wang and L. Yang, (2019). Energy-Efficient Resource Allocation for Energy Harvesting-Based Device-to-Device Communication, IEEE Transactions on Vehicular Technology, 68(1);509-524, doi: 10.1109/TVT.2018.2881545. DOI: https://doi.org/10.1109/TVT.2018.2881545
X. Hou, J. Wang, C. Jiang, Z. Meng, J. Chen and Y. Ren, (2024). Efficient Federated Learning for Metaverse via Dynamic User Selection, Gradient Quantization, and Resource Allocation, IEEE Journal on Selected Areas in Communications, 42(4);850-866, doi: 10.1109/JSAC.2023.3345393. DOI: https://doi.org/10.1109/JSAC.2023.3345393
A. Mughees, M. Tahir, M. A. Sheikh, and A. Ahad, (2021). Energy-Efficient Ultra-Dense 5G Networks: Recent Advances, Taxonomy and Future Research Directions. IEEE Access, 9;147692-147716, doi: 10.1109/ACCESS.2021.3123577. DOI: https://doi.org/10.1109/ACCESS.2021.3123577
C. He, Y. Zhou, G. Qian, X. Li and D. Feng, (2019). Energy Efficient Power Allocation Based on Machine Learning Generated Clusters for Distributed Antenna Systems, IEEE Access, 7;59575-59584, doi: 10.1109/ACCESS.2019.2914159. DOI: https://doi.org/10.1109/ACCESS.2019.2914159
A. B. M. Adam, Z. Wang, X. Wan, Y. Xu and B. Duo, (2022). Energy-Efficient Power Allocation in Downlink Multi-Cell Multi-Carrier NOMA: Special Deep Neural Network Framework, IEEE Transactions on Cognitive Communications and Networking, 8(4);1770-1783, doi: 10.1109/TCCN.2022.3198652. DOI: https://doi.org/10.1109/TCCN.2022.3198652
Q. Zeng, Y. Du, K. Huang, and K. K. Leung, (2021). Energy-Efficient Resource Management for Federated Edge Learning With CPU-GPU Heterogeneous Computing," IEEE Transactions on Wireless Communications, 20(12);7947-7962, doi: 10.1109/TWC.2021.3088910. DOI: https://doi.org/10.1109/TWC.2021.3088910
M. Poposka, B. Jovanovski, V. Rakovic, D. Denkovski and Z. Hadzi-Velkov, (2023). Resource Allocation of NOMA Communication Systems for Federated Learning, IEEE Communications Letters, 27(8);2108-2112, doi: 10.1109/LCOMM.2023.3286909. DOI: https://doi.org/10.1109/LCOMM.2023.3286909
J. Lin, D. Cui, Z. Peng, Q. Li, and J. He, (2020). A Two-Stage Framework for the Multi-User Multi-Data Center Job Scheduling and Resource Allocation, IEEE Access, 8;197863-197874, doi: 10.1109/ACCESS.2020.3033557. DOI: https://doi.org/10.1109/ACCESS.2020.3033557
P. Biswas, M. S. Akhtar, S. Saha, S. Majhi and A. Adhya, (2023). Q-Learning-Based Energy-Efficient Network Planning in IP-Over-EON, IEEE Transactions on Network and Service Management, 20(1);3-13 doi: 10.1109/TNSM.2022.3197329. DOI: https://doi.org/10.1109/TNSM.2022.3197329
M. G. Brahmam and V. A. R, (2024). VMMISD: An Efficient Load Balancing Model for Virtual Machine Migrations via Fused Metaheuristics with Iterative Security Measures and Deep Learning Optimizations, IEEE Access, 12;39351-39374, doi: 10.1109/ACCESS.2024.3373465. DOI: https://doi.org/10.1109/ACCESS.2024.3373465
H. Yang, J. Zhao, K. -Y. Lam, Z. Xiong, Q. Wu, and L. Xiao, (2022). Distributed Deep Reinforcement Learning-Based Spectrum and Power Allocation for Heterogeneous Networks, IEEE Transactions on Wireless Communications, 21(9);6935-6948, doi: 10.1109/TWC.2022.3153175. DOI: https://doi.org/10.1109/TWC.2022.3153175
R. Yin, T. Wang, J. Yuan, X. Chen, C. Wu and Y. Ji, (2024). An Energy-Efficient Deep Mutual Learning System Based on D2D-U Communications, IEEE Transactions on Wireless Communications, 23(7);7775-7786, doi: 10.1109/TWC.2023.3344637. DOI: https://doi.org/10.1109/TWC.2023.3344637
Z. Wang, T. Li, L. Ge, Y. Zhou, G. Zhang, and W. Tang, (2021). Learn from Optimal Energy-Efficiency Beamforming for SWIPT-Enabled Sensor Cloud System Based on DNN, IEEE Access, 9;60841-60852, doi: 10.1109/ACCESS.2021.3074390. DOI: https://doi.org/10.1109/ACCESS.2021.3074390
S. Zhou, Y. Cheng, X. Lei, Q. Peng, J. Wang, and S. Li, (2022). Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach, IEEE Transactions on Vehicular Technology, 71(11);12088-12103, doi: 10.1109/TVT.2022.3189552. DOI: https://doi.org/10.1109/TVT.2022.3189552
A. Shahid, V. Maglogiannis, I. Ahmed, K. S. Kim, E. De Poorter and I. Moerman, (2021). Energy-Efficient Resource Allocation for Ultra-Dense Licensed and Unlicensed Dual-Access Small Cell Networks, IEEE Transactions on Mobile Computing, 20(3);983-1000, doi: 10.1109/TMC.2019.2953845. DOI: https://doi.org/10.1109/TMC.2019.2953845
H. Nashaat, O. Refaat, F. W. Zaki and I. E. Shaalan, (2020). Dragonfly-Based Joint Delay/Energy LTE Downlink Scheduling Algorithm, IEEE Access, 8;35392-35402, doi: 10.1109/ACCESS.2020.2974856. DOI: https://doi.org/10.1109/ACCESS.2020.2974856
S. Kumar and S. Misra, (2020). Procurement-Based User Association for LTE-Advanced HetNets, IEEE Systems Journal, 14(3);3194-3201, doi: 10.1109/JSYST.2019.2937049. DOI: https://doi.org/10.1109/JSYST.2019.2937049
P. B. Pankajavalli, A. Muniyappan and R. Vishnuvarthan, (2023). Spectrum-Efficient User and Qos-Aware Resource Allocation with Enhanced Uplink Transmission in U-LTE Networks Co-Occurrence with Wi-Fi by CRN, IEEE Access, 11;57295-57304, doi: 10.1109/ACCESS.2023.3284037. DOI: https://doi.org/10.1109/ACCESS.2023.3284037
Jong, C., Kim, Y.C., So, J.H. et al. (2023) QoS and energy-efficiency aware scheduling and resource allocation scheme in LTE-A uplink systems. Telecommun Syst 82;175–191. https://doi.org/10.1007/s11235-022-00980-5. DOI: https://doi.org/10.1007/s11235-022-00980-5
W. -K. Lai, Y. -C. Wang, H. -C. Lin and J. -W. Li, (2020). Efficient Resource Allocation and Power Control for LTE-A D2D Communication with Pure D2D Model, IEEE Transactions on Vehicular Technology, 69(3);3202-3216, doi: 10.1109/TVT.2020.2964286. DOI: https://doi.org/10.1109/TVT.2020.2964286
Debnath, S., Jee, A., Sen, D., Baishya, S., & Arif, W. (2021). Energy Efficient Optimal Resource Allocation in Multi-RAT Heterogeneous Network. Applied Artificial Intelligence, 35(15), 2246–2275. https://doi.org/10.1080/08839514.2021.1998300. DOI: https://doi.org/10.1080/08839514.2021.1998300
Pandey, K., & Arya, R. (2022). Lyapunov optimization machine learning resource allocation approach for uplink underlaid D2D communication in 5G networks. IET Communications, 16(5), 476-484. https://doi.org/10.1049/cmu2.12264.2 DOI: https://doi.org/10.1049/cmu2.12264
Maheshwari, R. U., Jayasutha, D., Senthilraja, R., & Thanappan, S. (2024). Development of Digital Twin Technology in Hydraulics Based on Simulating and Enhancing System Performance. Journal of Cybersecurity & Information Management, 13(2). DOI: https://doi.org/10.54216/JCIM.130204
Paulchamy, B., Uma Maheshwari, R., Sudarvizhi AP, D., Anandkumar AP, R., & Ravi, G. (2023). Optimized Feature Selection Techniques for Classifying Electrocorticography Signals. Brain‐Computer Interface: Using Deep Learning Applications, 255-278. DOI: https://doi.org/10.1002/9781119857655.ch11
Paulchamy, B., Chidambaram, S., Jaya, J., & Maheshwari, R. U. (2021). Diagnosis of Retinal Disease Using Retinal Blood Vessel Extraction. In International Conference on Mobile Computing and Sustainable Informatics: ICMCSI 2020 (pp. 343-359). Springer International Publishing. DOI: https://doi.org/10.1007/978-3-030-49795-8_34
Maheshwari, U. Silingam, K. (2020). Multimodal Image Fusion in Biometric Authentication. Fusion: Practice and Applications, 1(2);79-9179-91. DOI: https://doi.org/10.54216/FPA.010203 DOI: https://doi.org/10.54216/FPA.010203
R.Uma Maheshwari (2021). encryption and decryption using image processing techniques. International Journal of Engineering Applied Sciences and Technology, 5(12);219-222 DOI: https://doi.org/10.33564/IJEAST.2021.v05i12.037
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 International Journal of Computational and Experimental Science and Engineering
This work is licensed under a Creative Commons Attribution 4.0 International License.
