JGPR: a computationally efficient multi-target Gaussian process regression algorithm

Article


Nabati, M., Ghorashi, S. A. and Shahbazian, R. 2022. JGPR: a computationally efficient multi-target Gaussian process regression algorithm. Machine Learning. 111, pp. 1987-2010. https://doi.org/10.1007/s10994-022-06170-3
AuthorsNabati, M., Ghorashi, S. A. and Shahbazian, R.
Abstract

Multi-target regression algorithms are designed to predict multiple outputs at the same time, and allow us to take all output variables into account during the training phase. Despite the recent advances, this context of machine learning is still an open challenge for developing a low-cost and high accurate algorithm. The main challenge in multi-target regression algorithms is how to use different targets’ information in the training and/or test phases. In this paper, we introduce a low-cost multi-target Gaussian process regression (GPR) algorithm, called joint GPR (JGPR) that employs a shared covariance matrix among the targets during the training phase and solves a sub-optimal cost function for optimization of hyperparameters. The proposed strategy reduces the computational complexity considerably during the training and test phases and simultaneously avoids overfitting of the multi-target regression algorithm upon the targets. We have performed extensive experiments on both simulated data and 18 benchmark datasets to assess the proposed method compared with other multi-target regression algorithms. Experimental results show that the proposed JGPR outperforms the state-of-the-art approaches on most of the given benchmark datasets.

KeywordsMachine learning; Gaussian process regression; Multi-task learning; Multitarget regression
JournalMachine Learning
Journal citation111, pp. 1987-2010
ISSN0885-6125
Year2022
PublisherSpringer
Accepted author manuscript
License
File Access Level
Anyone
Digital Object Identifier (DOI)https://doi.org/10.1007/s10994-022-06170-3
Publication dates
Online11 May 2022
Publication process dates
Accepted18 Mar 2022
Deposited13 May 2022
Copyright holder© 2022, The Author(s)
Additional information

This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10994-022-06170-3

Permalink -

https://repository.uel.ac.uk/item/8q995

Download files


Accepted author manuscript
Ghorashi - Machine Learning - 2022.pdf
License: Springer Nature terms of use for archived author accepted manuscripts (AAMs) of subscription articles, books and chapters
File access level: Anyone

  • 78
    total views
  • 4
    total downloads
  • 2
    views this month
  • 0
    downloads this month

Export as

Related outputs

A real-time fingerprint-based indoor positioning using deep learning and preceding states
Nabati, M. and Ghorashi, S. 2023. A real-time fingerprint-based indoor positioning using deep learning and preceding states. Expert Systems with Applications. 213 (Art. 118889). https://doi.org/10.1016/j.eswa.2022.118889
Time-series clustering for sensor fault detection in large-scale Cyber-Physical Systems
Alwan, A., Brimicombe, A., Ciupala, A., Ghorashi, S., Baravalle, A. and Falcarin, P. 2022. Time-series clustering for sensor fault detection in large-scale Cyber-Physical Systems. Computer Networks. 218 (Art. 109384). https://doi.org/10.1016/j.comnet.2022.109384
Confidence interval estimation for fingerprint-based indoor localization
Nabati, M., Ghorashi, S. and Shahbazian, R. 2022. Confidence interval estimation for fingerprint-based indoor localization. Ad Hoc Networks. 134 (Art. 102877). https://doi.org/10.1016/j.adhoc.2022.102877
The Impact of CISO Appointment Announcements on the Market Value of Firms
Ford, A., Al-Nemrat, A., Ghorashi, S. and Davidson, J. 2022. The Impact of CISO Appointment Announcements on the Market Value of Firms. 17th International Conference on Cyber Warfare and Security (ICCWS 2022). Albany, New York, USA 17 - 18 Mar 2022 Academic Conferences International Limited.
A Machine Learning Framework for House Price Estimation
Awonaike, A., Ghorashi, S. and Hammad, R. 2022. A Machine Learning Framework for House Price Estimation. 21st International Conference on Intelligent Systems Design and Applications (ISDA 2021). Online 13 - 15 Dec 2021 Springer. https://doi.org/10.1007/978-3-030-96308-8_90
Data quality challenges in large-scale cyber-physical systems: A systematic review
Alwan, A., Ciupala, A., Brimicombe, A., Ghorashi, S., Baravalle, A. and Falcarin, P. 2021. Data quality challenges in large-scale cyber-physical systems: A systematic review. Information Systems. 105 (Art. 101951). https://doi.org/10.1016/j.is.2021.101951
The Impact of Data Breach Announcements on Company Value in European Markets
Ford, A., Al-Nemrat, A., Ghorashi, S. and Davidson, J. 2021. The Impact of Data Breach Announcements on Company Value in European Markets. WEIS 2021: The 20th Annual Workshop on the Economics of Information Security. 28 - 29 Jun 2021
The Impact of GDPR Infringement Fines on the Market Value of Firms
Ford, A., Al-Nemrat, A., Ghorashi, S. and Davidson, J. 2021. The Impact of GDPR Infringement Fines on the Market Value of Firms. ECCWS 2021- Proceeding of the 20th European Conference on Cyber Warfare and Security. 24 - 25 Jun 2021 Academic Conferences International Limited. https://doi.org/10.34190/EWS.21.088
A CSI-Based Human Activity Recognition Using Deep Learning
Fard Moshiri, P., Shahbazian, R., Nabati, M. and Ghorashi, S. A. 2021. A CSI-Based Human Activity Recognition Using Deep Learning. Sensors. https://doi.org/10.3390/s21217225
Reconfigurable Linear Antenna Arrays for Beam-Pattern Matching in Collocated MIMO Radars
Kavousi Ghafi, E., Ghorashi, S. and Mehrshahi, E. 2021. Reconfigurable Linear Antenna Arrays for Beam-Pattern Matching in Collocated MIMO Radars. IEEE Transactions on Aerospace and Electronic Systems. 57 (5), pp. 2715-2724. https://doi.org/10.1109/TAES.2021.3062173
Generative Adversarial Networks (GANs) in Networking: A Comprehensive Survey & Evaluation
Navidan, H., Fard Moshiri, P., Nabati, M., Shahbazian, R., Ghorashi, S., Shah-Mansouri, V. and Windridge, D. 2021. Generative Adversarial Networks (GANs) in Networking: A Comprehensive Survey & Evaluation. Computer Networks. 194 (Art. 108149). https://doi.org/10.1016/j.comnet.2021.108149
Joint Coordinate Optimization in Fingerprint-Based Indoor Positioning
Nabati, M., Ghorashi, S. and Shahbazian, R. 2021. Joint Coordinate Optimization in Fingerprint-Based Indoor Positioning. IEEE Communications Letters. 25 (4), pp. 1192-1195. https://doi.org/10.1109/LCOMM.2020.3047352
A fingerprint technique for indoor localization using autoencoder based semi-supervised deep extreme learning machine
Ezzati Khatab, Z., Hajihoseini Gazestani, A., Ghorashi, S. and Ghavami, M. 2020. A fingerprint technique for indoor localization using autoencoder based semi-supervised deep extreme learning machine. Signal Processing. 181 (Art. 107915). https://doi.org/10.1016/j.sigpro.2020.107915
Joint Optimization of Power and Location in Full-Duplex UAV Enabled Systems
Gazestani A. H., Ghorashi, S. A., Yang, Z. and Shikh-Bahaei, M. 2020. Joint Optimization of Power and Location in Full-Duplex UAV Enabled Systems. IEEE Systems Journal. 16 (1), pp. 914-921. https://doi.org/10.1109/JSYST.2020.3036275
Fingerprinting Based Indoor Localization Considering the Dynamic Nature of Wi-Fi Signals
Alikhani, N., Moghtadaiee, V. and Ghorashi, S. 2020. Fingerprinting Based Indoor Localization Considering the Dynamic Nature of Wi-Fi Signals. Wireless Personal Communications. 115 (2), pp. 1445-1464. https://doi.org/10.1007/s11277-020-07636-0
Resource Allocation in Full-Duplex UAV Enabled Multi Small Cell Networks
Hajihoseini Gazestani, A., Ghorashi, S. A., Yang, Z. and Shikh-Bahaei, M 2020. Resource Allocation in Full-Duplex UAV Enabled Multi Small Cell Networks. IEEE Transactions on Mobile Computing. 21 (3), pp. 1049-1060. https://doi.org/10.1109/TMC.2020.3017137
Privacy preserving in indoor fingerprint localization and radio map expansion
Ghorashi, S. A., Sazdar, A. M., Alikhani, N. and Khonsari, A. 2020. Privacy preserving in indoor fingerprint localization and radio map expansion. Peer-to-Peer Networking and Applications. 14, p. 121–134. https://doi.org/10.1007/s12083-020-00950-1
A Low-complexity trajectory privacy preservation approach for indoor fingerprinting positioning systems
Sazdar, A. M., Ghorashi, S. A., Moghtadaiee, V., Khonsari, A. and Windridge, D. 2020. A Low-complexity trajectory privacy preservation approach for indoor fingerprinting positioning systems. Journal of Information Security and Applications. 53 (Art. 102515). https://doi.org/10.1016/j.jisa.2020.102515
Using Synthetic Data to Enhance the Accuracy of Fingerprint-Based Localization: A Deep Learning Approach
Nabati, M., Navidan, H., Shahbazian, R., Ghorashi, S. A. and Windridge, D. 2020. Using Synthetic Data to Enhance the Accuracy of Fingerprint-Based Localization: A Deep Learning Approach. IEEE Sensors Letters. 4 (Art. 6000204). https://doi.org/10.1109/LSENS.2020.2971555
Power Allocation for D2D Communications Using Max-Min Message-Passing Algorithm
Kazemi Rashed, S, Asvadi, R., Rajabi, S., Ghorashi, S. A. and Martini, M. G. 2020. Power Allocation for D2D Communications Using Max-Min Message-Passing Algorithm. IEEE Transactions on Vehicular Technology. 69 (8), pp. 8443-8458. https://doi.org/10.1109/TVT.2020.2995534
Throughput Improvement by Mode Selection in Hybrid Duplex Wireless Networks
Mousavinasab, B., Gazestani, A. H., Ghorashi, S. A. and Shikh-Bahaei, M. 2020. Throughput Improvement by Mode Selection in Hybrid Duplex Wireless Networks. Wireless Networks. 26, p. 3687–3699. https://doi.org/10.1007/s11276-020-02286-3
New Reconstructed Database for Cost Reduction in Indoor Fingerprinting Localization
Moghatdaiee, V., Ghorashi, S. and Ghavami, G. 2019. New Reconstructed Database for Cost Reduction in Indoor Fingerprinting Localization. IEEE Access. 7, pp. 104462-104477. https://doi.org/10.1109/ACCESS.2019.2932024