{
    "abstract": "The improvement of controllers of left ventricular assist device (LVAD) technology supporting heart failure (HF) patients has enormous impact, given the high prevalence and mortality of HF in the population. The use of reinforcement learning for control applications in LVAD remains minimally explored. This work introduces a preload-based deep reinforcement learning control for LVAD based on the proximal policy optimization algorithm.\nThe deep reinforcement learning control is built upon data derived from a deterministic high-fidelity cardiorespiratory simulator exposed to variations of total blood volume, heart rate, systemic vascular resistance, pulmonary vascular resistance, right ventricular end-systolic elastance, and left ventricular end-systolic elastance, to replicate realistic inter- and intra-patient variability of patients with a severe HF supported by LVAD. The deep reinforcement learning control obtained in this work is trained to avoid ventricular suction and allow aortic valve opening by using left ventricular pressure signals: end-diastolic pressure, maximum pressure in the left ventricle (LV), and maximum pressure in the aorta.\nThe results show controller obtained in this work, compared to the constant speed LVAD alternative, assures a more stable end-diastolic volume (EDV), with a standard deviation of 5\u2009mL and 9\u2009mL, respectively, and a higher degree of aortic flow, with an average flow of 1.1\u2009L/min and 0.9\u2009L/min, respectively.\nThis work implements a deep reinforcement learning controller in a high-fidelity cardiorespiratory simulator, resulting in increases of flow through the aortic valve and increases of EDV stability, when compared to a constant speed LVAD strategy.",
    "authors": [
        {
            "affiliation": null,
            "firstname": "Diego",
            "initials": "D",
            "lastname": "Fern\u00e1ndez-Zapico"
        },
        {
            "affiliation": "Department of Electrical Engineering (ESAT), KU Leuven, Leuven, Belgium.",
            "firstname": "Thijs",
            "initials": "T",
            "lastname": "Peirelinck"
        },
        {
            "affiliation": "Department of Electrical Engineering (ESAT), KU Leuven, Leuven, Belgium.",
            "firstname": "Geert",
            "initials": "G",
            "lastname": "Deconinck"
        },
        {
            "affiliation": "Cardiovascular and Respiratory Physiology, University of Twente, Enschede, the Netherlands.\nIntensive Care Center, University Medical Center Utrecht, Utrecht, the Netherlands.",
            "firstname": "Dirk W",
            "initials": "DW",
            "lastname": "Donker"
        },
        {
            "affiliation": "Cardiovascular and Respiratory Physiology, University of Twente, Enschede, the Netherlands.",
            "firstname": "Libera",
            "initials": "L",
            "lastname": "Fresiello"
        }
    ],
    "conclusions": "This work implements a deep reinforcement learning controller in a high-fidelity cardiorespiratory simulator, resulting in increases of flow through the aortic valve and increases of EDV stability, when compared to a constant speed LVAD strategy.",
    "copyrights": "\u00a9 2024 International Center for Artificial Organ and Transplantation (ICAOT) and Wiley Periodicals LLC.",
    "doi": "10.1111/aor.14845",
    "journal": "Artificial organs",
    "keywords": [
        "cardiorespiratory simulator",
        "deep reinforcement learning",
        "heart failure",
        "left ventricular assist device",
        "physiological control"
    ],
    "methods": null,
    "publication_date": "2024-09-18",
    "pubmed_id": "39289857",
    "results": "The results show controller obtained in this work, compared to the constant speed LVAD alternative, assures a more stable end-diastolic volume (EDV), with a standard deviation of 5\u2009mL and 9\u2009mL, respectively, and a higher degree of aortic flow, with an average flow of 1.1\u2009L/min and 0.9\u2009L/min, respectively.",
    "title": "Physiological control for left ventricular assist devices based on deep reinforcement learning.",
    "xml": "<Element 'PubmedArticle' at 0x7885054ad350>"
}