author_facet Stapor, Paul
Fröhlich, Fabian
Hasenauer, Jan
Stapor, Paul
Fröhlich, Fabian
Hasenauer, Jan
author Stapor, Paul
Fröhlich, Fabian
Hasenauer, Jan
spellingShingle Stapor, Paul
Fröhlich, Fabian
Hasenauer, Jan
Bioinformatics
Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
Computational Mathematics
Computational Theory and Mathematics
Computer Science Applications
Molecular Biology
Biochemistry
Statistics and Probability
author_sort stapor, paul
spelling Stapor, Paul Fröhlich, Fabian Hasenauer, Jan 1367-4803 1367-4811 Oxford University Press (OUP) Computational Mathematics Computational Theory and Mathematics Computer Science Applications Molecular Biology Biochemistry Statistics and Probability http://dx.doi.org/10.1093/bioinformatics/bty230 <jats:title>Abstract</jats:title> <jats:sec> <jats:title>Motivation</jats:title> <jats:p>Parameter estimation methods for ordinary differential equation (ODE) models of biological processes can exploit gradients and Hessians of objective functions to achieve convergence and computational efficiency. However, the computational complexity of established methods to evaluate the Hessian scales linearly with the number of state variables and quadratically with the number of parameters. This limits their application to low-dimensional problems.</jats:p> </jats:sec> <jats:sec> <jats:title>Results</jats:title> <jats:p>We introduce second order adjoint sensitivity analysis for the computation of Hessians and a hybrid optimization-integration-based approach for profile likelihood computation. Second order adjoint sensitivity analysis scales linearly with the number of parameters and state variables. The Hessians are effectively exploited by the proposed profile likelihood computation approach. We evaluate our approaches on published biological models with real measurement data. Our study reveals an improved computational efficiency and robustness of optimization compared to established approaches, when using Hessians computed with adjoint sensitivity analysis. The hybrid computation method was more than 2-fold faster than the best competitor. Thus, the proposed methods and implemented algorithms allow for the improvement of parameter estimation for medium and large scale ODE models.</jats:p> </jats:sec> <jats:sec> <jats:title>Availability and implementation</jats:title> <jats:p>The algorithms for second order adjoint sensitivity analysis are implemented in the Advanced MATLAB Interface to CVODES and IDAS (AMICI, https://github.com/ICB-DCM/AMICI/). The algorithm for hybrid profile likelihood computation is implemented in the parameter estimation toolbox (PESTO, https://github.com/ICB-DCM/PESTO/). Both toolboxes are freely available under the BSD license.</jats:p> </jats:sec> <jats:sec> <jats:title>Supplementary information</jats:title> <jats:p>Supplementary data are available at Bioinformatics online.</jats:p> </jats:sec> Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis Bioinformatics
doi_str_mv 10.1093/bioinformatics/bty230
facet_avail Online
Free
finc_class_facet Mathematik
Informatik
Biologie
Chemie und Pharmazie
format ElectronicArticle
fullrecord blob:ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuMTA5My9iaW9pbmZvcm1hdGljcy9idHkyMzA
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuMTA5My9iaW9pbmZvcm1hdGljcy9idHkyMzA
institution DE-D275
DE-Bn3
DE-Brt1
DE-Zwi2
DE-D161
DE-Gla1
DE-Zi4
DE-15
DE-Pl11
DE-Rs1
DE-105
DE-14
DE-Ch1
DE-L229
imprint Oxford University Press (OUP), 2018
imprint_str_mv Oxford University Press (OUP), 2018
issn 1367-4803
1367-4811
issn_str_mv 1367-4803
1367-4811
language English
mega_collection Oxford University Press (OUP) (CrossRef)
match_str stapor2018optimizationandprofilecalculationofodemodelsusingsecondorderadjointsensitivityanalysis
publishDateSort 2018
publisher Oxford University Press (OUP)
recordtype ai
record_format ai
series Bioinformatics
source_id 49
title Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_unstemmed Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_full Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_fullStr Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_full_unstemmed Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_short Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_sort optimization and profile calculation of ode models using second order adjoint sensitivity analysis
topic Computational Mathematics
Computational Theory and Mathematics
Computer Science Applications
Molecular Biology
Biochemistry
Statistics and Probability
url http://dx.doi.org/10.1093/bioinformatics/bty230
publishDate 2018
physical i151-i159
description <jats:title>Abstract</jats:title> <jats:sec> <jats:title>Motivation</jats:title> <jats:p>Parameter estimation methods for ordinary differential equation (ODE) models of biological processes can exploit gradients and Hessians of objective functions to achieve convergence and computational efficiency. However, the computational complexity of established methods to evaluate the Hessian scales linearly with the number of state variables and quadratically with the number of parameters. This limits their application to low-dimensional problems.</jats:p> </jats:sec> <jats:sec> <jats:title>Results</jats:title> <jats:p>We introduce second order adjoint sensitivity analysis for the computation of Hessians and a hybrid optimization-integration-based approach for profile likelihood computation. Second order adjoint sensitivity analysis scales linearly with the number of parameters and state variables. The Hessians are effectively exploited by the proposed profile likelihood computation approach. We evaluate our approaches on published biological models with real measurement data. Our study reveals an improved computational efficiency and robustness of optimization compared to established approaches, when using Hessians computed with adjoint sensitivity analysis. The hybrid computation method was more than 2-fold faster than the best competitor. Thus, the proposed methods and implemented algorithms allow for the improvement of parameter estimation for medium and large scale ODE models.</jats:p> </jats:sec> <jats:sec> <jats:title>Availability and implementation</jats:title> <jats:p>The algorithms for second order adjoint sensitivity analysis are implemented in the Advanced MATLAB Interface to CVODES and IDAS (AMICI, https://github.com/ICB-DCM/AMICI/). The algorithm for hybrid profile likelihood computation is implemented in the parameter estimation toolbox (PESTO, https://github.com/ICB-DCM/PESTO/). Both toolboxes are freely available under the BSD license.</jats:p> </jats:sec> <jats:sec> <jats:title>Supplementary information</jats:title> <jats:p>Supplementary data are available at Bioinformatics online.</jats:p> </jats:sec>
container_issue 13
container_start_page 0
container_title Bioinformatics
container_volume 34
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
_version_ 1792347734468984842
geogr_code not assigned
last_indexed 2024-03-01T17:59:56.933Z
geogr_code_person not assigned
openURL url_ver=Z39.88-2004&ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fvufind.svn.sourceforge.net%3Agenerator&rft.title=Optimization+and+profile+calculation+of+ODE+models+using+second+order+adjoint+sensitivity+analysis&rft.date=2018-07-01&genre=article&issn=1367-4811&volume=34&issue=13&pages=i151-i159&jtitle=Bioinformatics&atitle=Optimization+and+profile+calculation+of+ODE+models+using+second+order+adjoint+sensitivity+analysis&aulast=Hasenauer&aufirst=Jan&rft_id=info%3Adoi%2F10.1093%2Fbioinformatics%2Fbty230&rft.language%5B0%5D=eng
SOLR
_version_ 1792347734468984842
author Stapor, Paul, Fröhlich, Fabian, Hasenauer, Jan
author_facet Stapor, Paul, Fröhlich, Fabian, Hasenauer, Jan, Stapor, Paul, Fröhlich, Fabian, Hasenauer, Jan
author_sort stapor, paul
container_issue 13
container_start_page 0
container_title Bioinformatics
container_volume 34
description <jats:title>Abstract</jats:title> <jats:sec> <jats:title>Motivation</jats:title> <jats:p>Parameter estimation methods for ordinary differential equation (ODE) models of biological processes can exploit gradients and Hessians of objective functions to achieve convergence and computational efficiency. However, the computational complexity of established methods to evaluate the Hessian scales linearly with the number of state variables and quadratically with the number of parameters. This limits their application to low-dimensional problems.</jats:p> </jats:sec> <jats:sec> <jats:title>Results</jats:title> <jats:p>We introduce second order adjoint sensitivity analysis for the computation of Hessians and a hybrid optimization-integration-based approach for profile likelihood computation. Second order adjoint sensitivity analysis scales linearly with the number of parameters and state variables. The Hessians are effectively exploited by the proposed profile likelihood computation approach. We evaluate our approaches on published biological models with real measurement data. Our study reveals an improved computational efficiency and robustness of optimization compared to established approaches, when using Hessians computed with adjoint sensitivity analysis. The hybrid computation method was more than 2-fold faster than the best competitor. Thus, the proposed methods and implemented algorithms allow for the improvement of parameter estimation for medium and large scale ODE models.</jats:p> </jats:sec> <jats:sec> <jats:title>Availability and implementation</jats:title> <jats:p>The algorithms for second order adjoint sensitivity analysis are implemented in the Advanced MATLAB Interface to CVODES and IDAS (AMICI, https://github.com/ICB-DCM/AMICI/). The algorithm for hybrid profile likelihood computation is implemented in the parameter estimation toolbox (PESTO, https://github.com/ICB-DCM/PESTO/). Both toolboxes are freely available under the BSD license.</jats:p> </jats:sec> <jats:sec> <jats:title>Supplementary information</jats:title> <jats:p>Supplementary data are available at Bioinformatics online.</jats:p> </jats:sec>
doi_str_mv 10.1093/bioinformatics/bty230
facet_avail Online, Free
finc_class_facet Mathematik, Informatik, Biologie, Chemie und Pharmazie
format ElectronicArticle
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
geogr_code not assigned
geogr_code_person not assigned
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuMTA5My9iaW9pbmZvcm1hdGljcy9idHkyMzA
imprint Oxford University Press (OUP), 2018
imprint_str_mv Oxford University Press (OUP), 2018
institution DE-D275, DE-Bn3, DE-Brt1, DE-Zwi2, DE-D161, DE-Gla1, DE-Zi4, DE-15, DE-Pl11, DE-Rs1, DE-105, DE-14, DE-Ch1, DE-L229
issn 1367-4803, 1367-4811
issn_str_mv 1367-4803, 1367-4811
language English
last_indexed 2024-03-01T17:59:56.933Z
match_str stapor2018optimizationandprofilecalculationofodemodelsusingsecondorderadjointsensitivityanalysis
mega_collection Oxford University Press (OUP) (CrossRef)
physical i151-i159
publishDate 2018
publishDateSort 2018
publisher Oxford University Press (OUP)
record_format ai
recordtype ai
series Bioinformatics
source_id 49
spelling Stapor, Paul Fröhlich, Fabian Hasenauer, Jan 1367-4803 1367-4811 Oxford University Press (OUP) Computational Mathematics Computational Theory and Mathematics Computer Science Applications Molecular Biology Biochemistry Statistics and Probability http://dx.doi.org/10.1093/bioinformatics/bty230 <jats:title>Abstract</jats:title> <jats:sec> <jats:title>Motivation</jats:title> <jats:p>Parameter estimation methods for ordinary differential equation (ODE) models of biological processes can exploit gradients and Hessians of objective functions to achieve convergence and computational efficiency. However, the computational complexity of established methods to evaluate the Hessian scales linearly with the number of state variables and quadratically with the number of parameters. This limits their application to low-dimensional problems.</jats:p> </jats:sec> <jats:sec> <jats:title>Results</jats:title> <jats:p>We introduce second order adjoint sensitivity analysis for the computation of Hessians and a hybrid optimization-integration-based approach for profile likelihood computation. Second order adjoint sensitivity analysis scales linearly with the number of parameters and state variables. The Hessians are effectively exploited by the proposed profile likelihood computation approach. We evaluate our approaches on published biological models with real measurement data. Our study reveals an improved computational efficiency and robustness of optimization compared to established approaches, when using Hessians computed with adjoint sensitivity analysis. The hybrid computation method was more than 2-fold faster than the best competitor. Thus, the proposed methods and implemented algorithms allow for the improvement of parameter estimation for medium and large scale ODE models.</jats:p> </jats:sec> <jats:sec> <jats:title>Availability and implementation</jats:title> <jats:p>The algorithms for second order adjoint sensitivity analysis are implemented in the Advanced MATLAB Interface to CVODES and IDAS (AMICI, https://github.com/ICB-DCM/AMICI/). The algorithm for hybrid profile likelihood computation is implemented in the parameter estimation toolbox (PESTO, https://github.com/ICB-DCM/PESTO/). Both toolboxes are freely available under the BSD license.</jats:p> </jats:sec> <jats:sec> <jats:title>Supplementary information</jats:title> <jats:p>Supplementary data are available at Bioinformatics online.</jats:p> </jats:sec> Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis Bioinformatics
spellingShingle Stapor, Paul, Fröhlich, Fabian, Hasenauer, Jan, Bioinformatics, Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis, Computational Mathematics, Computational Theory and Mathematics, Computer Science Applications, Molecular Biology, Biochemistry, Statistics and Probability
title Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_full Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_fullStr Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_full_unstemmed Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_short Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
title_sort optimization and profile calculation of ode models using second order adjoint sensitivity analysis
title_unstemmed Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis
topic Computational Mathematics, Computational Theory and Mathematics, Computer Science Applications, Molecular Biology, Biochemistry, Statistics and Probability
url http://dx.doi.org/10.1093/bioinformatics/bty230