bioRxivBiophysicsPreprint
A fast and objective hidden Markov modeling for accurate analysis of biophysical data with numerous states
Abstract
The hidden Markov model (HMM) is widely used to analyze biophysical chronological data with discrete states, such as binding/detachment of biomolecules, protein/nucleotide conformational changes and step-like movement of single proteins. Despite its usefulness, classical HMM fitting has practical drawbacks that it requires the determination of the number of hidden states and fine initialization of many parameters before fitting. To overcome these drawbacks, several HMM pre-analyses have been reported, but do not provide enough accuracy when data have unknown kinetics and/or low signal-to-noise ratio. Therefore, in many cases, HMM fitting needs trial-and-error manual process that can impair the objectivity of the analysis. Moreover, for data composed of numerous hidden states, such as stepping data of cytoskeletal motors, there has been difficulty in HMM analysis because the large number of parameters were hardly properly initialized. Here, by combining a statistical step-finding method and the Gaussian mixture model clustering, we developed a new algorithm for more objective HMM analysis. Our algorithm can execute accurate state number estimation and parameter optimization with fully automated way. Simulation analysis demonstrated that our algorithm accurately fit both fast- and slow-transition trajectories. Compared with the previous method, the speed of our algorithm was 10-20 times faster for standard size data. Our algorithm also showed the accurate fit of the simulated motor-stepping data with more than 10 transition states, suggesting the applicability of the method to the data with numerous states. Furthermore, the algorithm is flexible enough to cope with cases where some kinetics are known in advance. Some available prior information, such as the dwell time of each state, can be integrated into the algorithm via two user-tunable parameters. In summary, our method enables fast, accurate and objective HMM analysis, and broadens the application range of HMM fitting that can provide more accurate interpretation of a wide variety of biophysical data.
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Generalizing HMMs to Continuous Time for Fast Kinetics: Hidden Markov Jump Processes
Z. Kilic, I. Sgouralis, S. Presse·bioRxiv·Jul 28, 2020
- An accurate probabilistic step finder for time-series analysis
A. Rojewski, M. Schweiger, … S. Presse·bioRxiv·Sep 19, 2023
- Diffusion analysis of single particle trajectories in a Bayesian nonparametrics framework
R. Cardim Falcao, D. Coombs·bioRxiv·Jul 16, 2019
- Worth the effort? A practical examination of random effects in hidden Markov models for animal telemetry data
B. T. McClintock·bioRxiv·Jul 10, 2020
- Behavioural state inference from movement and environmental data using Markovian step selection functions
Ilhem Bouderbala, Aurélien Nicosia, Daniel Fortin·PLoS ONEPeer-reviewed·Oct 26, 2026
- Variational algorithms for analyzing noisy multi-state diffusion trajectories
Martin Lindén, Johan Elf·bioRxiv·Mar 8, 2018