Gastvortrag: Raphaël Reynouard: The Baum-Welch Algorithm in All its Power
Dienstag, 29.03.2022, 11.00 Uhr
Ort: RWTH Aachen University, Informatikzentrum - Ahornstr. 55, Erweiterungsgebäude E3, Raum 9u10
Vortragender: Raphaël Reynouard
Cyber-physical systems (CPSs) are naturally modelled as reactive systems with nondeterministic and probabilistic dynamics. Model-based verification techniques have proved effective in the deployment of safety-critical CPSs.
The construction of an accurate formal model for the system is central to the successful application of such techniques. Manual construction can be a resource-demanding and error-prone process, thus motivating the design of automata learning algorithms to synthesise a system model from observed system behaviours.
In this presentation, we revisit and adapt the classic Baum-Welch algorithm for learning several kinds of Markov models, namely: Hidden Markov Models, Labeled Makov Chains, Markov Decision Processes, Continuous Hidden Markov Models, Continuous-Time Markov Chains.
For the case of MDPs, which typically demand more observations, we present a model-based active learning sampling strategy that chooses examples that are most informative w.r.t. the current model hypothesis.