Guest Talk: Raphaël Reynouard: The Baum-Welch Algorithm in All its Power

Tuesday, March 29, 2022, 11:00am

Location: RWTH Aachen University, Department of Computer Science - Ahornstr. 55, building E3, room 9u10

Speaker: Raphaël Reynouard

 

Abstract:

Cyber-physical systems (CPSs) are naturally modelled as reactive systems with nondeterministic and probabilistic dynamics. Model-based verification techniques have proved effective in the deployment of safety-critical CPSs.

The construction of an accurate formal model for the system is central to the successful application of such techniques. Manual construction can be a resource-demanding and error-prone process, thus motivating the design of automata learning algorithms to synthesise a system model from observed system behaviours.

In this presentation, we revisit and adapt the classic Baum-Welch algorithm for learning several kinds of Markov models, namely: Hidden Markov Models, Labeled Makov Chains, Markov Decision Processes, Continuous Hidden Markov Models, Continuous-Time Markov Chains.

For the case of MDPs, which typically demand more observations, we present a model-based active learning sampling strategy that chooses examples that are most informative w.r.t. the current model hypothesis.

https://rwth.zoom.us/j/92047949381?pwd=LzIwUW96WEM0MkRjZ01FUmhwd1I3QT09