Multicamera Fusion for online Analysis of structured Processes

Dimitrios Kosmopoulos, Ilias Maglogiannis


Abstract:We propose a novel framework for online analysis of visual struc- tured processes, using fusion from multiple cameras. Online recog- nition is performed through particle filters supported by hidden Markov models. We evaluate three fusion methods, an early fu- sion, a simple multiplication of the observation probabilities and a multi-stream one implying cross-stream coupling of observations and states. The performance is thoroughly evaluated under two complex visual behavior understanding scenarios: a visual process for table preparation in a kitchen and a real life manufacturing pro- cess in an industrial plant. The obtained results are compared and discussed.