Multispectral optoacoustic tomography requires real-time image feedback during clinical use. Herein, we present DeepMB, a deep learning framework to express the model-based reconstruction operator with a deep neural network and reconstruct high-quality optoacoustic images from arbitrary experimental input data at speeds that enable live imaging (31ms per image).