This paper describes an approach to adaptive optimal control in the presence of model parameter calculation difficulties. This has wide application in a variety of biological and biomedical research and clinical problems. To illustrate the techniques, the approach is applied to the development and implementation of a practical adaptive insulin infusion algorithm for use with patients with Type 1 diabetes mellitus.