Obesity is a critical healthcare issue affecting the United States. The least risky treatments available for obesity are behavioral interventions meant to promote diet and exercise. Often these interventions contain a mobile component that allows interventionists to collect participants level data and provide participants with incentives and goals to promote long term behavioral change. Recently, there has been interest in using direct financial incentives to promote behavior change. However, adherence is challenging in these interventions, as each participant will react differently to different incentive structure and amounts, leading researchers to consider personalized interventions. The key challenge for personalization, is that the clinicians do not know a priori how best to administer incentives to participants, and given finite intervention budgets how to disburse costly resources efficiently. In this paper, we consider this challenge of designing personalized weight loss interventions that use direct financial incentives to motivate weight loss while remaining within a budget. We create a predictive model that is able to predict how individuals may react to different incentive schedules within the context of a behavioral intervention. We integrated this predictive model in an adaptive optimization framework that over the course of the intervention computes what incentives to disburse to participants and remain within the study budget. We show that our optimization framework is asymptotically optimal. We demonstrate the effectiveness of our approach using real world data from a real world weight loss trial that used financial incentives to incentives weight loss. Our results show that using an 60-80% smaller budget, our adaptive optimization framework is able to help the same number of participants lose weight as an existing one-size-fits-all intervention. Furthermore, using our adaptive optimization framework would spend only $120 per individual across 24 weeks as opposed to the current intervention which would spend $360 per individual in the same time frame to achieve similar clinical outcomes. Our results highlight that providers who choose to implement behavioral interventions at scale will need to use a personalized approach to effectively use their limited budgets.