Autonomous micro aerial robots can operate in three-dimensional unstructured environments, and offer many opportunities for environmental monitoring, search and rescue, and first response. I will describe the challenges in developing small, agile robots and our recent work in addressing these challenges. I will also discuss the deployment of large numbers of aerial robots, focusing on the control and planning problems with applications to cooperative manipulation and transport, construction, and exploration and mapping.