We adopt a contextual framework to examine the within-person associations between smartphone use and subsequent momentary well-being. In a large intensive mobile sensing and experience sampling study (N = 1,003 young adult; 36,949 observations), we examined the relationship between five broad indicators of well-being (loneliness, stress, sadness, contentment, and energy level), two indicators of smartphone use (frequency and duration of use), and two contextual factors (social and spatial). We found that frequent “check-ins” had a small positive association with momentary well-being: when people unlocked their phones more often than usual, they reported feeling less lonely, less sad, more content, and more energetic. On the other hand, long sessions had a small negative association with momentary well-being: when people spent longer periods of time on their phones than usual, they reported feeling more lonely and more sad, while also feeling less content and less energetic. Moreover, we found that contextual factors were (a) a more important predictor of momentary well-being, and (b) moderated the within-person associations between smartphone use and well-being. Frequent and prolonged smartphone use was more detrimental to momentary well-being when occurring in social settings (around strong or weak ties vs. when alone) and in public or work environments (vs. at home). Overall, we find a relationship between smartphone use and momentary well-being exists, but the direction of this effect is sensitive to context—underscoring the value of a situational approach to media effects research.