We found that acupuncture may not play a more clinically meaningful role than sham in relieving pain immediately after treatment or in improving quality of life in the short term, and acupuncture possibly did not improve back function compared to sham in the immediate term. However, acupuncture was more effective than no treatment in improving pain and function in the immediate term. Trials with usual care as the control showed acupuncture may not reduce pain clinically, but the therapy may improve function immediately after sessions as well as physical but not mental quality of life in the short term. The evidence was downgraded to moderate to very low-certainty considering most of studies had high risk of bias, inconsistency, and small sample size introducing imprecision. The decision to use acupuncture to treat chronic low back pain might depend on the availability, cost and patient's preferences.