Fiber Bragg grating (FBG) sensor is broadly accepted as a structural health monitoring device for fiber reinforced polymer (FRP) materials by either embedding into or bonding onto the structures. A new kind of smart FRP-concrete composite beam was developed by using embedded FBG sensors. Firstly, fabrication process of the smart FRP-concrete composite beam was introduced. Subsequently, FRP laminates with embedded FBG sensors, which have the same stacking sequences as that of the smart composite beam, were fabricated and tested on material test system to determine the strain sensitivity coefficients of the smart composite beams. Finally, the proposed smart FRP-concrete composite beam was tested in 4-point bending to verify the operation of FBG sensors embedded in the smart beam. The experimental results indicate the strain sensing property of the laminates with embedding FBG sensors is nearly the same as that of bare FBG sensor, and the output of embedded FBG sensors in the smart beam agrees well with that of surface-bonded strain gauges over the entire load range. The proposed smart FRP-concrete composite beam can reveal the true internal strain of itself in its service life and will have wide applications for long-term monitoring in civil engineering.