The linear wave-number spectrometer for spectral domain optical coherence tomography (SD-OCT) is proposed. Compensation by optical glass prism is used to make optical frequency readouts equidistant in diffraction grating based spectrometer. We demonstrate that selection of only two optical prism parameters almost completely eliminates non-equidistance of optical frequency readouts. Proposed optically linearized spectrometer allows reconstructing OCT image without any numerical resampling.