We propose a new PAM-4 receiver architecture based on a silicon photonic quantizer that converts a PAM-4 optical signal into multiple weighted electrical signals. Circuit simulation of this receiver at 50-Gbps demonstrates its feasibility and advantages.