As export container throughput continues to increase in container terminal yards, ensuring the efficient management and scheduling of terminal resources has become crucial for enhancing terminal competitiveness. Considering an automated container terminal yard as the research object, this study proposes an optimization method based on Deep Reinforcement Learning (DRL) to address the issues of storage slot allocation and yard crane scheduling for export containers. A comprehensive analysis of the container terminal yard operation system is performed, and a multi-objective optimization model is constructed. This model primarily aims to reduce the yard crane operation time, internal truck waiting time, and number of container relocations within the yard blocks, while also considering constraints such as the safe distance between yard cranes and balanced workload distribution. To reduce the complexity of solving the model, an Actor—Critic algorithm based on DRL is proposed. Numerical examples of different scales are designed. Through a comparative analysis with the results of the Genetic Algorithm (GA) and exact solutions from CPLEX, the advantages of the Actor—Critic algorithm in terms of solution speed and quality are demonstrated. Experiments reveal that the proposed algorithm can quickly and accurately solve small-scale problems and obtain near-optimal solutions for large-scale problems, exhibiting significant superiority over the GA in solving large-scale problems. Comparative experiments are conducted to further investigate the impact of the number of yard cranes and zoning-balanced mixed stacking strategy on the optimization results. The analysis results indicate that the zoning-balanced mixed stacking strategy outperforms traditional stacking strategies in terms of balancing yard crane workloads and reducing idle time.