In this paper a two dimensional non linear neural network model is considered and it is shown that chaotic attractor exists beyond accumulation point. To confirm the existence of chaotic attractor, Lyapunov exponent method is used. Further various fractal dimensions like Correlation dimension, Box-counting and Information dimension of the chaotic attractor were found to assess the geometry of the fractal set. Keywords: Lyapunov Exponent, Strange attractor, fractal dimension, Correlation dimension, Box-counting and Information dimension.