The curvature in the normal quantile plot suggests that there is some skew in the population, one of the reasons that the goodness of fit test rejects the normal distribution model. The skew is not that strong, though, so the sample means are approximately normally distributed after all and the t test should be valid.
Here is a reference for estimating the minimum sample size necessary to assure that the sum of the random variables is normally distributed:
Sugden, R. A., et al. (2002) "Cochran's Rule for Simple Random Sampling,
J of the Royal Statistical Society, Series B, Statistical Methodology. 62(4):787-793.