Yes, the terminology can be challenging. Use of the terms often requires context.
It is often thought that error is either random (unpredictable, chance) or systematic (assignable).
When running an experiment, you want to compare the effects of the factors in your experiment (e.g., your model terms) to an estimate of the true error in the system (which is likely a combination of both random and systematic errors). This estimate is often referred to as the experimental error. How that error is estimated (randomized replicates, et. al.) and how representative of the true error in the system are very important considerations for the analysis and interpretation of your experimental results. If, for example, the errors associated with your experiment are much less than typical error in the system (e.g., future conditions), you likely will commit an alpha error. If the errors in your experiment are much greater than typical, then you commit the beta error.
Back to your question, what errors are represented in your residuals are a function of how the experiment was conducted (e.g., inference space) and the model you are analyzing (e.g., what terms are in your model).
"All models are wrong, some are useful" G.E.P. Box