There is not enough context to provide specific advice.
I have some questions/comments:
1. What are the response variables? You suggest one is a "measure of performance". We live in a multivariate world, so what are the other Y's? For example, cost is another Y.
2. Have you studied your measurements systems?
3. How do you determine the consistency of either "A" or "B"? Have you studied the lot-to-lot or batch-to-batch variation of either component? Obviously you will have to take a sample for your experiments. How representative will your sample be of future material?
4. What are the scientific or engineering hypotheses/theories? What is actually different between "A" and "B"? Are the differences measurable? Why is B cheaper? Are there no other factors? How is the material made? Is there any time, temperature, etc. in making the product? What noise might affect the product?
IMHO, you really aren't designing experiments per se. You want to run 5 possible combinations and pick the best results from those 5.
"All models are wrong, some are useful" G.E.P. Box