Factory cost refers to the total cost required to manufacture goods. This concept is the basis for several cost accounting analyses. Factory costs have traditionally been broken down into the following three categories of cost: Direct materials. This is the cost of those materials directly associated with the construction of goods. It can also include the cost of materials destroyed during the setup and testing of production equipment, as well as a normal amount of scrap.