More in: Small Business Growth 11 Comments ▼. Small businesses are seeking ways to tighten their belts and cut business costs without sacrificing growth. As a small business owner, you can cut costs simply by reducing incidental spending.For example, some businesses are buying less paper, staplers, snacks and coffee machines to tighten their budgets, according to a recent report from Sam’s Club where many small companies buy these items for their offices at a discount.ay too little and you may find the cost of countless errors too much for your budget to bear. Don’t Do It Yourself. Embrace Cloud-based Accounting. Cloud-based accounting is a way to cut business costs on expensive software you need to maintain your ledger.