Here are five foods that can cause kidney stones because of a high oxalate content. Sweet potatoes, baked or canned–These vegetables which are often advised as being better for you then regular white potatoes which are very high in oxates. A half cup serving can have 26 to 99 mg of oxalates.