According to the USDA, yes, you can safely cook your frozen chicken, as long as you follow a couple general guidelines. In order to skip the thawing step and turn your frozen chicken into a fully-cooked, safe-to-eat dinner, use your oven or stove top and simply increase your cooking time by at least 50%.