Kirchhoff's voltage law in a circuit with just a battery
Nope. You're missing the fact that a battery can only supply a certain amount of current - that is, it has an internal resistance. Then your circuit looks like







simulate this circuit &ndash; Schematic created using CircuitLab

So there is an internal node which you cannot see (it's not actually a single point - it's part of the overall functioning of the battery) for which KVL applies. 

Please note that, if possible, you should not try too hard to apply batteries to your thinking about circuits. They are very, very non-ideal devices. A voltage/resistor model does not do the device justice. The internal voltage depends on how fully charged or discharged the device is, and the resistance depends on things like state of charge, current level and temperature. 

With that said, you should realize that, for instance, a 9-volt battery has a pretty high internal resistance - it won't provide much current. A car battery, on the other hand, has a very low resistance, and if you mess around with one you can do things like weld large wires together.