Does connecting batteries in parallel increase the current?
"Real" batteries are capable of maintaining their voltage while delivering significant current.  

However, the potato batteries are not capable of delivering much current - they have a relatively high internal resistance, so the voltage will drop significantly when they are delivering current.  Putting the potatoes in parallel doubles the available current.