Android 5 date and time pickers are not accessible
Never mind I figured it out you have to navigate to the circular thing and then make the scroll gesture which is right-then-left to increment the number and left-then-right to decrement it.