How does decimation work without losing samples?
Your understanding is correct. You need to make sure the information content fits into the output rate, and that implies your signal needs to be band-limited to 1/16384. Otherwise you'll lose information.
Making sure that's the case with a filter is called anti-alias filtering.