Lightning-3.5mm adapter causes device to act as if remote button is continuously pressed
This is likely a defective adapter.
Trying it with different peripherals and devices kind of nails it down. Just probably a short in the wiring or internal circuitry that can't be seen. I would toss it and replace it.