connect 2 speakers to act as a telephone
It can work, and you saw it work long ago.  I had a setup like that (some kind of science kit) when I was young.  It works just like you guessed.  You could do this again today, if you can find two speakers like that.  The hardest thing these days is to find a quiet place to try it!