Simple analog display?
You can capture the pulse in analog fashion, convert to digital, and display it on an LCD display. This is far more complex than an analog oscilloscope needs to be- it's possible to make an oscilloscope tube display a few 10's of volts directly, using an electrostatic deflection tube such as a 3JP1, but it involves a special hard-to-find vacuum tube, filament current, high voltage and some biasing, plus the sawtooth generator and trigger for horizontal deflection (could be a few op-amps or some discretes for relatively low frequencies to a MHz or two). 

But even though it's incredibly complex, involving millions of transistors and a fair bit of code, it's not necessarily expensive and one can purchase modules that do this for less than $50 US. The same technology is used in many consumer products (displays used in cell phones, GPS etc.) as are the CPUs (ARM, for example) so the parts are relatively cheap and high performance. Provided you don't need oscilloscope performance, that is. A modern digital oscilloscope does GHz sampling. You don't need that for most ultrasonics which is not much over audio in frequency. Of course if you're doing MHz ultrasonics you may need more sophisticated circuitry, and a real digital oscilloscope would be a good solution.