What is "clearance delivery" meant for?
"Clearance Delivery" is exactly what you've surmised it is - a frequency used on the ground to copy your initial clearance from ATC before you take off.
The idea behind using a dedicated frequency for this is that it avoids tying up the ground control frequency (used for authorizing ground movement on taxiways and such) with long clearances and readbacks.

Clearance Delivery is found at controlled fields. Pilots operating under Instrument Flight Rules will generally use it prior to each flight, and at airfields in class C or class B airspace it's used by VFR pilots as well (since they'll be talking to departure controllers very shortly after take off until clear of the controlled airspace).  

At less busy fields Clearance Delivery is often staffed by the same controller working Ground (e.g. at Long Island / Mac Arthur it's usually the same controller working both positions), and at some airports clearances will be read over the ground control frequency when it's not busy. At busier airports clearance is usually its own position - possibly with multiple frequencies (e.g. at La Guardia there is a separate clearance frequency for helicopters).