How can S11 component measurement circuit be made on a pcb?
You don't necessarily need to measure \$S_{11}\$ to determine the dielectric constant of your material. 

You could, for example, make a capacitor out of your material, put it in series or parallel with an inductor of known value, and excite it with a swept-frequency source. Then you'd only need a rectifier or rf detector (basically the same circuit but named differently depending on operating frequency) and a voltmeter (or ADC) to find the resonant frequency. 

This would probably work best in the 1 kHz to 10 MHz frequency range. 
You could make a dielectric resonator out of your material and again use a swept frequency source, rf detector, and voltmeter to determine the resonant frequency. This would likely work best in the 100 MHz to ~5 GHz frequency range.
If you do decide you want to do a reflection measurement, if you don't need phase information (so still not a full \$S_{11}\$ measurement), then you could use a VSWR-meter. This is much simpler than a VNA, but still requires a directional coupler to build one. This means some difficulty if you want the measurement to span an octave or more of frequency. You can google "VSWR-meter schematic" and get numerous design ideas.
If you don't mind doing the measurement manually, you can measure \$S_{11}\$ using an airline probe. See my question on VSWR for more on what this looks like. Measuring VSWR give the magnitude of \$S_{11}\$ and the position of the probes to find the minima and maxima gives the phase. The minimum frequency of this measurement is limited because the air line must be at least one quarter wavelength long, and the maximum frequency is limited by the precision with which you can position the probes (and the frequency response of the probes).
Another step short of building a VNA is a vector voltmeter. This allows an automated measurement of both gain and phase. 
If you google, you will find a few published designs for homebrew VNAs, mostly targeted at frequencies used in amateur radio. Basically this means combining multiple vector voltmeters with directional couplers to get completely automated amplitude and phase S-parameter measurements.