230V to 12V step down transformer
How are you measuring this 4.4V output?  Keep in mind that the transformer output will be AC, so your voltmeter needs to be set to AC to read the voltage properly.

A transformer rated for "12V" out should put that out at its maximum rated output current.  That means it probably puts out more when unloaded.  For some transformers, that could be significantly more, like up to 50% more.

Keep in mind that 12V AC will result in a higher rectified DC voltage.  This is because the 12V spec is RMS.  For a sine wave, such as your power voltage, the peaks will be sqrt(2) times higher than the RMS level.  The peaks will be 17V for the case of 12V RMS.  If this 12V transformer secondary is followed by a full wave bridge to make DC, then about 1.4V will be lost in the diodes.  That leaves about 15.6V DC.  Again, it may be somewhat higher when unloaded.  20V DC with no current drawn wouldn't be too surprising.

With 15-20V into the 5V regulator and 5V out, the regulator is dropping 10-15V.  This times the current draw of the circuit will be burned up as heat in the regulator.  For example, if the circuit draws 100mA, then then up to 15V * 100mA = 1.5W could go to heating the regulator.  That is enough for a free standing TO-220 to possibly get hot enough for the regulator to shut itself down.  This will happen at temperatures that will burn your finger.  If you can hold onto the regulator for a few seconds without hurting yourself, then overheating of the regulator is not the problem.

So, here are some things you need to do so this question can be answered more than above:

Show the schematic.

Measure the output of the transformer with nothing connected with a AC voltmeter.

Measure the output of the transformer with the circuit connected with a AC voltmeter.

Measure the raw DC after the diodes witha the voltmeter set to DC.

Measure the output of the regulator with a DC voltmeter.

Report all these measurements here.



Added after power supply schematic available:

That takes care of #1, still waiting for #2-6.

Some observations from the schematic:

1N4007 is a strange choice for the diodes.  They should work, but this can be done with 1N4001.  You don't need the very high voltage rating of the 1N4007.

You should have ceramic caps immediately accross the input and output of the regulator.  100nF to 1&micro;F is good enough.  These are to provide low impedance at high frequencies, which your electrolytics do not.  Without these caps the 7805 could oscillate.  In fact, that is one reason you could be measuring 4.4V on its output instead of 5V.

12V secondary is quite high if you just want to linearly regulate down to 5V.  You're going to burn up most of the power in heat.  That by itself may not be a problem, but dealing with the heat will be.  A 6V or so secondary would be significantly more efficient and allow for higher current before the 7805 shuts down due to getting too hot.