Removing deck frame attached to siding
Going by the drip edge over top the ledger it appears indeed that there is siding behind the ledger.
You can confirm this by measuring the distance from the front of the cut joist to the siding and on its other side to the ledger, and there would be 1.5in difference.
The ledger may be nailed all the way through the siding and through any sheathing into the bottom plate, which is structural. Expect long and strong 8d nails.
You should thus be able to remove the ledger and the siding will appear behind it, which you can then paint to match.
You can remove the drip edge, and lever off the ledger with a break iron etc.. An alternative is to cut the ledger's nails by carefully cutting between the ledger and the siding, reaching in from the top, with a 6in reciprocal saw.