Can we use the Tierra approach to optimize machine code?
Yes it has been tried. In fact there is a whole field, dubbed Genetic Programming.

There is an annual competition to obtain "Human-Competitive" algorithms, and many instances of those have been found over the years.