change convolution function if signal is above threshold?
Is there a name for such a kind of filter?


No. (Ok, there probably is, but it's not commonly used)

The point is that your filter is not a linear system, and thus has properties that make it unsuitable for most applications. Hence, I'd neither heard of someone using it, nor of someone giving it a name.