<p dir="auto">Hello,</p>
<p dir="auto">please can you add an <code class="notranslate">exclude_from_weight_decay</code> parameter to AdamW? Some parameters during weight decay must be excluded.</p>
<p dir="auto">For more details please look <a href="https://github.com/tensorflow/addons/issues/2681" data-hovercard-type="issue" data-hovercard-url="/tensorflow/addons/issues/2681/hovercard">here</a>.</p>
<p dir="auto">Thanks a lot.<br>
Have a nice day.</p>
<p dir="auto">Hello,</p>
<p dir="auto">Would be interested to port <code class="notranslate">RectifiedAdam</code> from <strong>tensorflow/addon</strong> with addding exclude_from_weight_decay extension?</p>
<p dir="auto">For more details <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="1161977617" data-permission-text="Title is private" data-url="https://github.com/tensorflow/addons/issues/2681" data-hovercard-type="issue" data-hovercard-url="/tensorflow/addons/issues/2681/hovercard" href="https://github.com/tensorflow/addons/issues/2681">tensorflow/addons#2681</a></p>
<p dir="auto">Thanks a lot.<br>
Have a nice day.</p>