Update index.html
Browse files- index.html +3 -3
index.html
CHANGED
|
@@ -81,12 +81,12 @@ Exploring Refusal Loss Landscapes </title>
|
|
| 81 |
<p>Current transformer-based LLMs will return different responses to the same query due to the randomness of
|
| 82 |
autoregressive sampling-based generation. With this randomness, it is an
|
| 83 |
interesting phenomenon that a malicious user query will sometimes be rejected by the target LLM, but
|
| 84 |
-
sometimes be able to bypass the safety guardrail. Based on this observation,
|
| 85 |
-
|
| 86 |
</p>
|
| 87 |
|
| 88 |
<div class="container jailbreak-intro-sec">
|
| 89 |
-
<div><img id="jailbreak-intro-img" src="
|
| 90 |
</div>
|
| 91 |
|
| 92 |
<div id="refusal-loss-formula" class="container">
|
|
|
|
| 81 |
<p>Current transformer-based LLMs will return different responses to the same query due to the randomness of
|
| 82 |
autoregressive sampling-based generation. With this randomness, it is an
|
| 83 |
interesting phenomenon that a malicious user query will sometimes be rejected by the target LLM, but
|
| 84 |
+
sometimes be able to bypass the safety guardrail. Based on this observation, we propose a new concept called Refusal Loss and visualize its 2-d
|
| 85 |
+
landscape below:
|
| 86 |
</p>
|
| 87 |
|
| 88 |
<div class="container jailbreak-intro-sec">
|
| 89 |
+
<div><img id="jailbreak-intro-img" src="./loss_landscape.png" /></div>
|
| 90 |
</div>
|
| 91 |
|
| 92 |
<div id="refusal-loss-formula" class="container">
|