Update README.md

README.md

@@ -30,6 +30,8 @@ tags:
 
 <h3>Maximizing Model Performance for All Quants Types And Full-Precision using Samplers, Advance Samplers and Parameters Guide</h3>
 
+(Updated: "INDEX", and added "Generation Steering" section)
+
 This document includes detailed information, references, and notes for general parameters, samplers and
 advanced samplers to get the most out of your model's abilities including notes / settings for the most popular AI/LLM app in use (LLAMACPP, KoboldCPP, Text-Generation-WebUI, LMStudio, Sillytavern, Ollama and others).
 
@@ -86,11 +88,16 @@ You will get higher quality operation overall - stronger prose, better answers,
 
 Review quant(s) information to select quant(s) to download, then review "Class 1,2,3..." for specific information on models followed by "Source Files...APPS to run LLMs/AIs". 
 
+"TESTING / Default / Generation Example PARAMETERS AND SAMPLERS" are the basic defaults for parameters, and samplers - the bare minimums. You should always set these first.
+
+The optional section "Generational Control And Steering of a Model / Fixing Model Issues on the Fly" covers methods to manually steer / edit / modify generation (as well as fixes) for any model.
+
 "Quick reference" will state the best parameter settings for each "Class" of model(s) to get the best operation and/or good defaults to use to get started. If you came to this page from a repo card on my repo -DavidAU- the "class" of the model would have been stated just before you came to this page.
 
 The detailed sections about parameters - Section 1 a,b,c and section 2 will help tune the model(s) operation.
 
-The "DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS" section after this covers and links to more information about "tuning" your model(s). These cover theory, hints, tips and tricks, and observations.
+The "DETAILED NOTES ON PARAMETERS, SAMPLERS and ADVANCED SAMPLERS" section after this covers and links to more information about "tuning" your model(s). These cover theory, hints, tips and tricks, and observations
+and how to fine control CLASS 3/4 models directly.
 
 All information about parameters, samplers and advanced samplers applies to ALL models, regardless of repo(s) you download them from.
 
@@ -112,9 +119,15 @@ SOURCE FILES for my Models / APPS to Run LLMs / AIs:
 -	SILLYTAVERN
 -	OTHER PROGRAMS
 
-TESTING / Generation Example PARAMETERS AND SAMPLERS
+TESTING / Default / Generation Example PARAMETERS AND SAMPLERS
+
+Generational Control And Steering of a Model / Fixing Model Issues on the Fly
+- Multiple Methods to Steer Generation on the fly
+- On the fly Class 3/4 Steering / Generational Issues and Fixes (also for any model/type)
+- Advanced Steering / Fixing Issues (any model, any type) and "sequenced" parameter/sampler change(s)
 
 Quick Reference Table - Parameters, Samplers, Advanced Samplers
+- Quick setup for all model classes for automated control / smooth operation.
 
 Section 1a : PRIMARY PARAMETERS - ALL APPS
 Section 1b : PENALITY SAMPLERS - ALL APPS
@@ -499,6 +512,138 @@ These parameters/settings are considered both safe and default and in most cases
 Note for Class 3/Class 4 models (discussed below) "repeat-last-n" is a CRITICAL setting.
 
 
+---
+
+<H2>Generational Control And Steering of a Model / Fixing Model Issues on the Fly</h2>
+
+---
+
+<B>Multiple Methods to Steer Generation on the fly</B>
+
+Now that you have the basic parameters and samplers from the previous section, I will cover Generational Control and Steering.
+
+This section will also cover how to deal with Class 3/4 issues directly, as well as general issues than can happen with any "class" of model during generation.
+
+There is a very important concept that must be covered first:
+
+The output/generation/answer to your prompt/instructions BECOMES part of your "prompt" after you click STOP, and then click on "CONTINUE".
+
+Likewise is true in multi-turn chat, role play, or in a "chat window" so to speak.
+
+Your prompts AND the model's "answers"/"generation" all become part of the "ROADMAP" for the model to use in whatever journey you are on.
+
+When you hit "REGEN" this nullifies only the last "generation" - not the prompt before it, nor the prompt(s)/generation(s) in the same chat.
+
+The part I will cover here is once a generation has started, from a single prompt (no other prompts/generations in the chat).
+
+So we have a prompt:
+
+Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
+
+Generation starts ... and then ends.
+
+Then you hit regen however many times to get a "good" generation.
+
+There is a better way.
+
+Generation starts... 200 words in you think... this is not going in the right direction.
+
+Do you hit stop? Then regen? 
+
+There are a lot more options:
+
+1 - Hit Stop.
+
+2 - Select "EDIT" -> Edit out the part(s) you don't want AND/OR add in STEERING "text" (statement, phrase, paragraph, even a single word) (anywhere in the "generation" text).
+
+3 - Hit Continue. 
+
+Once you hit "continue" the change(s) you made will now steer the models choices. 
+
+The LAST edit (bottom of the generation) will have the most impact. However ALL EDITS will affect generation as these become part of the generational "ROADMAP".
+
+You can repeat this process at will.
+
+Eventually the model will come to a "natural" stopping point. 
+
+If you want to model to continue past this model, delete a few lines AND "steer" it.
+
+These methods apply to all generation types - not just a "scene" or "story", but "programming code", "article", "conclusions", "analytics", ... you name it.
+
+Notes: 
+- For Text Generation Webui, you can transfer your "chat" to "notebook" for easy Stop/Edit/Continue function.
+- For Silly Tavern -> This is built in.
+- For LMStudio -> This is built in.
+- For API (direct control) you have to send the "chat" elements back to the "server" with the "edits" (send the whole "revised" chat as a json payload).
+
+<B>On the fly Class 3/4 Steering / Generational Issues and Fixes (also for any model/type):</B>
+
+Generational issues can occur such as letter(s), word(s), phrase(s), paragraph repeat(s), "rants" etc etc which can occur at any point during generation.
+
+This can happen to ANY model, any type ; however with Class 3/4 models there is a higher chance this will occur because of how these models operate.
+
+The "Quick Reference" and Detailed Parameters, Samplers and Advanced Samplers (below) cover how to set the model "controls" to do this automatically.
+
+However, sometimes these settings MAY trim too much (ie creativity, "madness", nuance, emotion, even the "right answer(s) etc etc) sometimes, so I will show you how to address these issues directly.
+
+If you have a letter(s) and/or word(s) repeat:
+
+- Stop generation, edit out this, and back ONE OR TWO lines (delete) 
+- Hit continue. 
+- Better: Do these steps, and add "steering" (last line -> word, phrase, sentence)
+
+If you have single or multiple paragraph repeat(s):
+
+- Stop generation, edit out all the paragraph(s), and back ONE OR TWO lines OR last NON repeating paragraph (delete) 
+- Hit continue. 
+- Better: Do these steps, and add "steering" (last line -> word, phrase, sentence or paragraph)
+
+<B>Advanced Steering / Fixing Issues (any model, any type) and "sequenced" parameter/sampler change(s)</B>
+
+This will drastically (depending on changes you make) change up "Continue(d)" generation(s):
+
+- Do the edits above (steering and/or "steering fixes"), but before you click "Continue" (after your "Edit(s)"), adjust the parameter(s), sampler(s) and advanced sampler(s) settings.
+- Once you do this BEFORE hitting "Continue" your new settings will be applied to all generation from your new "Continue" point.
+- You can repeat this process at will. 
+- You can also hit "stop", make NO EDIT(S), adjust the parameter(s), sampler(s) and advanced sampler(s) settings and hit "Continue" and the new settings will take effect from the "stop point" going forward.
+
+<B>"Cold" Editing/Generation</B>
+
+Let say you have a generation, but you want to edit it later IN A NEW CHAT.
+
+Sometimes you can just copy/paste the generation and the model MAY get the "IDEA" and continue the generation without a prompt or direction.
+
+However this does not always work.
+
+So you need something along these lines (adjust accordingly):
+
+Instructions: Continue this scene, using vivid and graphic details.
+
+SCENE:
+
+(previous generation)
+
+Note the structure, layout and spacing.
+
+If it was programming code:
+
+Instructions: Continue this javascript, [critical instructions here for "code" goals]
+
+JAVASCRIPT:
+
+(previous generation)
+
+You may want to include the ENTIRE prior prompt (with some modifications) used in the first generation:
+
+Instructions: Continue the scene below (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
+
+SCENE:
+
+(previous generation)
+
+NOTE: 
+
+You may want to modify the instructions to provide a "steering" continue point and/or "goal" for the generation to the model has some idea how to proceed.
 
 ---