internlm
/

internlm-xcomposer-7b

Text Generation

InternLMXComposer

feature-extraction

Model card Files Files and versions Community

myownskyW7 commited on Oct 19, 2023

Commit

3b3bafa

·

1 Parent(s): 1543e50

Update modeling_InternLM.py

Files changed (1) hide show

modeling_InternLM.py +1 -1

modeling_InternLM.py CHANGED Viewed

@@ -1241,6 +1241,6 @@ class InternLMForCausalLM(InternLMPreTrainedModel):
         reordered_past = ()
         for layer_past in past_key_values:
             reordered_past += (tuple(
-                past_state.index_select(0, beam_idx)
                 for past_state in layer_past), )
         return reordered_past

         reordered_past = ()
         for layer_past in past_key_values:
             reordered_past += (tuple(
+                past_state.index_select(0, beam_idx.to(past_state.device))
                 for past_state in layer_past), )
         return reordered_past