Spaces:

rphrp1985
/

zerogpu

Running on Zero

rphrp1985 commited on Jan 30

Commit

ce6dc13

verified ·

1 Parent(s): a8381f0

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -196,9 +196,9 @@ def respond(
     for new_token in streamer:
         print(new_token," ")
         outputs.append(new_token)
-        if new_token in stop_tokens:
-            break
-        yield "".join(outputs)
     # yield 'retuend'
     # model.to(accelerator.device)

     for new_token in streamer:
         print(new_token," ")
         outputs.append(new_token)
+    yield "".join(outputs)
     # yield 'retuend'
     # model.to(accelerator.device)