Skip to content

Commit 551f7ea

Browse files
authored
GPTJ demo fix and deprecation node [Release 2023.3] (#2304)
1 parent 887f3c2 commit 551f7ea

File tree

2 files changed

+5
-3
lines changed

2 files changed

+5
-3
lines changed

demos/gptj_causal_lm/python/README.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
1-
# GPT-J Causal Language Modeling Demo {#ovms_demo_gptj_causal_lm}
1+
# [DEPRECATED] GPT-J Causal Language Modeling Demo {#ovms_demo_gptj_causal_lm}
2+
3+
**This demo is deprecated and will be removed in 2024.0. Check out new [python demos](../../python_demos) for latest examples with language models.**
24

35
### Introduction
46
This demo illustrates usage of GPT-like models in OpenVINO™ Model Server. GPT-J 6B model used in this example can be found at [huggingface](https://huggingface.co/EleutherAI/gpt-j-6B) (~25GB). Steps below automate download and conversion steps to be able to load it using OpenVINO™. Example python client provided at the end of the document requests Model Server for the next word of the sentence until `EOS` (end of sequence) token is received.

demos/gptj_causal_lm/python/requirements.txt

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,6 @@ accelerate==0.20.3
22
numpy==1.23
33
torch==1.13.1
44
onnx==1.15.0
5-
optimum[openvino,nncf]==1.14.1
5+
optimum[openvino,nncf]>=1.14.1
66
ovmsclient
7-
openvino
7+
openvino==2023.2.0

0 commit comments

Comments
 (0)