Skip to content

Commit 55ce311

Browse files
committed
adding config template
1 parent b444c46 commit 55ce311

File tree

2 files changed

+10
-2
lines changed

2 files changed

+10
-2
lines changed

service/python/config.json.txt

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
{
2+
"compartment_id": "<your_compartment_id>",
3+
"config_profile": "<your_config_profile>",
4+
"service_endpoint": "https://inference.generativeai.us-chicago-1.oci.oraclecloud.com",
5+
"model_type": "<cohere|llama>",
6+
"cohere_model_id": "<your_cohere_model_id>",
7+
"llama_model_id": "<your_llama_model_id>"
8+
}

service/python/server.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212
with open('config.json') as f:
1313
config = json.load(f)
1414

15-
# Load configuration parameters
15+
# Load configuration parameters
1616
compartment_id = config['compartment_id']
1717
CONFIG_PROFILE = config['config_profile']
1818
endpoint = config['service_endpoint']
@@ -172,6 +172,6 @@ async def handle_websocket(websocket, path):
172172

173173
async def start_server():
174174
async with websockets.serve(handle_websocket, "localhost", 1986, max_size=200000000):
175-
await asyncio.Future() # run forever
175+
await asyncio.Future()
176176

177177
asyncio.run(start_server())

0 commit comments

Comments
 (0)