You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Now you either have to deploy an Azure Open AI service to use the OpenAI API, or you can use a local emulator based on Ollama and an open-source LLM.
27
+
28
+
#### Using Azure Open AI
29
+
26
30
You first need to deploy an Azure Open AI service to use the OpenAI API.
27
31
28
32
Before moving to the next section, go to the **Azure setup** section (either on the left or using the "hamburger" menu depending of your device) to deploy the necessary resources and create your `.env` file needed.
@@ -41,4 +45,38 @@ With:
41
45
QDRANT_URL="http://localhost:6333"
42
46
```
43
47
48
+
#### (Optional) Using Ollama and ollamazure
49
+
50
+
If you have a machine with enough resources, you can run this workshop entirely locally without using any cloud resources. To do that, you first have to install [Ollama](https://ollama.com) and then run the following commands to download the models on your machine:
51
+
52
+
```bash
53
+
ollama pull phi3
54
+
ollama pull all-minilm:l6-v2
55
+
```
56
+
57
+
<divclass="info"data-title="Note">
58
+
59
+
> The `phi3` model with download a few gigabytes of data, so it can take some time depending on your internet connection.
60
+
61
+
</div>
62
+
63
+
<divclass="important"data-title="Important">
64
+
65
+
> Ollama work in GitHub Codespaces, but runs very slow currently. If you want to use the Ollama option, it will work best if you are working on the workshop on your local machine directly.
66
+
67
+
</div>
68
+
69
+
Once the model are downloaded, create a `.env` file at the root of the project, and add the following content:
70
+
71
+
```
72
+
AZURE_OPENAI_API_ENDPOINT=http://localhost:4041
73
+
QDRANT_URL=http://localhost:6333
74
+
```
75
+
76
+
Finally, run this command to start the Azure OpenAI emulator and leave it running in the background:
0 commit comments