Add Openlayer to Logging / Monitoring / Eval

Author: vikasnair

README.md

@@ -13,20 +13,24 @@ We also included [Perplexity and Cursor.sh prompts](#formatting-prompt-templates
 
 ## Table of Contents
 
-1. [Data Pipelines](#data-pipelines)
-2. [Embedding Models](#embedding-models)
-3. [Vector Databases](#vector-databases)
-4. [Playgrounds](#playgrounds)
-5. [Orchestrators](#orchestrators)
-6. [APIs / Plugins](#apis--plugins)
-7. [LLM Caches](#llm-caches)
-8. [Logging / Monitoring / Eval](#logging--monitoring--eval)
-9. [Validators](#validators)
-10. [LLM APIs (proprietary)](#llm-apis-proprietary)
-11. [LLM APIs (open source)](#llm-apis-open-source)
-12. [App Hosting Platforms](#app-hosting-platforms)
-13. [Cloud Providers](#cloud-providers)
-14. [Opinionated Clouds](#opinionated-clouds)
+- [LLM App Stack](#llm-app-stack)
+  - [Table of Contents](#table-of-contents)
+  - [Project List](#project-list)
+    - [Data Pipelines](#data-pipelines)
+    - [Embedding Models](#embedding-models)
+    - [Vector Databases](#vector-databases)
+    - [Playgrounds](#playgrounds)
+    - [Orchestrators](#orchestrators)
+    - [APIs / Plugins](#apis--plugins)
+    - [LLM Caches](#llm-caches)
+    - [Logging / Monitoring / Eval](#logging--monitoring--eval)
+    - [Validators](#validators)
+    - [LLM APIs (proprietary)](#llm-apis-proprietary)
+    - [LLM APIs (open source)](#llm-apis-open-source)
+    - [App Hosting Platforms](#app-hosting-platforms)
+    - [Cloud Providers](#cloud-providers)
+    - [Opinionated Clouds](#opinionated-clouds)
+  - [Formatting Prompt Templates](#formatting-prompt-templates)
 
 
 
@@ -115,6 +119,7 @@ We also included [Perplexity and Cursor.sh prompts](#formatting-prompt-templates
 ### Logging / Monitoring / Eval
 | Name (site) | Description | Github | Pip Installs |
 |------------|------------|------------|------------|
+| [Openlayer](https://www.openlayer.com/) | Openlayer is a platform and SDK for monitoring, evaluating, and versioning LLMs.| <a href=https://github.com/openlayer-ai><img src="https://img.shields.io/github/stars/openlayer-ai?style=social" width=90/></a> | <a href=https://pypi.org/project/openlayer><img src="https://img.shields.io/pypi/dw/openlayer" width=150/></a> |
 | [Braintrust Data](https://www.braintrustdata.com/) | An AI product stack featuring evaluations, prompt playgrounds, continuous integration, dataset management, and access to various AI models through a single API | <a href=https://github.com/braintrustdata/braintrust-proxy><img src="https://img.shields.io/github/stars/braintrustdata/braintrust-proxy?style=social" width=90/></a> | <a href=https://pypi.org/project/braintrust><img src="https://img.shields.io/pypi/dw/braintrust" width=150/></a> |
 | [Arize AI](https://arize.com/) | An observability platform for both LLMs and supervised ML | <a href=https://github.com/Arize-ai><img src="https://img.shields.io/github/stars/Arize-ai?style=social" width=90/></a> | <a href=https://pypi.org/project/arize><img src="https://img.shields.io/pypi/dw/arize" width=150/></a> |
 | [Weights & Biases](https://wandb.ai) | An MLOps platform for streamlining ML workflows | <a href=https://github.com/wandb/wandb><img src="https://img.shields.io/github/stars/wandb/wandb?style=social" width=90/></a> | <a href=https://pypi.org/project/wandb><img src="https://img.shields.io/pypi/dw/wandb" width=150/></a> |