vllm/examples/online_serving/pooling/README.md

# Pooling models

## Cohere rerank usage

```bash
python examples/online_serving/pooling/cohere_rerank_client.py
```

## Jinaai rerank usage

```bash
python examples/online_serving/pooling/jinaai_rerank_client.py
```

## Named Entity Recognition (NER) usage

```bash
python examples/online_serving/pooling/ner_client.py
```

## Openai chat embedding for multimodal usage

```bash
python examples/online_serving/pooling/openai_chat_embedding_client_for_multimodal.py
```

## Openai classification usage

```bash
python examples/online_serving/pooling/openai_classification_client.py
```

## Openai embedding usage

```bash
python examples/online_serving/pooling/openai_embedding_client.py
```

## Openai embedding matryoshka dimensions usage

```bash
python examples/online_serving/pooling/openai_embedding_matryoshka_fy.py
```

## Openai pooling usage

```bash
python examples/online_serving/pooling/openai_pooling_client.py
```