> ## Documentation Index
> Fetch the complete documentation index at: https://docs.nscale.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Inferencing

> Manage inferencing resources — list models, endpoints, and send chat completions.

**Aliases:** `inferencing`, `infer`

## Subcommands

* [model list](#model-list) — List available models
* [endpoint list](#endpoint-list) — List inferencing endpoints
* [chat](#chat) — Send a chat completion request

> [!NOTE]
>
> CLI v7.0.0 renamed `list-models` to `model list` and `list-endpoints` to `endpoint list`. The old names still work but are hidden from help.

***

## model list

Returns a list of all models available on the serverless platform.

```bash theme={null}
nscale inferencing model list [flags]
```

**Aliases:** `model`, `models`; `list`, `ls`

### Flags

<table>
  <thead><tr><th>Flag</th><th>Description</th></tr></thead>

  <tbody>
    <tr>
      <td>
        `--json`
      </td>

      <td>Emit the full JSON payload (mutually exclusive with `-q`)</td>
    </tr>

    <tr>
      <td>
        `-q, --query stringArray`
      </td>

      <td>jq filter for value extraction (see [Query output with `-q`](https://docs.nscale.com/docs/cli/query-output))</td>
    </tr>

    <tr>
      <td>
        `--limit int`
      </td>

      <td>Show at most N results (client-side; every result is still fetched). Cuts before `-q`. `0` for all</td>
    </tr>
  </tbody>
</table>

`--json` prints a bare JSON array of models.

### Examples

```bash theme={null}
nscale inferencing model list
nscale inferencing model list -q '.[].id' -q '.[].owned_by'
nscale inferencing model list --json | jq -r '.[].id'
```

***

## endpoint list

Returns a list of all model endpoints available for use by the specified organization.

```bash theme={null}
nscale inferencing endpoint list [flags]
```

**Aliases:** `endpoint`, `endpoints`; `list`, `ls`

### Flags

<table>
  <thead><tr><th>Flag</th><th>Description</th></tr></thead>

  <tbody>
    <tr><td>`--org string`</td><td>Organization ID or name</td></tr>

    <tr>
      <td>
        `--json`
      </td>

      <td>Emit the full JSON payload (mutually exclusive with `-q`)</td>
    </tr>

    <tr>
      <td>
        `-q, --query stringArray`
      </td>

      <td>jq filter for value extraction (see [Query output with `-q`](https://docs.nscale.com/docs/cli/query-output))</td>
    </tr>

    <tr>
      <td>
        `--limit int`
      </td>

      <td>Show at most N results (client-side; every result is still fetched). Cuts before `-q`. `0` for all</td>
    </tr>
  </tbody>
</table>

`--json` prints a bare JSON array of endpoints.

### Examples

```bash theme={null}
nscale inferencing endpoint list --org <org-id>
nscale inferencing endpoint list -q '.[].id' -q '.[].name'
nscale inferencing endpoint list -q '.[] | select(.model_type == "TextGeneration") | .id'
```

***

## chat

Send a chat completion request to the inference API using a configuration file. Supports both batch and interactive modes.

```bash theme={null}
nscale inferencing chat [flags]
```

### Flags

| Flag | Description |
| - | - |
| `--config string` | Path to a chat configuration file (JSON). Required unless you pass `--ui` |
| `--messages string` | Path to a JSON+LD file containing additional messages |
| `--ui` | Launch interactive chat TUI |

### Reasoning content

When you use the interactive TUI (`--ui`) with a model that supports reasoning, the model's thought process appears in a separate "Thought Process" bubble above the response. The reasoning streams live as the model works through the problem, and the final answer appears in the standard response bubble once reasoning is complete.

This gives you visibility into how the model arrives at its answer without cluttering the final response.

### Examples

```bash theme={null}
# Send a chat completion using a config file
nscale inferencing chat --config chat-config.json

# Launch the interactive chat TUI
nscale inferencing chat --ui

# Include additional messages from a file
nscale inferencing chat --config chat-config.json --messages extra-messages.json
```

***

## Related

> [card] [Models](https://docs.nscale.com/docs/ai-services/models.md)
>
> Learn about available models on the Nscale platform.

> [card] [Chat Use Case](https://docs.nscale.com/docs/use-cases/chat.md)
>
> End-to-end guide for chat inferencing.
