GPU Temperature Trend

Retrieve the temperature trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/temperature/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of integer

GPU temperature by timestamp

itemsinteger

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Tensor Core Usage Trend

Retrieve the Tensor Core usage trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/tensor/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of float

GPU Tensor Core usage by timestamp

itemsfloat

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU GR Engine Usage Trend

Retrieve the GR Engine usage trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/gr-engine-utilize/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of integer

GPU GR Engine usage by timestamp

itemsinteger

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Power Consumption Trend

Retrieve the power consumption trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/power/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of float

GPU power consumption by timestamp

itemsfloat

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Framebuffer Memory Usage Trend

Retrieve the framebuffer memory usage trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/memory/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of float

GPU Framebuffer memory usage by timestamp

itemsfloat

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Timeslicing Status

Retrieve the Capacity and Used status when the GPU is used in Time-Slicing mode.

GET/v1/monitoring-gpu/metric/timeslicing/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

Target Metrics

UUIDstring

Universally Unique Identifier

Example: "GPU-79e36614..."

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

measurestring

Status

Example: "allocate"

modelNamestring

Resource Name

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

timestampinteger

Timestamp

Example: 1727159760

valueinteger

The number of resources in the status

Example: 1

Request

Response

GPU Temperature Trend

Retrieve the temperature trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/temperature/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of integer

GPU temperature by timestamp

itemsinteger

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Framebuffer Memory Usage

const response = await fetch('/v1/monitoring-gpu/metric/temperature/result/transition?clusterIds=text&start=text&end=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "gpu": "0",
      "model": "",
      "node": "cocktail-gpu-node-1"
    },
    "samples": [
      40,
      39,
      39
    ],
    "timestamps": [
      1727156220,
      1727156280,
      1727156340
    ],
    "values": null
  }
]

GPU Framebuffer Memory Usage

Retrieve the framebuffer memory usage rate for each GPU.

GET/v1/monitoring-gpu/metric/memory-rate/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

nodestring

Node Name

Example: "cocktail-gpu-node-1u"

timestampinteger

Timestamp

Example: 1727158980

valueinteger

GPU Framebuffer memory usage rate

Example: 0

Request

Response

GPU Instances

Retrieve GPU instance information (GPU, MIG).

GET/v1/monitoring-gpu/metric/model/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

대상 메트릭

UUIDstring

Universally Unique Identifier

Example: "GPU-79e36614..."

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

measurestring

Status

Example: "allocate"

modelNamestring

GPU Model Name

Example: "NVIDIA A30"

nodestring

Node Name

Example: "cocktail-gpu-node-1"

timestampinteger

Timestamps per time interval

Example: 1727159760

valueinteger

The number of GPUs in the status

Example: 1

Request

Response

GPU GR Engine Activation Ratio

Retrieve the average activation ratio of the GR Engine for each GPU.

GET/v1/monitoring-gpu/metric/gr-engine-rate/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

nodestring

Node Name

Example: "cocktail-gpu-node-1u"

timestampinteger

Timestamp

Example: 1727158980

valueinteger

GPU GR Engine activation rate

Example: 0

Request

Response

GPU GR Engine Usage Trend

Retrieve the GR Engine usage trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/gr-engine-utilize/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of integer

GPU GR Engine usage by timestamp

itemsinteger

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Tensor Core Usage Trend

Retrieve the Tensor Core usage trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/tensor/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of float

GPU Tensor Core usage by timestamp

itemsfloat

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

GPU Power Consumption Trend

Retrieve the power consumption trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/power/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of float

GPU power consumption by timestamp

itemsfloat

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

const response = await fetch('/v1/monitoring-gpu/metric/gr-engine-utilize/result/transition?clusterIds=text&start=text&end=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "gpu": "0",
      "model": "",
      "node": "cocktail-gpu-node-1"
    },
    "samples": [
      0,
      0,
      0
    ],
    "timestamps": [
      1727156220,
      1727156280,
      1727156340
    ],
    "values": null
  }
]

const response = await fetch('/v1/monitoring-gpu/metric/tensor/result/transition?clusterIds=text&start=text&end=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "gpu": "0",
      "model": "",
      "node": "cocktail-gpu-node-1"
    },
    "samples": [
      0,
      0,
      0
    ],
    "timestamps": [
      1727156220,
      1727156280,
      1727156340
    ],
    "values": null
  }
]

const response = await fetch('/v1/monitoring-gpu/metric/power/result/transition?clusterIds=text&start=text&end=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "gpu": "0",
      "model": "",
      "node": "cocktail-gpu-node-1"
    },
    "samples": [
      29.909,
      29.703,
      29.698
    ],
    "timestamps": [
      1727156220,
      1727156280,
      1727156340
    ],
    "values": null
  }
]

GPU Framebuffer Memory Usage Trend

Retrieve the framebuffer memory usage trend per minute for each GPU.

GET/v1/monitoring-gpu/metric/memory/result/transition

Query parameters

clusterIds*string

Cluster Id

start*string

Start date for the query

end*string

End date for the query

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

modelstring

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

samplesarray of float

GPU Framebuffer memory usage by timestamp

itemsfloat

timestampsarray of integer

Timestamps per time interval

itemsinteger

valuesinteger

Request

Response

const response = await fetch('/v1/monitoring-gpu/metric/memory/result/transition?clusterIds=text&start=text&end=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "gpu": "0",
      "model": "",
      "node": "cocktail-gpu-node-1"
    },
    "samples": [
      0,
      17,
      0
    ],
    "timestamps": [
      1727156220,
      1727156280,
      1727156340
    ],
    "values": null
  }
]

GPU Timeslicing Status

Retrieve the Capacity and Used status when the GPU is used in Time-Slicing mode.

GET/v1/monitoring-gpu/metric/timeslicing/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

Target Metrics

UUIDstring

Universally Unique Identifier

Example: "GPU-79e36614..."

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

measurestring

Status

Example: "allocate"

modelNamestring

Resource Name

Example: ""

nodestring

Node Name

Example: "cocktail-gpu-node-1"

timestampinteger

Timestamp

Example: 1727159760

valueinteger

The number of resources in the status

Example: 1

Request

Response

const response = await fetch('/v1/monitoring-gpu/metric/timeslicing/result/current?clusterIds=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "UUID": "GPU-79e36614...",
      "cluster": "gpu-cluster",
      "gpu": "0",
      "measure": "allocate",
      "modelName": "",
      "node": "cocktail-gpu-node-1"
    },
    "timestamp": 1727159760,
    "value": 1
  }
]

GPU GR Engine Activation Ratio

Retrieve the average activation ratio of the GR Engine for each GPU.

GET/v1/monitoring-gpu/metric/gr-engine-rate/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

nodestring

Node Name

Example: "cocktail-gpu-node-1u"

timestampinteger

Timestamp

Example: 1727158980

valueinteger

GPU GR Engine activation rate

Example: 0

Request

Response

GPU Instances

Retrieve GPU instance information (GPU, MIG).

GET/v1/monitoring-gpu/metric/model/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

대상 메트릭

UUIDstring

Universally Unique Identifier

Example: "GPU-79e36614..."

clusterstring

Cluster Id

Example: "gpu-cluster"

gpustring

GPU Index

Example: "0"

measurestring

Status

Example: "allocate"

modelNamestring

GPU Model Name

Example: "NVIDIA A30"

nodestring

Node Name

Example: "cocktail-gpu-node-1"

timestampinteger

Timestamps per time interval

Example: 1727159760

valueinteger

The number of GPUs in the status

Example: 1

Request

Response

GPU Framebuffer Memory Usage

Retrieve the framebuffer memory usage rate for each GPU.

GET/v1/monitoring-gpu/metric/memory-rate/result/current

Query parameters

clusterIds*string

Cluster Id

Response

Body

metricsMetrics (object)

Target Metrics

clusterstring

Cluster Id

Example: "gpu-cluster"

nodestring

Node Name

Example: "cocktail-gpu-node-1u"

timestampinteger

Timestamp

Example: 1727158980

valueinteger

GPU Framebuffer memory usage rate

Example: 0

Request

Response

const response = await fetch('/v1/monitoring-gpu/metric/gr-engine-rate/result/current?clusterIds=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "node": "cocktail-gpu-node-1u"
    },
    "timestamp": 1727158980,
    "value": 0
  }
]

const response = await fetch('/v1/monitoring-gpu/metric/model/result/current?clusterIds=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "UUID": "GPU-79e36614...",
      "cluster": "gpu-cluster",
      "gpu": "0",
      "measure": "allocate",
      "modelName": "NVIDIA A30",
      "node": "cocktail-gpu-node-1"
    },
    "timestamp": 1727159760,
    "value": 1
  }
]

const response = await fetch('/v1/monitoring-gpu/metric/memory-rate/result/current?clusterIds=text', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

[
  {
    "metrics": {
      "cluster": "gpu-cluster",
      "node": "cocktail-gpu-node-1u"
    },
    "timestamp": 1727158980,
    "value": 0
  }
]

Monitoring GPU

GPU Temperature Trend

GPU Framebuffer Memory Usage Trend

GPU Power Consumption Trend

GPU GR Engine Usage Trend

GPU Tensor Core Usage Trend

GPU GR Engine Activation Ratio

GPU Framebuffer Memory Usage

GPU Timeslicing Status

GPU Instances

GPU Temperature Trend

GPU Temperature Trend

GPU Tensor Core Usage Trend

GPU Tensor Core Usage Trend

GPU GR Engine Usage Trend

GPU GR Engine Usage Trend

GPU Power Consumption Trend

GPU Power Consumption Trend

GPU Framebuffer Memory Usage Trend

GPU Framebuffer Memory Usage Trend

Monitoring GPU

GPU Timeslicing Status

GPU Timeslicing Status

GPU Temperature Trend

GPU Framebuffer Memory Usage

GPU Framebuffer Memory Usage

GPU Instances

GPU Instances

GPU GR Engine Activation Ratio

GPU GR Engine Activation Ratio

GPU GR Engine Usage Trend

GPU Tensor Core Usage Trend

GPU Power Consumption Trend

GPU Framebuffer Memory Usage Trend

GPU Timeslicing Status

GPU GR Engine Activation Ratio

GPU Instances

GPU Framebuffer Memory Usage