注意

使用 Ray Serve 大规模部署 PyTorch 模型#

本教程展示了如何使用具备生产级功能的 Ray Serve 来部署 PyTorch 模型。

您将学到什么

如何创建可扩展至数千个节点和 GPU 的生产级 PyTorch 模型部署
如何使用 FastAPI 为部署配置 HTTP 端点
启用动态请求批处理以获得更高的吞吐量
配置自动伸缩（Autoscaling）及每个副本的 CPU/GPU 资源分配
使用并发请求对服务进行负载测试，并使用 Ray 仪表板进行监控
Ray Serve 部署如何从故障中自动恢复
Ray Serve 的高级功能，如模型多路复用（Model Multiplexing）和模型组合（Model Composition）。

先决条件

PyTorch v2.9+ 和 torchvision
Ray Serve (ray[serve]) v2.52.1+
建议使用 GPU 以获得更高吞吐量，但非必需

Ray Serve 是一个用于在生产环境中部署机器学习模型的可扩展框架。它构建于 Ray 之上，Ray 是一个统一的 AI 和 Python 应用扩展框架，简化了分布式计算的复杂性。Ray 同时也是开源项目，且是 PyTorch 基金会的一部分。

设置#

要安装依赖项，请运行：

pip install "ray[serve]" torch torchvision

首先导入所需的库

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

定义 PyTorch 模型#

为 MNIST 数字分类数据集定义一个简单的卷积神经网络

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

定义 Ray Serve 部署#

要使用 Ray Serve 部署此模型，请将模型包装在一个 Python 类中，并使用 @serve.deployment 装饰它。

批量处理请求比逐个处理效率更高，尤其是在使用 GPU 时。Ray Serve 提供了对动态请求批处理的内置支持，可以机会性地将单个传入请求进行批处理。如下面的代码所示，使用 @serve.batch 装饰器即可启用动态批处理。

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

这是一个 FastAPI 应用，它通过 Pydantic 自动请求验证、自动生成的 OpenAPI 风格 API 文档等功能扩展了 Ray Serve。

配置自动伸缩和资源分配#

在生产环境中，流量可能会有很大波动。Ray Serve 的自动伸缩功能会根据流量负载自动调整副本数量，确保您在高峰期拥有足够的容量，并在低谷期节省资源。Ray Serve 可以扩展至包含数千个节点和副本的超大规模部署。

您还可以指定每个副本的资源分配，例如 CPU 或 GPU 的数量。Ray Serve 会处理这些资源在集群中的编排。Ray 还支持分片 GPU，当模型足够小以至于可以共同放入内存时，允许多个副本共享单个 GPU。

以下是一个带有自动伸缩和资源分配的配置示例：

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

该应用已准备好部署。假设您在一个由 10 台机器组成的集群上运行它，每台机器有 4 个 GPU。通过 num_gpus=0.5，Ray 会在每个 GPU 上调度 2 个副本，从而在整个集群中提供 80 个副本。此配置允许部署根据需要弹性扩展至 80 个副本以处理流量峰值，并在流量平息时缩减回 1 个副本。

使用并发请求测试端点#

要部署应用，请使用 serve.run 函数

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-06-03 00:26:44,403 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-06-03 00:26:46,575 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4644) INFO 2026-06-03 00:26:49,129 proxy 172.17.0.2 -- Proxy starting on node 8e3356ec1aace84e824836ca1fb0218de829d7b69a416d6e2bd8ae51 (HTTP port: 8000).
INFO 2026-06-03 00:26:49,202 serve 3837 -- Started Serve in namespace "serve".
(ProxyActor pid=4644) INFO 2026-06-03 00:26:49,199 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4645) INFO 2026-06-03 00:26:49,283 controller 4645 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4645) INFO 2026-06-03 00:26:49,283 controller 4645 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4644) INFO 2026-06-03 00:26:49,287 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4644) INFO 2026-06-03 00:26:49,294 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f8388a2e260>.
(ServeController pid=4645) INFO 2026-06-03 00:26:49,388 controller 4645 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4644) INFO 2026-06-03 00:26:53,608 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-06-03 00:26:54,326 serve 3837 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

您将看到类似以下的输出：

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

该应用现在正在监听端口 8000 上的请求。

要测试部署，您可以使用 aiohttp 并发发送大量请求。以下代码演示了如何向该应用发送 1000 个并发请求：

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="https://:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,451 mnist_classifier_MNISTClassifier ql67vb0i cc54fb4e-64fb-464c-bb08-2e3b656c672f -- POST / 200 450.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,452 mnist_classifier_MNISTClassifier ql67vb0i 3745c189-6e1c-40de-bc4c-5c2581f3f6c0 -- POST / 200 433.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,452 mnist_classifier_MNISTClassifier ql67vb0i 393dab30-aa38-4fc7-bae2-960fac1b266e -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,452 mnist_classifier_MNISTClassifier ql67vb0i 36dd8e00-c905-4ccf-a1fb-24a1daf21791 -- POST / 200 429.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,453 mnist_classifier_MNISTClassifier ql67vb0i deaa2b23-38b9-4ea4-b291-895cf171375b -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,453 mnist_classifier_MNISTClassifier ql67vb0i 29cf71f3-1260-4b74-9a1d-3eaf1270df52 -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,454 mnist_classifier_MNISTClassifier ql67vb0i bf56a9d4-7abc-4ed7-99f1-96916b6a78b7 -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,455 mnist_classifier_MNISTClassifier ql67vb0i 9278ab55-48e9-46e1-b6f7-a7081ed00087 -- POST / 200 428.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,456 mnist_classifier_MNISTClassifier ql67vb0i a1c885f3-d75a-42be-b3a1-fe20285145e4 -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,459 mnist_classifier_MNISTClassifier ql67vb0i 0f183898-4948-494e-865a-1412c617faf4 -- POST / 200 429.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,459 mnist_classifier_MNISTClassifier ql67vb0i 57f0e1d0-16cb-4b01-bae7-920a1da5ecd2 -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,459 mnist_classifier_MNISTClassifier ql67vb0i aebdbf5e-cc9d-4494-826b-25b861197b65 -- POST / 200 427.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,460 mnist_classifier_MNISTClassifier ql67vb0i 4c88d401-d688-494d-aacb-227b5615136f -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,461 mnist_classifier_MNISTClassifier ql67vb0i d4605bcc-48e0-4af3-a2e8-88818f233832 -- POST / 200 425.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,462 mnist_classifier_MNISTClassifier ql67vb0i b250722f-e6ee-435a-9fbb-a3fc9ce7025f -- POST / 200 426.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,465 mnist_classifier_MNISTClassifier ql67vb0i 475adb2b-68ff-41b2-bd53-530c9516b7ff -- POST / 200 428.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,466 mnist_classifier_MNISTClassifier ql67vb0i 1bb61b6d-e34c-4840-8c19-6fb4ba6f6575 -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,468 mnist_classifier_MNISTClassifier ql67vb0i 94d4e9ab-eba1-42cf-82d7-ad9a2602ffdf -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,468 mnist_classifier_MNISTClassifier ql67vb0i 2f462995-a21e-472f-8030-9d093d0dc128 -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,469 mnist_classifier_MNISTClassifier ql67vb0i bf9c9e5f-af65-4db2-8b49-417132a32285 -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,469 mnist_classifier_MNISTClassifier ql67vb0i 69d78eae-f9ec-46ab-809d-569b73abd794 -- POST / 200 427.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,470 mnist_classifier_MNISTClassifier ql67vb0i 9b95c4f0-8a99-4aeb-9329-83523def32e7 -- POST / 200 427.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,471 mnist_classifier_MNISTClassifier ql67vb0i 95d5860c-27b4-4b56-a84e-51f351627830 -- POST / 200 425.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,473 mnist_classifier_MNISTClassifier ql67vb0i dea652fc-c56b-4c65-a5e9-c79f67d64dea -- POST / 200 424.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,479 mnist_classifier_MNISTClassifier ql67vb0i fb0382e3-8b26-4f8c-bf1c-5b35a8359a7a -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,480 mnist_classifier_MNISTClassifier ql67vb0i 148d1e69-80cb-4a25-8c18-8bf61693136a -- POST / 200 426.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,481 mnist_classifier_MNISTClassifier ql67vb0i aac7badb-5a04-42cd-a782-af941fa3f0c6 -- POST / 200 426.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,482 mnist_classifier_MNISTClassifier ql67vb0i c11a6b95-7340-4d92-b834-f43b8473d4f5 -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,483 mnist_classifier_MNISTClassifier ql67vb0i 4de3203a-36ce-45d7-8d0a-c830a973a640 -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,484 mnist_classifier_MNISTClassifier ql67vb0i 5b575d98-61d2-4358-893e-80fd82944a6f -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,549 mnist_classifier_MNISTClassifier ql67vb0i ae4b04bb-a963-4a2c-ae24-ea19649e5d68 -- POST / 200 492.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,552 mnist_classifier_MNISTClassifier ql67vb0i e9e526e5-57df-4b0e-9522-55e7ea8f5736 -- POST / 200 495.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,553 mnist_classifier_MNISTClassifier ql67vb0i db39ef60-5fd8-4c03-9e14-442b3ca50e99 -- POST / 200 495.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,553 mnist_classifier_MNISTClassifier ql67vb0i b2a1e452-a4f4-48a4-a4eb-21b044d669d0 -- POST / 200 496.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,554 mnist_classifier_MNISTClassifier ql67vb0i c6bcbda1-47f8-44c3-8eca-06360f6f403b -- POST / 200 495.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,555 mnist_classifier_MNISTClassifier ql67vb0i 78d0d928-b63a-4c26-8475-fa634412e1b6 -- POST / 200 495.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,556 mnist_classifier_MNISTClassifier ql67vb0i fe76dcdb-586e-4191-9a8c-a01c07e3e487 -- POST / 200 495.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,556 mnist_classifier_MNISTClassifier ql67vb0i 7a095118-bf77-4f6e-887a-668ad71c976f -- POST / 200 493.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,556 mnist_classifier_MNISTClassifier ql67vb0i cc647373-0388-49a0-b150-e4a17435f2ba -- POST / 200 492.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,557 mnist_classifier_MNISTClassifier ql67vb0i 0c1f4a5e-c372-40c8-8a72-01e900176966 -- POST / 200 491.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,557 mnist_classifier_MNISTClassifier ql67vb0i 76faf836-3243-4dc9-9182-e85ebc542ad3 -- POST / 200 491.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,561 mnist_classifier_MNISTClassifier ql67vb0i 07ad5a62-38d9-4a55-8d37-4e9358921a26 -- POST / 200 495.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,563 mnist_classifier_MNISTClassifier ql67vb0i 9b101db2-2cec-4adf-bcd5-5e6f8d54e0c4 -- POST / 200 496.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,790 mnist_classifier_MNISTClassifier ql67vb0i dbad8e86-8713-488c-9936-8bfe551f1198 -- POST / 200 720.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,791 mnist_classifier_MNISTClassifier ql67vb0i 7b681eb3-da72-4c13-a3b3-3d2c7e905030 -- POST / 200 718.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,794 mnist_classifier_MNISTClassifier ql67vb0i 72fd0371-8e20-4d33-8cbf-f5d820305505 -- POST / 200 719.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,794 mnist_classifier_MNISTClassifier ql67vb0i d1fea3d8-6c76-43f0-a71f-800efd11988b -- POST / 200 719.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,796 mnist_classifier_MNISTClassifier ql67vb0i 263f28d9-8ff1-4a0c-9f8a-20da5b6cd9da -- POST / 200 720.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,803 mnist_classifier_MNISTClassifier ql67vb0i b75b576a-6b89-4523-9fef-fa710328f40d -- POST / 200 726.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,804 mnist_classifier_MNISTClassifier ql67vb0i ee249633-a499-426b-bad6-185ccca22098 -- POST / 200 727.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,805 mnist_classifier_MNISTClassifier ql67vb0i fcd6b3f2-4d05-446d-93ce-bfed222e7f7c -- POST / 200 725.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,811 mnist_classifier_MNISTClassifier ql67vb0i 9acc35db-f6a1-41b5-8e13-7c3a927c47c7 -- POST / 200 727.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,811 mnist_classifier_MNISTClassifier ql67vb0i 3bff5921-b258-4eb2-b0ef-6b513c0d537f -- POST / 200 727.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,812 mnist_classifier_MNISTClassifier ql67vb0i 7659ed97-4b45-40eb-8c39-fbe1072762b8 -- POST / 200 726.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,812 mnist_classifier_MNISTClassifier ql67vb0i 46e24c2d-fbb3-4b93-998b-8884f0a8e7cd -- POST / 200 726.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,813 mnist_classifier_MNISTClassifier ql67vb0i 0ff70ccf-47ef-4629-9a1d-0efa39163a42 -- POST / 200 726.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,813 mnist_classifier_MNISTClassifier ql67vb0i 964c7152-2ff9-4129-8bab-5938e764017a -- POST / 200 723.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,813 mnist_classifier_MNISTClassifier ql67vb0i aad87ec1-0586-4547-8b5c-b469239a2c68 -- POST / 200 723.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,814 mnist_classifier_MNISTClassifier ql67vb0i 0ec3869b-b115-4206-b305-28fdab373436 -- POST / 200 723.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,814 mnist_classifier_MNISTClassifier ql67vb0i fcb6228c-0ea1-4fb7-a811-a62b6ab49ff0 -- POST / 200 718.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,814 mnist_classifier_MNISTClassifier ql67vb0i 9ab90e43-8004-49f0-9396-c053a7a8d5d7 -- POST / 200 715.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,815 mnist_classifier_MNISTClassifier ql67vb0i 9f5973aa-1872-414e-b041-2019b3652647 -- POST / 200 716.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,816 mnist_classifier_MNISTClassifier ql67vb0i 9b803b79-0b0e-47b7-9e12-0966afe49cd9 -- POST / 200 716.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,817 mnist_classifier_MNISTClassifier ql67vb0i 80ed6597-29d9-4906-b34c-3bf4a3c20aa5 -- POST / 200 717.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,817 mnist_classifier_MNISTClassifier ql67vb0i 79f138bb-94d5-43bd-8fce-a7501a64ae79 -- POST / 200 716.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,818 mnist_classifier_MNISTClassifier ql67vb0i 57c0c054-f898-4353-b329-119416f242bf -- POST / 200 715.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,818 mnist_classifier_MNISTClassifier ql67vb0i 9359f812-e5ee-4f79-b7db-58038504d004 -- POST / 200 715.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,818 mnist_classifier_MNISTClassifier ql67vb0i ee349d1f-a784-4f46-b3dd-5e973ee3fbfc -- POST / 200 713.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,818 mnist_classifier_MNISTClassifier ql67vb0i e05abcd9-ddb2-4d71-a3bf-d1b505edb404 -- POST / 200 712.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,819 mnist_classifier_MNISTClassifier ql67vb0i e4a7dfe3-7f51-4f22-bd9b-c359c141d3b9 -- POST / 200 710.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,820 mnist_classifier_MNISTClassifier ql67vb0i acfbfb4b-5870-4c26-8b78-98043409c913 -- POST / 200 709.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,821 mnist_classifier_MNISTClassifier ql67vb0i 8fa4ad21-e84a-44f9-9915-1885b82a0c46 -- POST / 200 710.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,822 mnist_classifier_MNISTClassifier ql67vb0i be6fee3d-ff8b-420a-b0c3-41b9a2510e65 -- POST / 200 710.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,822 mnist_classifier_MNISTClassifier ql67vb0i 9193244f-5438-4012-ac27-3dc9c310c77f -- POST / 200 708.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,822 mnist_classifier_MNISTClassifier ql67vb0i 69160e78-7331-4780-bcf6-508b1af2b5e6 -- POST / 200 709.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,823 mnist_classifier_MNISTClassifier ql67vb0i 25aef930-9597-4d28-a7b6-0f201c9958d8 -- POST / 200 707.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,824 mnist_classifier_MNISTClassifier ql67vb0i 839997cf-f2e4-4720-9ba3-35eecd73b82b -- POST / 200 705.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,824 mnist_classifier_MNISTClassifier ql67vb0i bcb827a2-81ec-4c09-a4a5-62c7cf7b17dc -- POST / 200 707.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,825 mnist_classifier_MNISTClassifier ql67vb0i ac34deed-f13a-4faa-b05e-7524ba57a55d -- POST / 200 707.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,826 mnist_classifier_MNISTClassifier ql67vb0i ad890446-1136-46ba-a514-739ec51bb3d5 -- POST / 200 708.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,826 mnist_classifier_MNISTClassifier ql67vb0i 1860ac30-f7e2-479c-89fa-dfd2458eb14e -- POST / 200 705.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,827 mnist_classifier_MNISTClassifier ql67vb0i 088e8e06-74e3-477a-8175-738c95dc029c -- POST / 200 702.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,828 mnist_classifier_MNISTClassifier ql67vb0i 8397699b-86e7-4f0b-9abf-ccc74c2b2525 -- POST / 200 703.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,829 mnist_classifier_MNISTClassifier ql67vb0i 35601154-cbbb-44df-9204-aac1fc75ceb3 -- POST / 200 703.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,829 mnist_classifier_MNISTClassifier ql67vb0i 18663072-5800-4cba-b52c-049afe1a55b9 -- POST / 200 703.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,829 mnist_classifier_MNISTClassifier ql67vb0i d6bd123e-1c4a-4085-9260-4b684df2199e -- POST / 200 702.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,830 mnist_classifier_MNISTClassifier ql67vb0i 035ae8fb-4544-42fd-b660-9cc4e0e58358 -- POST / 200 703.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,831 mnist_classifier_MNISTClassifier ql67vb0i 73587055-c4d6-43d5-acec-ff0948d094e5 -- POST / 200 702.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,898 mnist_classifier_MNISTClassifier ql67vb0i 2072fea9-eafa-4724-a144-49a2031ebfb5 -- POST / 200 769.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,900 mnist_classifier_MNISTClassifier ql67vb0i c9839a6b-afd6-4e57-8f14-6548b00590bd -- POST / 200 770.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,900 mnist_classifier_MNISTClassifier ql67vb0i d65b2445-544f-46d3-b692-799ebb1e503b -- POST / 200 770.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,901 mnist_classifier_MNISTClassifier ql67vb0i c8e0c082-90ac-46c4-82ff-db983fb8ae5b -- POST / 200 770.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,905 mnist_classifier_MNISTClassifier ql67vb0i 68eba196-84da-4371-b2ee-194d6739871e -- POST / 200 774.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,908 mnist_classifier_MNISTClassifier ql67vb0i 17804eda-1769-42c4-bd05-6b3dd94da1f7 -- POST / 200 775.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,909 mnist_classifier_MNISTClassifier ql67vb0i 7145c097-9cd6-4bd9-88cd-e868e28e4d3c -- POST / 200 777.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,910 mnist_classifier_MNISTClassifier ql67vb0i fb991f57-cdd6-410e-899f-e49a2b164d26 -- POST / 200 776.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,910 mnist_classifier_MNISTClassifier ql67vb0i 05cc63e4-4c7f-4fc6-96e6-2a8c0d6c8c0d -- POST / 200 775.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,911 mnist_classifier_MNISTClassifier ql67vb0i 7ae702ff-ce35-4c4d-86d0-04563dea23f0 -- POST / 200 776.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,912 mnist_classifier_MNISTClassifier ql67vb0i de6289fa-a472-4228-9b81-389ebf5381be -- POST / 200 776.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,913 mnist_classifier_MNISTClassifier ql67vb0i 156e0fd9-7347-4557-863c-ce0c41ea7f60 -- POST / 200 777.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,914 mnist_classifier_MNISTClassifier ql67vb0i 53e13e1e-2afa-46ea-900c-b5d9e9d36b2b -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,914 mnist_classifier_MNISTClassifier ql67vb0i 0d74a621-1874-4eec-ac89-d9c0990d9059 -- POST / 200 468.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,916 mnist_classifier_MNISTClassifier ql67vb0i f81aba37-2826-458a-9895-ab60a6d1e780 -- POST / 200 471.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,918 mnist_classifier_MNISTClassifier ql67vb0i 600f35c4-3fa4-453c-9d20-cb151b8f71d0 -- POST / 200 431.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,919 mnist_classifier_MNISTClassifier ql67vb0i 8330954c-589e-48c9-8a04-1301794e4c3a -- POST / 200 468.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,920 mnist_classifier_MNISTClassifier ql67vb0i 7f8d9c12-b70f-4d7d-9a94-6fb88a5919c9 -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,922 mnist_classifier_MNISTClassifier ql67vb0i 532ef078-7da3-48d9-a72f-255e0cfddc29 -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,923 mnist_classifier_MNISTClassifier ql67vb0i cc9ddd0a-f650-4c29-897c-149334f8f093 -- POST / 200 433.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,923 mnist_classifier_MNISTClassifier ql67vb0i 84990b6b-85bc-4673-b6d2-fb094c9da7c9 -- POST / 200 427.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,923 mnist_classifier_MNISTClassifier ql67vb0i 0316db53-3d7c-4492-994a-bf2e477cadca -- POST / 200 430.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,924 mnist_classifier_MNISTClassifier ql67vb0i e66419d2-43d8-4be7-9186-aa2f24a70204 -- POST / 200 434.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,981 mnist_classifier_MNISTClassifier ql67vb0i 9fc71da9-9dd1-464c-b00d-59a7a7cd10ed -- POST / 200 490.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,984 mnist_classifier_MNISTClassifier ql67vb0i 4de32649-fea4-47f5-ada3-0314ed286fb2 -- POST / 200 487.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,984 mnist_classifier_MNISTClassifier ql67vb0i 178e6136-e79f-48ac-a179-d8672b07518f -- POST / 200 491.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,985 mnist_classifier_MNISTClassifier ql67vb0i 14d90764-fa61-4e50-9566-ee6780972ba6 -- POST / 200 490.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,985 mnist_classifier_MNISTClassifier ql67vb0i 2314f38a-66db-43bc-b37e-8ebda21d6996 -- POST / 200 491.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,986 mnist_classifier_MNISTClassifier ql67vb0i 8da49ec4-3f9b-4e97-b849-443c32c25cfa -- POST / 200 489.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,986 mnist_classifier_MNISTClassifier ql67vb0i c1e24799-1299-4d4d-8cbc-4d17f9951bc4 -- POST / 200 489.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,988 mnist_classifier_MNISTClassifier ql67vb0i f9f1d1ea-3541-4a12-9851-3dc8a604abcb -- POST / 200 490.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,989 mnist_classifier_MNISTClassifier ql67vb0i e2ab132a-9acc-4403-83d5-6e06790000d5 -- POST / 200 489.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,991 mnist_classifier_MNISTClassifier ql67vb0i f067b21a-d37a-483d-8bb2-8b84a6d42229 -- POST / 200 490.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,992 mnist_classifier_MNISTClassifier ql67vb0i 90860481-c231-4958-88e0-7f90809bbe98 -- POST / 200 492.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,994 mnist_classifier_MNISTClassifier ql67vb0i 0db8998a-3890-49a9-9b87-065eebad3e94 -- POST / 200 492.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,996 mnist_classifier_MNISTClassifier ql67vb0i e651d598-66d9-4294-98e2-f682645b7916 -- POST / 200 489.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,998 mnist_classifier_MNISTClassifier ql67vb0i 578e8b13-b28b-4711-9a3f-ae0c860bbe3b -- POST / 200 486.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,999 mnist_classifier_MNISTClassifier ql67vb0i d05195c7-d092-4811-8c92-8a7a60054d15 -- POST / 200 469.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:55,999 mnist_classifier_MNISTClassifier ql67vb0i 778157c1-d051-4b96-ae42-10f2f2e76800 -- POST / 200 468.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,003 mnist_classifier_MNISTClassifier ql67vb0i e21b7cbd-09a9-4b1d-a816-c410693c935c -- POST / 200 469.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,012 mnist_classifier_MNISTClassifier ql67vb0i f89571ab-e136-4213-b195-7869a1683b99 -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,013 mnist_classifier_MNISTClassifier ql67vb0i 7f07de9a-a85f-426f-be20-681923f980de -- POST / 200 477.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,014 mnist_classifier_MNISTClassifier ql67vb0i cbb2c0d9-ecbb-4938-9c92-07cf48704840 -- POST / 200 441.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,014 mnist_classifier_MNISTClassifier ql67vb0i f4e83170-153d-45b8-be70-04d5457fb31a -- POST / 200 441.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,023 mnist_classifier_MNISTClassifier ql67vb0i cfb1a50a-1367-4c0f-9521-5254986dae5e -- POST / 200 448.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,024 mnist_classifier_MNISTClassifier ql67vb0i eda29de7-ce9c-484a-b83d-2c6133e49def -- POST / 200 445.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,025 mnist_classifier_MNISTClassifier ql67vb0i f66caa24-812e-4ec9-9d5b-ba51c58c53a3 -- POST / 200 446.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,025 mnist_classifier_MNISTClassifier ql67vb0i c121f237-e6f7-489c-a683-2367ec91df7a -- POST / 200 446.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,028 mnist_classifier_MNISTClassifier ql67vb0i 0c89243e-8b08-4921-853a-d66e15313b4d -- POST / 200 445.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,029 mnist_classifier_MNISTClassifier ql67vb0i ec8f6e61-e188-4ab1-b446-4e90d760ede8 -- POST / 200 446.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,029 mnist_classifier_MNISTClassifier ql67vb0i 5b876b65-e1cb-4fa2-96e0-3fc6bed403ea -- POST / 200 446.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,031 mnist_classifier_MNISTClassifier ql67vb0i 4c9ecfc0-eef1-4523-ba1f-326ee603ea04 -- POST / 200 446.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,033 mnist_classifier_MNISTClassifier ql67vb0i d7f5118c-44ff-411e-a88f-658c2ac41929 -- POST / 200 447.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,033 mnist_classifier_MNISTClassifier ql67vb0i 50caff5e-871c-4b1f-b9b6-27d67f2aa22d -- POST / 200 447.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,035 mnist_classifier_MNISTClassifier ql67vb0i 29eee042-0e63-4393-bcaa-b5a0933139ea -- POST / 200 448.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,111 mnist_classifier_MNISTClassifier ql67vb0i 88c9ce8b-42df-4e85-8d9b-0f2b87f38329 -- POST / 200 324.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,112 mnist_classifier_MNISTClassifier ql67vb0i 418c6ecf-72aa-46d9-b2f3-8ac19aba46f8 -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,114 mnist_classifier_MNISTClassifier ql67vb0i 86a748b9-bfff-4380-899c-869b55f93e5c -- POST / 200 280.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,114 mnist_classifier_MNISTClassifier ql67vb0i 21353bea-abce-4e22-b526-3af0bc6b307a -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,115 mnist_classifier_MNISTClassifier ql67vb0i ec7764af-51d4-4147-bdac-f983d52df8d7 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,115 mnist_classifier_MNISTClassifier ql67vb0i 8f6a4a3f-1d18-448c-924b-1c5b85b4edc0 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,116 mnist_classifier_MNISTClassifier ql67vb0i 7836338e-a170-4851-a0f6-fad480152dec -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,116 mnist_classifier_MNISTClassifier ql67vb0i f77f2e13-c4ba-4a6b-bc86-025b1e23d507 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,117 mnist_classifier_MNISTClassifier ql67vb0i 6f3bb37a-4071-4a7a-a97a-d5185a22094b -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,119 mnist_classifier_MNISTClassifier ql67vb0i a9ea011c-d37a-4414-bd5a-4a38e88c1f2a -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,120 mnist_classifier_MNISTClassifier ql67vb0i 530c7d86-6cbd-4229-af30-2ed6389081c3 -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,121 mnist_classifier_MNISTClassifier ql67vb0i a9a202c8-5c7c-42df-97a0-efc4c1156875 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,121 mnist_classifier_MNISTClassifier ql67vb0i 7f84efa5-c57b-4643-9162-695c06a40ee0 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,122 mnist_classifier_MNISTClassifier ql67vb0i 17d54898-e2f5-4748-82ae-c38b7cfefc19 -- POST / 200 274.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,123 mnist_classifier_MNISTClassifier ql67vb0i 5f459da0-4d8e-4bb7-b503-c1a92fd5f979 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,132 mnist_classifier_MNISTClassifier ql67vb0i 50cbebc2-3783-4ef5-8b18-fb18711a9057 -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,133 mnist_classifier_MNISTClassifier ql67vb0i 75308946-1783-42e6-8c6c-78e07956c6cf -- POST / 200 283.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,134 mnist_classifier_MNISTClassifier ql67vb0i eb90110c-e6b2-4769-bf97-9da957c5715d -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,135 mnist_classifier_MNISTClassifier ql67vb0i 53b55aad-ff9f-4249-8fb1-8a50eaedb42f -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,136 mnist_classifier_MNISTClassifier ql67vb0i c0e53cef-ddb7-4860-b4fa-178211896907 -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,136 mnist_classifier_MNISTClassifier ql67vb0i a86c0382-e446-4c66-9858-57ec995c2653 -- POST / 200 282.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,138 mnist_classifier_MNISTClassifier ql67vb0i ca7d7ba7-80b2-4590-b2f1-80bc4cafffd5 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,139 mnist_classifier_MNISTClassifier ql67vb0i c7e6cbd1-f4fc-4947-81be-8f69bef3afe1 -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,140 mnist_classifier_MNISTClassifier ql67vb0i 50aca786-c509-4fbf-8647-3867f08c1861 -- POST / 200 283.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,140 mnist_classifier_MNISTClassifier ql67vb0i 240af7be-dd62-4d34-b846-37d7f3e49d06 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,141 mnist_classifier_MNISTClassifier ql67vb0i 9880e981-bf4d-4084-893c-269f1347a67e -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,142 mnist_classifier_MNISTClassifier ql67vb0i 6bcc9c23-2aec-4971-92d4-554108b8e32f -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,144 mnist_classifier_MNISTClassifier ql67vb0i 477aa26c-84d7-4494-a0e0-47fece203203 -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,146 mnist_classifier_MNISTClassifier ql67vb0i 5781fa56-8394-4421-9e19-749cabcc0a9e -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,148 mnist_classifier_MNISTClassifier ql67vb0i 32345a59-1918-48f2-b482-8a3a6c16e626 -- POST / 200 286.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,149 mnist_classifier_MNISTClassifier ql67vb0i da9844b9-ad5f-4317-a598-2d2f41da026d -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,160 mnist_classifier_MNISTClassifier ql67vb0i 2f996cc5-d19e-4e17-b27e-4f81c3fca722 -- POST / 200 295.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,162 mnist_classifier_MNISTClassifier ql67vb0i ebdbabbb-33f7-4a00-94e2-c7b91d7d4f31 -- POST / 200 297.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,169 mnist_classifier_MNISTClassifier ql67vb0i fc589f26-69a1-41b6-8dd8-984cbc878496 -- POST / 200 309.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,169 mnist_classifier_MNISTClassifier ql67vb0i bc19454f-d60e-4b13-a3ef-edb6b04f5d89 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,172 mnist_classifier_MNISTClassifier ql67vb0i 069baa0d-afbe-40fe-b648-f61c853a31c1 -- POST / 200 304.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,173 mnist_classifier_MNISTClassifier ql67vb0i 6d291235-e8ce-4058-a4fb-dbda7b1ba13b -- POST / 200 307.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,174 mnist_classifier_MNISTClassifier ql67vb0i 6ed44729-4752-476c-935f-601aff7cc0a2 -- POST / 200 306.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,175 mnist_classifier_MNISTClassifier ql67vb0i 814a028c-a362-4774-8c1a-50507f6c58bd -- POST / 200 298.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,175 mnist_classifier_MNISTClassifier ql67vb0i 8ca2379a-6190-45d3-931d-64be4ee3c199 -- POST / 200 297.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,176 mnist_classifier_MNISTClassifier ql67vb0i 3c3a9fdd-ab52-46d2-b212-942da4316543 -- POST / 200 297.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,177 mnist_classifier_MNISTClassifier ql67vb0i a0ebe732-32b9-4b7a-b8fe-12acd0d3094f -- POST / 200 296.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,177 mnist_classifier_MNISTClassifier ql67vb0i e17d511f-6d68-405c-81e4-11e09ba4de31 -- POST / 200 296.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,251 mnist_classifier_MNISTClassifier ql67vb0i bad5093e-1d53-485b-814a-2b32c34c17e8 -- POST / 200 367.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,255 mnist_classifier_MNISTClassifier ql67vb0i fe86e8b8-bfb4-4ec7-abfb-c5fc1a1887c7 -- POST / 200 361.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,256 mnist_classifier_MNISTClassifier ql67vb0i 3e121823-b5cb-4c47-8714-5f62b6b18248 -- POST / 200 327.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,257 mnist_classifier_MNISTClassifier ql67vb0i f7fb0fd6-6f49-4d7f-8f31-90f8a473566e -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,257 mnist_classifier_MNISTClassifier ql67vb0i 687944bf-dc64-410f-a2cf-e620ca7b07f5 -- POST / 200 326.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,258 mnist_classifier_MNISTClassifier ql67vb0i 14f3edb2-8213-4ba3-90c4-b53c225b463f -- POST / 200 317.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,258 mnist_classifier_MNISTClassifier ql67vb0i 390b41c3-6b88-4ffc-a7a8-34c8525ad11d -- POST / 200 314.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,261 mnist_classifier_MNISTClassifier ql67vb0i 370cbbff-3866-46cb-81e1-5f05686b4076 -- POST / 200 314.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,262 mnist_classifier_MNISTClassifier ql67vb0i 6957b7f2-ba16-4dc0-b7ad-f9aaa714fa3d -- POST / 200 316.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,262 mnist_classifier_MNISTClassifier ql67vb0i d83e4a03-8538-4582-9747-43024ea0e839 -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,264 mnist_classifier_MNISTClassifier ql67vb0i 73192686-98e9-478d-9837-1685141661ed -- POST / 200 316.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,264 mnist_classifier_MNISTClassifier ql67vb0i 0bc73253-3909-4627-86c5-c177266079c3 -- POST / 200 315.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,265 mnist_classifier_MNISTClassifier ql67vb0i c8ef1716-9299-41a3-94b6-2d3724228aa3 -- POST / 200 316.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,267 mnist_classifier_MNISTClassifier ql67vb0i b24da9a5-5bb4-4566-9914-192805580432 -- POST / 200 316.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,267 mnist_classifier_MNISTClassifier ql67vb0i 010da6f8-2cf5-4bda-a87d-c5446e0f910e -- POST / 200 318.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,269 mnist_classifier_MNISTClassifier ql67vb0i 3adb422d-bf93-46d5-801b-213964d31824 -- POST / 200 318.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,270 mnist_classifier_MNISTClassifier ql67vb0i 70861dc8-01fe-4794-9605-43fe30259825 -- POST / 200 315.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,271 mnist_classifier_MNISTClassifier ql67vb0i 68fd9815-73e5-4b17-b777-3eeb31e4af9e -- POST / 200 311.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,273 mnist_classifier_MNISTClassifier ql67vb0i 3ee7375a-20a1-4e4c-9029-e26308d0d847 -- POST / 200 312.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,274 mnist_classifier_MNISTClassifier ql67vb0i 4f4f41b9-2992-4af3-8ca4-63f7cc701d5f -- POST / 200 304.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,275 mnist_classifier_MNISTClassifier ql67vb0i c7847bda-061e-407f-bfa0-60f09aee8162 -- POST / 200 304.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,278 mnist_classifier_MNISTClassifier ql67vb0i 08aba723-9f2a-4333-b696-c08205d104c3 -- POST / 200 298.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,279 mnist_classifier_MNISTClassifier ql67vb0i 7472adfa-04b8-4992-8684-83f7e802f32a -- POST / 200 291.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,280 mnist_classifier_MNISTClassifier ql67vb0i 93c95c39-4136-4d42-95ab-a6a2d61cd7f7 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,281 mnist_classifier_MNISTClassifier ql67vb0i 66647fb9-cb06-4261-b48c-2df159010a85 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,282 mnist_classifier_MNISTClassifier ql67vb0i 95193ec9-33db-471e-9e38-7aa2ec84c4aa -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,289 mnist_classifier_MNISTClassifier ql67vb0i 2490cd70-628c-453f-a4fe-b425a4f4d06f -- POST / 200 275.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,290 mnist_classifier_MNISTClassifier ql67vb0i 721df7f0-023f-4ec5-8114-906b65db5e6d -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,297 mnist_classifier_MNISTClassifier ql67vb0i a1db6e3c-db7e-4d30-9334-9024e1d45bb4 -- POST / 200 273.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,300 mnist_classifier_MNISTClassifier ql67vb0i 63236350-6e4b-4cdc-93b4-94d764533fa5 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,301 mnist_classifier_MNISTClassifier ql67vb0i 892f70b0-c23a-4dd2-94be-0e8060f90c26 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,301 mnist_classifier_MNISTClassifier ql67vb0i 8465ddce-60ca-4863-bff6-de4f61b6206f -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,302 mnist_classifier_MNISTClassifier ql67vb0i de044251-a380-470f-86fa-0517dc21f344 -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,302 mnist_classifier_MNISTClassifier ql67vb0i 36aa9063-0f43-479d-adac-59c8f04aef63 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,304 mnist_classifier_MNISTClassifier ql67vb0i 6ee1d84f-58a3-4e18-a880-3c57cd80bec9 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,304 mnist_classifier_MNISTClassifier ql67vb0i ffe89bb3-89ff-452e-bead-e003c8518511 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,304 mnist_classifier_MNISTClassifier ql67vb0i a4636e9a-279c-4e94-ae91-5b93c6fb99a2 -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,305 mnist_classifier_MNISTClassifier ql67vb0i 27b81286-b31d-40b7-89ba-46392b8b325d -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,306 mnist_classifier_MNISTClassifier ql67vb0i 48bff763-ad56-4cec-9115-cf082386c860 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,307 mnist_classifier_MNISTClassifier ql67vb0i 047b0473-c0bd-4441-bfc2-922607355013 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,312 mnist_classifier_MNISTClassifier ql67vb0i 6b8bc737-248c-4304-b985-3efd4ef0a7aa -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,313 mnist_classifier_MNISTClassifier ql67vb0i 132512a1-d195-4726-8d03-761da7de7d7e -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,315 mnist_classifier_MNISTClassifier ql67vb0i 45870271-1b96-45ac-9774-dd4c924067e8 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,315 mnist_classifier_MNISTClassifier ql67vb0i 631184aa-dd4a-4026-8714-bfcc94e13e0a -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,317 mnist_classifier_MNISTClassifier ql67vb0i 3ec217a7-b161-4649-92fe-6683f633c052 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,318 mnist_classifier_MNISTClassifier ql67vb0i bd56596a-f412-4b0f-a9d5-34b9e7676a99 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,318 mnist_classifier_MNISTClassifier ql67vb0i b133e5be-f611-4447-9d1c-e5456632ada6 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,319 mnist_classifier_MNISTClassifier ql67vb0i 8b1a6625-0473-4f11-8ee0-9dbf1fc72ab7 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,319 mnist_classifier_MNISTClassifier ql67vb0i c9cccb83-0eba-4bca-a8b1-ea4dca3c33be -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,348 mnist_classifier_MNISTClassifier ql67vb0i b22560cf-1e70-478e-a9f6-f5a663bcdc5f -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,357 mnist_classifier_MNISTClassifier ql67vb0i aa4ccfce-cca0-4258-b847-4dfdb2b3b9c0 -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,358 mnist_classifier_MNISTClassifier ql67vb0i 71b50547-d40a-40db-8563-61b374e650f9 -- POST / 200 286.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,359 mnist_classifier_MNISTClassifier ql67vb0i 903c682c-4245-4c1d-8a72-7362290efc85 -- POST / 200 288.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,360 mnist_classifier_MNISTClassifier ql67vb0i afb087c0-551f-4448-a5ad-29d1c23c295a -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,361 mnist_classifier_MNISTClassifier ql67vb0i 55209225-1b99-4f94-b901-5e657c8fa655 -- POST / 200 288.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,362 mnist_classifier_MNISTClassifier ql67vb0i 41054016-8aaf-4f53-8cd7-de416ec08df6 -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,363 mnist_classifier_MNISTClassifier ql67vb0i 87012e61-d52c-45d1-83c1-8d4ad016c899 -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,451 mnist_classifier_MNISTClassifier ql67vb0i 25501970-36ab-4201-9cd5-02ad4f113ccd -- POST / 200 341.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,458 mnist_classifier_MNISTClassifier ql67vb0i 94b73729-6098-4fbc-93a6-b8e1fd4d552f -- POST / 200 336.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,459 mnist_classifier_MNISTClassifier ql67vb0i 586b3e14-a618-4027-b3a4-779629b3e563 -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,460 mnist_classifier_MNISTClassifier ql67vb0i 5bb519dd-0ca5-4d71-aa8b-a6c4366b24a9 -- POST / 200 272.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,461 mnist_classifier_MNISTClassifier ql67vb0i 98302309-e4a2-4e2c-a97c-7de5009f4532 -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,462 mnist_classifier_MNISTClassifier ql67vb0i 1708cba2-c48e-4155-b1ef-2a98516346b2 -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,463 mnist_classifier_MNISTClassifier ql67vb0i 460af2a2-fce3-45d1-b3ae-af59593cdb95 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,463 mnist_classifier_MNISTClassifier ql67vb0i 652dd9d5-dd10-44e6-8918-63276320865f -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,464 mnist_classifier_MNISTClassifier ql67vb0i 935256b4-8e9f-4753-8099-3e9b8822fd45 -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,465 mnist_classifier_MNISTClassifier ql67vb0i 560716cc-b820-4317-b681-253db65b58b3 -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,466 mnist_classifier_MNISTClassifier ql67vb0i 3e805498-7fbe-4124-ac27-e3c330b9ebe3 -- POST / 200 275.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,474 mnist_classifier_MNISTClassifier ql67vb0i 9fdb6938-dbb5-419f-a663-1e90b13d3be2 -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,477 mnist_classifier_MNISTClassifier ql67vb0i 34c8f6af-b5dd-4c9b-84e9-02787de44aa8 -- POST / 200 283.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,478 mnist_classifier_MNISTClassifier ql67vb0i 9d6f4897-7c58-47c6-9313-0040f90de65f -- POST / 200 280.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,480 mnist_classifier_MNISTClassifier ql67vb0i 5ac3e88c-07cb-494b-a2fb-40c38a16f77a -- POST / 200 285.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,480 mnist_classifier_MNISTClassifier ql67vb0i 1591d370-3895-4692-844f-594ba320197e -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,481 mnist_classifier_MNISTClassifier ql67vb0i e8453c03-a83f-4dfe-b9db-59e62b7f8047 -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,481 mnist_classifier_MNISTClassifier ql67vb0i 11c38142-d8d7-44f6-8d15-e5cb403740f6 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,482 mnist_classifier_MNISTClassifier ql67vb0i b13fdcc4-b90b-4498-9e05-c4de1853a2b8 -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,484 mnist_classifier_MNISTClassifier ql67vb0i b3a9b1ff-ccc2-41ce-aab7-45b0fc725db2 -- POST / 200 284.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,484 mnist_classifier_MNISTClassifier ql67vb0i d9ca7dd2-a3eb-4e7b-be29-7be70daf00ef -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,486 mnist_classifier_MNISTClassifier ql67vb0i dacab682-b7d1-4ffa-bcce-0f456d4fbe81 -- POST / 200 286.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,487 mnist_classifier_MNISTClassifier ql67vb0i 20e0ba55-cd87-43f1-827a-f30079ff7ee5 -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,488 mnist_classifier_MNISTClassifier ql67vb0i 0a285253-5c5f-497a-87af-1b181d03e1e7 -- POST / 200 286.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,489 mnist_classifier_MNISTClassifier ql67vb0i e89d1d4e-9b42-45c8-8929-f0d7712626cc -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,489 mnist_classifier_MNISTClassifier ql67vb0i 3f08c7e5-16c5-4d82-b4d8-e1f9602a489f -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,492 mnist_classifier_MNISTClassifier ql67vb0i 53cbeb20-f4a0-409a-b10e-492caeff98b0 -- POST / 200 289.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,498 mnist_classifier_MNISTClassifier ql67vb0i 3c53af6f-919c-4f58-9234-24519352b2e8 -- POST / 200 290.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,502 mnist_classifier_MNISTClassifier ql67vb0i b8279509-df90-4d18-b54e-e78d22dcf880 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,502 mnist_classifier_MNISTClassifier ql67vb0i f4f05976-fd0a-42cd-9798-80a4b7f97264 -- POST / 200 292.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,503 mnist_classifier_MNISTClassifier ql67vb0i 9f04eef6-cf25-4ce4-86c7-409538078296 -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,504 mnist_classifier_MNISTClassifier ql67vb0i 34466054-99ee-46cd-90d0-8af2d0012a1b -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,504 mnist_classifier_MNISTClassifier ql67vb0i 7124f9b8-3207-40d9-a2b8-57ffdca7d080 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,506 mnist_classifier_MNISTClassifier ql67vb0i 42a4a880-d5c4-470b-9504-2989f9604760 -- POST / 200 294.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,507 mnist_classifier_MNISTClassifier ql67vb0i 6148dd4f-9fcd-4137-92c0-d850c2b08464 -- POST / 200 294.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,508 mnist_classifier_MNISTClassifier ql67vb0i 559c9d58-9176-4d1a-80ff-e4d7c4be4d8d -- POST / 200 294.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,509 mnist_classifier_MNISTClassifier ql67vb0i bde55c5f-97e9-4697-bac2-8058321ce317 -- POST / 200 294.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,509 mnist_classifier_MNISTClassifier ql67vb0i 287561e4-5e85-4189-b02f-6e27218d3406 -- POST / 200 294.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,510 mnist_classifier_MNISTClassifier ql67vb0i a70c1096-290b-47ef-8554-e516d4be6b29 -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,511 mnist_classifier_MNISTClassifier ql67vb0i 1c8a1d1c-3ef9-4b67-8938-c113655794f1 -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,514 mnist_classifier_MNISTClassifier ql67vb0i 97703428-22e8-43a8-8fc7-02542013e50b -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,515 mnist_classifier_MNISTClassifier ql67vb0i a2b60f75-e49c-446c-a202-132bf2eb93b5 -- POST / 200 294.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,602 mnist_classifier_MNISTClassifier ql67vb0i eed25ab1-4147-4d06-8514-bbd30e34e2ee -- POST / 200 329.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,605 mnist_classifier_MNISTClassifier ql67vb0i 20825e6c-95d3-4a3d-8e50-099aee7fae1f -- POST / 200 360.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,608 mnist_classifier_MNISTClassifier ql67vb0i c2c3fa68-2643-4595-90da-a615d416e2ed -- POST / 200 334.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,608 mnist_classifier_MNISTClassifier ql67vb0i 40be1930-15e5-4934-97fb-f14c7b55a0b8 -- POST / 200 335.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,609 mnist_classifier_MNISTClassifier ql67vb0i 774c146f-cd50-44c1-9de0-68ffb0b6e407 -- POST / 200 336.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,611 mnist_classifier_MNISTClassifier ql67vb0i e649fd28-684e-4458-bcf5-115f97d1584a -- POST / 200 311.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,612 mnist_classifier_MNISTClassifier ql67vb0i cf3246e7-b923-4551-9498-8d0e62c82e50 -- POST / 200 327.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,613 mnist_classifier_MNISTClassifier ql67vb0i 2de388ed-7cb4-4dd0-b401-cab53dc8f071 -- POST / 200 299.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,614 mnist_classifier_MNISTClassifier ql67vb0i 14bd7075-c891-40d4-95b9-5690a42d72d7 -- POST / 200 294.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,614 mnist_classifier_MNISTClassifier ql67vb0i 62caca4c-b3a0-4000-9ff3-508f994c08ab -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,616 mnist_classifier_MNISTClassifier ql67vb0i 5f4c254c-4581-4800-a29c-3a1392494239 -- POST / 200 292.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,624 mnist_classifier_MNISTClassifier ql67vb0i 88ceb0cc-0b29-41e6-8945-417044b2a6e2 -- POST / 200 298.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,626 mnist_classifier_MNISTClassifier ql67vb0i 3f011336-af54-4d60-b36c-fa60d63fe4c1 -- POST / 200 297.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,626 mnist_classifier_MNISTClassifier ql67vb0i c87e478f-6ee6-4d15-89e2-51de6c46a618 -- POST / 200 296.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,626 mnist_classifier_MNISTClassifier ql67vb0i 53b2862a-56cf-42b4-8a63-9d49a0b75bc0 -- POST / 200 294.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,627 mnist_classifier_MNISTClassifier ql67vb0i 8ce6e533-d377-48a8-b4f5-802971f01ed8 -- POST / 200 294.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,628 mnist_classifier_MNISTClassifier ql67vb0i e61936eb-1655-4542-abc2-5915e5041341 -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,628 mnist_classifier_MNISTClassifier ql67vb0i be422e88-28c7-407d-a067-a6a1be5d55b0 -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,629 mnist_classifier_MNISTClassifier ql67vb0i 4014f81a-2ae0-4073-98b6-cd56e78faf33 -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,629 mnist_classifier_MNISTClassifier ql67vb0i c704547a-1d74-4221-b73a-2aaa8de8c6bb -- POST / 200 290.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,630 mnist_classifier_MNISTClassifier ql67vb0i 6047bbea-a4d8-4d5c-a96a-38c98088fbb3 -- POST / 200 291.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,630 mnist_classifier_MNISTClassifier ql67vb0i f79f7bdb-eced-474c-8846-c551c6d0a079 -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,631 mnist_classifier_MNISTClassifier ql67vb0i 11e27883-6802-4a63-b4a9-1eab938030a5 -- POST / 200 290.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,631 mnist_classifier_MNISTClassifier ql67vb0i 8f6d7134-d737-44ff-a79f-7784534b4f3d -- POST / 200 288.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,637 mnist_classifier_MNISTClassifier ql67vb0i 0a93d6eb-712e-42ad-8217-b81a1abd940a -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,639 mnist_classifier_MNISTClassifier ql67vb0i bad7c5d6-48d7-4271-8022-30443865290c -- POST / 200 295.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,639 mnist_classifier_MNISTClassifier ql67vb0i e487a5ee-a8a6-4340-97dd-ee2c3cca66f7 -- POST / 200 296.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,640 mnist_classifier_MNISTClassifier ql67vb0i cbc51a4d-9829-4f3e-9a34-3e9a392f8bf6 -- POST / 200 271.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,640 mnist_classifier_MNISTClassifier ql67vb0i fd2c89ed-c699-431a-96b9-c21cbea87d58 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,640 mnist_classifier_MNISTClassifier ql67vb0i f6b1a1f9-ac2a-4a34-9c1d-218ef02dd019 -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,640 mnist_classifier_MNISTClassifier ql67vb0i 9f70953b-ee36-4257-9b33-bef6e402a6da -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,641 mnist_classifier_MNISTClassifier ql67vb0i 98df1373-aaa0-4da5-ba59-769bbc605d94 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,641 mnist_classifier_MNISTClassifier ql67vb0i da7e52dc-e08d-463f-8914-773f56b826a4 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,643 mnist_classifier_MNISTClassifier ql67vb0i 226521e2-3f97-4d7f-9a1a-8e9298ec5aa9 -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,643 mnist_classifier_MNISTClassifier ql67vb0i 71fbac5f-ac6c-4c68-b4c5-a8ba92fef58e -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,643 mnist_classifier_MNISTClassifier ql67vb0i 7096356a-9c3c-4394-bfd3-5bc4dcab4a5e -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,644 mnist_classifier_MNISTClassifier ql67vb0i 76e76a74-4e00-4524-b0b2-fb3b49966187 -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,645 mnist_classifier_MNISTClassifier ql67vb0i 3e4141e0-26eb-4c8a-ba8c-67cba5136fd5 -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,646 mnist_classifier_MNISTClassifier ql67vb0i c9c32c51-acda-4fd6-b902-82258afe70ef -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,646 mnist_classifier_MNISTClassifier ql67vb0i cf239a45-506b-4cc9-9866-154892a16516 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,647 mnist_classifier_MNISTClassifier ql67vb0i 8d1f78ea-8a88-4fe6-a6ae-42a0cbd77c8f -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,648 mnist_classifier_MNISTClassifier ql67vb0i 5ee21b7d-a289-48e3-bf46-e3a483e73346 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,648 mnist_classifier_MNISTClassifier ql67vb0i 1118f0da-b10e-4742-a459-621df52055aa -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,649 mnist_classifier_MNISTClassifier ql67vb0i 4ed07149-0a05-4201-9dfe-af800ecf1ae6 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,650 mnist_classifier_MNISTClassifier ql67vb0i 691d37cc-6187-4ffe-a304-2518ff852923 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,651 mnist_classifier_MNISTClassifier ql67vb0i 3a15eda8-51e4-49d8-acc9-09f5f73dae04 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,651 mnist_classifier_MNISTClassifier ql67vb0i ec7dce9f-42f7-493f-aea1-fb7ebe18bb70 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,901 mnist_classifier_MNISTClassifier ql67vb0i 4ec0363e-8674-49ff-869b-6f20eec70c96 -- POST / 200 479.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,907 mnist_classifier_MNISTClassifier ql67vb0i d7f76b42-326c-4416-9b0b-f385c662daa1 -- POST / 200 495.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,907 mnist_classifier_MNISTClassifier ql67vb0i 4ba8e55d-d7cc-4bbb-ad62-66bbe339cfe0 -- POST / 200 495.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,907 mnist_classifier_MNISTClassifier ql67vb0i 9617de3f-1d1f-4ae6-9509-0f4c1d28f6ce -- POST / 200 494.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,908 mnist_classifier_MNISTClassifier ql67vb0i d264a047-9198-4269-b788-588a7cacaa2b -- POST / 200 489.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,913 mnist_classifier_MNISTClassifier ql67vb0i 7d4b4e64-ce46-4c80-9ae7-53d74d1f5b8b -- POST / 200 493.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,913 mnist_classifier_MNISTClassifier ql67vb0i 4c39198b-e17a-4428-b442-2b51fea63df8 -- POST / 200 493.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,915 mnist_classifier_MNISTClassifier ql67vb0i 938ceb42-08bb-482a-8ecf-9d580b9fcf53 -- POST / 200 492.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,915 mnist_classifier_MNISTClassifier ql67vb0i 6ec7c3fd-fc2e-490f-9ab5-9d9e1bb2a90b -- POST / 200 495.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,925 mnist_classifier_MNISTClassifier ql67vb0i 86419fcf-8a44-4c08-813d-32d9e98f46ba -- POST / 200 501.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,926 mnist_classifier_MNISTClassifier ql67vb0i 87a74605-255f-4f21-99a0-9aad26d25b82 -- POST / 200 501.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,926 mnist_classifier_MNISTClassifier ql67vb0i a29422d6-7286-42b8-9889-09635200b8b6 -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,927 mnist_classifier_MNISTClassifier ql67vb0i 94b8d2ec-e678-4f9c-85ef-3f8f5acb5134 -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,927 mnist_classifier_MNISTClassifier ql67vb0i ff15ef0d-6221-4cbb-94ae-68281bf27767 -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,927 mnist_classifier_MNISTClassifier ql67vb0i ac624030-0ff7-43b3-9f61-0e6bb0ff810f -- POST / 200 408.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,928 mnist_classifier_MNISTClassifier ql67vb0i e5c17c1b-8f53-4b50-810f-657e1d56983a -- POST / 200 430.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,928 mnist_classifier_MNISTClassifier ql67vb0i ef896939-3a82-4cb8-a9d3-90993d7e449b -- POST / 200 430.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,929 mnist_classifier_MNISTClassifier ql67vb0i e0715f1d-8f29-4523-b780-d5ae44499930 -- POST / 200 407.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,929 mnist_classifier_MNISTClassifier ql67vb0i 392b97f9-5a1a-4e39-8a39-bba94973a6d1 -- POST / 200 405.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,929 mnist_classifier_MNISTClassifier ql67vb0i ffbe4ca9-fe1c-4f3d-8bef-660beaa34192 -- POST / 200 404.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,929 mnist_classifier_MNISTClassifier ql67vb0i a7974b75-c6bd-4727-aa71-a8d62d4c3384 -- POST / 200 403.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,930 mnist_classifier_MNISTClassifier ql67vb0i a7e9f02c-9b5c-45d2-b5d5-920b015f023e -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,930 mnist_classifier_MNISTClassifier ql67vb0i 779bb28e-be7f-4099-8f77-2a12ed5250fc -- POST / 200 403.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,930 mnist_classifier_MNISTClassifier ql67vb0i 0a6a4b90-1628-45d0-be9d-90f301fa374c -- POST / 200 403.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,931 mnist_classifier_MNISTClassifier ql67vb0i 13e777e3-1e83-4697-be49-77e2f46095ce -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,932 mnist_classifier_MNISTClassifier ql67vb0i d381edec-7e1f-4d1a-9aee-98676840ff24 -- POST / 200 402.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,932 mnist_classifier_MNISTClassifier ql67vb0i 1f71b7ea-c111-4735-a6c5-8b4d31e02e07 -- POST / 200 401.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,932 mnist_classifier_MNISTClassifier ql67vb0i 28cc9371-ffe9-4ffe-af0e-a7a598c64711 -- POST / 200 401.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:56,932 mnist_classifier_MNISTClassifier ql67vb0i 55c818d4-9674-4a85-9014-0320f16834f1 -- POST / 200 402.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,074 mnist_classifier_MNISTClassifier ql67vb0i 7370b86f-e9a2-4186-bd8d-dbec468cbe6d -- POST / 200 528.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,075 mnist_classifier_MNISTClassifier ql67vb0i 8de89a87-3b2f-4bfb-8071-afc850567ead -- POST / 200 542.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,075 mnist_classifier_MNISTClassifier ql67vb0i 498c0577-46fa-4a6b-adec-29aa08a21517 -- POST / 200 538.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,076 mnist_classifier_MNISTClassifier ql67vb0i 534bd5fe-3a99-4c57-8db5-d2fe12801b8d -- POST / 200 534.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,077 mnist_classifier_MNISTClassifier ql67vb0i ee9c5438-f89e-4612-856b-cfb6b56b0e9a -- POST / 200 535.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,077 mnist_classifier_MNISTClassifier ql67vb0i 5f98c0b7-05e7-4261-b1d2-0da578f27c6a -- POST / 200 535.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,077 mnist_classifier_MNISTClassifier ql67vb0i ea58644c-339e-4913-86e1-3af202cb4ecc -- POST / 200 534.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,078 mnist_classifier_MNISTClassifier ql67vb0i 128a720c-c63c-4c7c-99a9-f0c93bc18841 -- POST / 200 532.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,082 mnist_classifier_MNISTClassifier ql67vb0i 4a6a4c1d-1517-47be-93f4-c279c660fc02 -- POST / 200 535.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,083 mnist_classifier_MNISTClassifier ql67vb0i cbe887ba-c0f1-46bc-9a97-330dd4a00d4d -- POST / 200 535.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,084 mnist_classifier_MNISTClassifier ql67vb0i ed0fa163-e090-4f19-9782-b96af86de16a -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,084 mnist_classifier_MNISTClassifier ql67vb0i 05f7357c-fa0f-4974-88f7-2238c993d37f -- POST / 200 534.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,084 mnist_classifier_MNISTClassifier ql67vb0i e45d36c9-91b6-4d93-a89c-dc528e19eebe -- POST / 200 534.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,085 mnist_classifier_MNISTClassifier ql67vb0i cefd1e61-88bd-4d63-bccc-ce889c644bc9 -- POST / 200 534.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,085 mnist_classifier_MNISTClassifier ql67vb0i f32cffc5-97bb-4caf-adbc-6117c1f5c33e -- POST / 200 521.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,085 mnist_classifier_MNISTClassifier ql67vb0i 7724844f-67d4-4c99-a0ce-82bdc555ca6f -- POST / 200 524.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,086 mnist_classifier_MNISTClassifier ql67vb0i 81475027-3dd3-41b0-98f5-1517bba15e48 -- POST / 200 523.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,086 mnist_classifier_MNISTClassifier ql67vb0i 67c2094d-97ff-4677-9161-3e03621feea6 -- POST / 200 522.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,086 mnist_classifier_MNISTClassifier ql67vb0i 4009cf16-0f45-48a2-8731-3e3e78fbcecb -- POST / 200 514.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,087 mnist_classifier_MNISTClassifier ql67vb0i cfac3720-6ca8-4f95-9421-b64ece107ece -- POST / 200 515.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,087 mnist_classifier_MNISTClassifier ql67vb0i 10c61cf5-9087-458d-b7e2-f8234ac962b9 -- POST / 200 514.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,087 mnist_classifier_MNISTClassifier ql67vb0i 7695d231-4bec-4197-a04e-444dcbb5290f -- POST / 200 513.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,087 mnist_classifier_MNISTClassifier ql67vb0i b2cf0e4e-138a-417a-80ab-65df439aee06 -- POST / 200 513.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,088 mnist_classifier_MNISTClassifier ql67vb0i fd9dc9a9-d494-472d-911e-277e1850fe91 -- POST / 200 513.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,088 mnist_classifier_MNISTClassifier ql67vb0i 64a4d0ee-6a90-4838-9c3b-65dfec95095f -- POST / 200 462.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,088 mnist_classifier_MNISTClassifier ql67vb0i 95fa9030-65c7-4cd7-baf4-2c7112c5586b -- POST / 200 459.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,089 mnist_classifier_MNISTClassifier ql67vb0i 15cbade9-7772-4f27-853a-8bbec3359d06 -- POST / 200 457.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,089 mnist_classifier_MNISTClassifier ql67vb0i c97d201b-08a3-49c6-9b42-fb95eb98c4bc -- POST / 200 441.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,090 mnist_classifier_MNISTClassifier ql67vb0i 4dc3366a-717d-4ded-bb97-9e736b98b4f5 -- POST / 200 454.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,091 mnist_classifier_MNISTClassifier ql67vb0i 60aba912-eda9-4c9c-92ea-76f7192e2d21 -- POST / 200 434.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,091 mnist_classifier_MNISTClassifier ql67vb0i 910de124-974d-4065-8416-78ac6db13b48 -- POST / 200 434.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,091 mnist_classifier_MNISTClassifier ql67vb0i 426b5b23-b58b-4044-8e42-3f90f641e336 -- POST / 200 434.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,092 mnist_classifier_MNISTClassifier ql67vb0i a96484b1-c088-48df-b496-22cd0513d6be -- POST / 200 435.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,092 mnist_classifier_MNISTClassifier ql67vb0i f347a1d3-b780-4a8f-8299-e4b02aca4851 -- POST / 200 435.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,093 mnist_classifier_MNISTClassifier ql67vb0i fe1eb479-1b03-416b-975e-5eaf1c366c7a -- POST / 200 434.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,093 mnist_classifier_MNISTClassifier ql67vb0i df09be75-8b33-41d5-9702-1ed80dd680ac -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,094 mnist_classifier_MNISTClassifier ql67vb0i e0f36873-a7af-44cd-8650-861dd16b1911 -- POST / 200 431.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,094 mnist_classifier_MNISTClassifier ql67vb0i 55cf675f-8d66-41e8-a222-d12f7b7fe193 -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,095 mnist_classifier_MNISTClassifier ql67vb0i 43f91ed7-6ef7-4a80-9306-126dfb87e3fa -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,096 mnist_classifier_MNISTClassifier ql67vb0i fa2ea9b7-84b1-48ca-a353-27fb8eb4feaa -- POST / 200 428.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,096 mnist_classifier_MNISTClassifier ql67vb0i eceefe02-493a-473d-8be0-e1330dc2fae1 -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,097 mnist_classifier_MNISTClassifier ql67vb0i a92a4c27-61a6-4f0a-ace3-a348234572e6 -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,097 mnist_classifier_MNISTClassifier ql67vb0i 00622162-fe35-4e05-afec-ea71a4d077cb -- POST / 200 426.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,098 mnist_classifier_MNISTClassifier ql67vb0i d35be2cc-a12a-45af-b589-c416a80a1d47 -- POST / 200 421.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,099 mnist_classifier_MNISTClassifier ql67vb0i 1f3cb445-7033-4e6a-968e-015b636a770d -- POST / 200 418.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,099 mnist_classifier_MNISTClassifier ql67vb0i b0cb4790-b615-4cce-af9f-0aecfd0a626d -- POST / 200 418.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,100 mnist_classifier_MNISTClassifier ql67vb0i 3682fc1a-b2e8-452d-8dd6-26db9d5e2aae -- POST / 200 416.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,100 mnist_classifier_MNISTClassifier ql67vb0i 50f224a7-022e-4eb1-ba8b-dcee67e1ca6e -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,100 mnist_classifier_MNISTClassifier ql67vb0i cf026105-fe3c-4ea1-945b-a358142d60ed -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,101 mnist_classifier_MNISTClassifier ql67vb0i 2ddba43c-dc2a-4c01-a9ba-42ca640cd81b -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,102 mnist_classifier_MNISTClassifier ql67vb0i b9e0024b-4caf-4e32-b4c3-668d7719c571 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,102 mnist_classifier_MNISTClassifier ql67vb0i 22c73f6d-600d-477e-b969-50603b9ae0d4 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,102 mnist_classifier_MNISTClassifier ql67vb0i 0bb71a7e-6375-4678-bf2b-47ad1a4345c6 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,108 mnist_classifier_MNISTClassifier ql67vb0i 247353eb-ce46-4afa-beb8-258a9f67728e -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,124 mnist_classifier_MNISTClassifier ql67vb0i db63b185-1fbc-4b09-9134-ed735dc254ff -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,124 mnist_classifier_MNISTClassifier ql67vb0i e1bbf5da-63d3-44c5-89f5-18677752ba65 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,124 mnist_classifier_MNISTClassifier ql67vb0i 8e1fcd37-c6c3-4e36-8340-c7019f70281c -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,124 mnist_classifier_MNISTClassifier ql67vb0i cf405b0d-bdab-492b-8c33-8b0d14a38850 -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,124 mnist_classifier_MNISTClassifier ql67vb0i 53310eec-0a1e-41d1-a099-b93ef20e9218 -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,126 mnist_classifier_MNISTClassifier ql67vb0i 918b5d9d-7a8e-434f-be4f-967a1148e5b2 -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,127 mnist_classifier_MNISTClassifier ql67vb0i eb1a53fe-a090-4223-9388-b75c9bfa7d5d -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,127 mnist_classifier_MNISTClassifier ql67vb0i 9224bd13-0709-48d8-bb07-4aa69f5bb0bd -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,127 mnist_classifier_MNISTClassifier ql67vb0i c9ed4040-fa40-4b5a-b101-92c70b3266a4 -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,128 mnist_classifier_MNISTClassifier ql67vb0i ad6f7b1f-a730-4709-af55-1e5985156ead -- POST / 200 276.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,129 mnist_classifier_MNISTClassifier ql67vb0i e4ae7e4c-8a3e-40f1-8615-84ed92dafd8e -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,129 mnist_classifier_MNISTClassifier ql67vb0i b70e674e-26df-471d-8776-b2f2e1713067 -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,129 mnist_classifier_MNISTClassifier ql67vb0i 1218caef-cbff-4636-9688-771eee023f6a -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,130 mnist_classifier_MNISTClassifier ql67vb0i 54661f06-4df9-4c21-9a56-06acd057a7e3 -- POST / 200 277.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,130 mnist_classifier_MNISTClassifier ql67vb0i 11a85e6a-d8bc-400f-a7d3-e2326822e1cf -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,131 mnist_classifier_MNISTClassifier ql67vb0i a95dcbc8-678d-470a-9108-f546d17f1c13 -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,131 mnist_classifier_MNISTClassifier ql67vb0i 5fa50e20-cd00-47af-99d2-77f40cab18b7 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,131 mnist_classifier_MNISTClassifier ql67vb0i a4b93818-3308-4887-8c42-ec04cca51275 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,132 mnist_classifier_MNISTClassifier ql67vb0i f2d555a8-c4be-47e9-909b-6d78822380a0 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,132 mnist_classifier_MNISTClassifier ql67vb0i 797c0a58-626d-4d24-8d19-15ea34d4120b -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,132 mnist_classifier_MNISTClassifier ql67vb0i 9a0ca7d4-7953-4d39-80f0-c5de0ed27e6f -- POST / 200 194.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,132 mnist_classifier_MNISTClassifier ql67vb0i 87e8e862-8f64-4259-9abf-0c7fcee6fe95 -- POST / 200 190.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,132 mnist_classifier_MNISTClassifier ql67vb0i 7d2a2cd6-2c5f-4fdb-8c74-cb393e27031a -- POST / 200 190.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,133 mnist_classifier_MNISTClassifier ql67vb0i 69ba1dec-35a2-43f7-9a3c-ae56f12c25d9 -- POST / 200 189.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,133 mnist_classifier_MNISTClassifier ql67vb0i 68361cd5-d85c-478f-8e2e-8a33c19a83ed -- POST / 200 187.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,133 mnist_classifier_MNISTClassifier ql67vb0i 2dbb42ae-8c49-4175-90b1-b9036541dd3f -- POST / 200 187.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,133 mnist_classifier_MNISTClassifier ql67vb0i 00d91019-4773-4b57-9479-e6b7e78098c2 -- POST / 200 187.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,133 mnist_classifier_MNISTClassifier ql67vb0i 55cdb711-4007-4bf2-ad61-f0f14644eaeb -- POST / 200 178.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,134 mnist_classifier_MNISTClassifier ql67vb0i ef95de0f-2f74-4471-a612-506859f44d85 -- POST / 200 178.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,134 mnist_classifier_MNISTClassifier ql67vb0i 80d01771-03e7-411f-a779-c56ab265b246 -- POST / 200 175.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,134 mnist_classifier_MNISTClassifier ql67vb0i ba111e2c-fd46-4c44-9f62-be38917191c5 -- POST / 200 175.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,134 mnist_classifier_MNISTClassifier ql67vb0i 560069db-7494-49fc-bd40-86777971f372 -- POST / 200 175.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,134 mnist_classifier_MNISTClassifier ql67vb0i cb8c2eb9-c585-42aa-a5a8-cac34d9dc5fb -- POST / 200 175.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,134 mnist_classifier_MNISTClassifier ql67vb0i 2a7fcf9c-3645-45f1-adb8-02054fa9d6bc -- POST / 200 175.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,142 mnist_classifier_MNISTClassifier ql67vb0i 75d3a1f7-e52b-41d8-bdd5-45c4c80e1b3a -- POST / 200 180.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,143 mnist_classifier_MNISTClassifier ql67vb0i e6787135-e408-4148-bb14-3b1839854b5e -- POST / 200 180.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,146 mnist_classifier_MNISTClassifier ql67vb0i 8f2416dc-6bdc-4dc9-9f83-2fd9cf40e65c -- POST / 200 183.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,147 mnist_classifier_MNISTClassifier ql67vb0i 8bab055c-cfaf-405a-9588-ccb868261161 -- POST / 200 178.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,147 mnist_classifier_MNISTClassifier ql67vb0i fa98f4c0-5af2-455e-a750-d1e6bfea590c -- POST / 200 178.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,148 mnist_classifier_MNISTClassifier ql67vb0i 15224dc0-cf4b-461b-9ed0-0f1fe2b70333 -- POST / 200 177.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,149 mnist_classifier_MNISTClassifier ql67vb0i d21cf67e-d756-4851-a384-4d2ee4862421 -- POST / 200 178.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,149 mnist_classifier_MNISTClassifier ql67vb0i 970a1129-b5df-45d0-9e50-f7683e23ed7b -- POST / 200 178.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,150 mnist_classifier_MNISTClassifier ql67vb0i 5e12099b-118f-453e-91db-6c1793b9dafe -- POST / 200 179.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,150 mnist_classifier_MNISTClassifier ql67vb0i 8e2ee84a-ac03-4ce5-a2dd-a778b9b50b7e -- POST / 200 179.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,153 mnist_classifier_MNISTClassifier ql67vb0i 73e1032b-1127-44e0-9c5d-faf4d9ab07cc -- POST / 200 178.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,154 mnist_classifier_MNISTClassifier ql67vb0i 49dce6ab-73ac-4985-8ad9-f2d48930d142 -- POST / 200 178.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,327 mnist_classifier_MNISTClassifier ql67vb0i dbffd2e0-90ac-4e51-a09d-854766c4a0c3 -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,334 mnist_classifier_MNISTClassifier ql67vb0i 3e553fa2-ad22-4299-9543-e139e4ae7e72 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,337 mnist_classifier_MNISTClassifier ql67vb0i 67898c4e-e11b-412a-8920-0f89759664a3 -- POST / 200 228.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,337 mnist_classifier_MNISTClassifier ql67vb0i 2e7cc8d8-9c7d-4882-83ab-10de833d2a7a -- POST / 200 177.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,338 mnist_classifier_MNISTClassifier ql67vb0i 25e485b9-c95a-4edc-a1b7-0dbaa619dcc3 -- POST / 200 175.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,338 mnist_classifier_MNISTClassifier ql67vb0i 5df4f995-7b3a-4b96-8096-10819a80afb3 -- POST / 200 172.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,338 mnist_classifier_MNISTClassifier ql67vb0i 8179668d-b833-464c-8e03-426a84b0d86d -- POST / 200 171.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,339 mnist_classifier_MNISTClassifier ql67vb0i 8a2cd7bd-cb83-49a8-91eb-79f34305f1c1 -- POST / 200 171.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,339 mnist_classifier_MNISTClassifier ql67vb0i 9ecbbc67-bac6-499f-99f2-2b6ebaea955d -- POST / 200 169.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,339 mnist_classifier_MNISTClassifier ql67vb0i 49c45b30-691e-4aa3-8c1e-34b124408dd1 -- POST / 200 169.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,339 mnist_classifier_MNISTClassifier ql67vb0i 77d93cb7-6298-4e64-b14f-2d685c2e8dc4 -- POST / 200 167.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,340 mnist_classifier_MNISTClassifier ql67vb0i 15789dbd-d5cf-42b8-84a7-abb71eac84da -- POST / 200 167.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,340 mnist_classifier_MNISTClassifier ql67vb0i 0ad1844e-ee8c-405e-adc4-4bd72e26fc84 -- POST / 200 167.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,475 mnist_classifier_MNISTClassifier ql67vb0i 873da819-da44-4836-8d81-b5c642d1ccd8 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,476 mnist_classifier_MNISTClassifier ql67vb0i 8524271e-5f97-4a7b-b2a5-af00d9256a48 -- POST / 200 299.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,476 mnist_classifier_MNISTClassifier ql67vb0i 0de00377-c8ff-4977-9b2a-7df8d6b09689 -- POST / 200 299.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,476 mnist_classifier_MNISTClassifier ql67vb0i f6c807c8-5c6d-49fa-ad70-e1e5867ded58 -- POST / 200 299.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,477 mnist_classifier_MNISTClassifier ql67vb0i 2edb9414-2f8f-4304-8a66-1010e3e60262 -- POST / 200 299.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,478 mnist_classifier_MNISTClassifier ql67vb0i 5e9b420f-b754-4de1-a3c9-120a6cf62059 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,479 mnist_classifier_MNISTClassifier ql67vb0i 5e374638-0d17-4efe-82aa-9f82bf537904 -- POST / 200 298.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,480 mnist_classifier_MNISTClassifier ql67vb0i dc601f2b-9973-43e3-88ba-9566877051fb -- POST / 200 298.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,481 mnist_classifier_MNISTClassifier ql67vb0i c4e54354-791b-4319-8d4d-f740b86a99bb -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,481 mnist_classifier_MNISTClassifier ql67vb0i cd058152-afb6-4257-ae76-f50503aec3e5 -- POST / 200 299.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,481 mnist_classifier_MNISTClassifier ql67vb0i 17ff16e8-d5f0-49f9-9e51-cbc11f227b62 -- POST / 200 298.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,481 mnist_classifier_MNISTClassifier ql67vb0i e4f8d16f-07b2-4fcb-a63b-98e5fee55edc -- POST / 200 298.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,482 mnist_classifier_MNISTClassifier ql67vb0i f81ccfb6-5d7f-4678-82bd-d42c99a1eab5 -- POST / 200 298.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,482 mnist_classifier_MNISTClassifier ql67vb0i f7d907a4-b52a-4fb0-82d9-30d5a87f6a33 -- POST / 200 297.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,482 mnist_classifier_MNISTClassifier ql67vb0i da79c4af-37c1-4693-8ca9-265f9a6836ab -- POST / 200 297.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,482 mnist_classifier_MNISTClassifier ql67vb0i d76f314c-3342-457f-9a3d-973e6ff7949e -- POST / 200 297.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,483 mnist_classifier_MNISTClassifier ql67vb0i 58a7ca51-9e10-454c-9154-708d745ef26f -- POST / 200 295.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,483 mnist_classifier_MNISTClassifier ql67vb0i c3d4f532-dacf-45ba-b487-34cc71f85466 -- POST / 200 294.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,483 mnist_classifier_MNISTClassifier ql67vb0i 07bf12b9-52ab-4d54-9709-c4c1fea2e1f4 -- POST / 200 294.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,484 mnist_classifier_MNISTClassifier ql67vb0i 49270a0e-3d6b-4bfe-bf5d-b03da5d209d5 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,484 mnist_classifier_MNISTClassifier ql67vb0i 937ba9fe-78cc-4b89-a6ba-83e1552260f3 -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,484 mnist_classifier_MNISTClassifier ql67vb0i ed359ec1-969c-4246-8241-24b8cb9f2512 -- POST / 200 280.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,485 mnist_classifier_MNISTClassifier ql67vb0i a080902c-ec0f-4700-87b2-8ed4e48c14ea -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,487 mnist_classifier_MNISTClassifier ql67vb0i 366a447f-ac5d-4356-ac89-48cfb71efd19 -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,488 mnist_classifier_MNISTClassifier ql67vb0i cd92a44d-1595-402a-99f9-f0b5152affd9 -- POST / 200 290.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,489 mnist_classifier_MNISTClassifier ql67vb0i 0c8cf26a-05bc-4270-b607-29cfff3fa942 -- POST / 200 291.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,490 mnist_classifier_MNISTClassifier ql67vb0i ba666f15-09bd-485f-970b-93f6e808c8a6 -- POST / 200 292.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,491 mnist_classifier_MNISTClassifier ql67vb0i 7d07f3bf-3826-44fd-9971-9b3e4785fdc0 -- POST / 200 292.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,491 mnist_classifier_MNISTClassifier ql67vb0i 9b86db26-c68b-431c-852d-1bd5edc683a2 -- POST / 200 291.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,492 mnist_classifier_MNISTClassifier ql67vb0i 6feadc1d-6674-4584-b42e-07345079b931 -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,492 mnist_classifier_MNISTClassifier ql67vb0i 40bd33da-9af9-4b18-a45b-6650c62dff78 -- POST / 200 287.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,492 mnist_classifier_MNISTClassifier ql67vb0i 5505ab81-6547-48b5-a869-af4849226436 -- POST / 200 287.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,494 mnist_classifier_MNISTClassifier ql67vb0i d1d6017a-2514-4fd8-9012-0f377487f5ad -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,494 mnist_classifier_MNISTClassifier ql67vb0i e6286e88-6126-40da-9455-0ec17801792f -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,495 mnist_classifier_MNISTClassifier ql67vb0i 9d434b52-f37d-4171-a51a-143d0edbb519 -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,495 mnist_classifier_MNISTClassifier ql67vb0i 320e2a90-289f-49b2-9298-03634a1a33db -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,496 mnist_classifier_MNISTClassifier ql67vb0i b9900e8d-88f0-4578-a5f6-d7deeeb2eaa7 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,496 mnist_classifier_MNISTClassifier ql67vb0i 35621018-b7b5-40b3-91dc-e6011c5c8b67 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,496 mnist_classifier_MNISTClassifier ql67vb0i 2e63200f-80ce-4362-a1cb-6d38123bd7b8 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,497 mnist_classifier_MNISTClassifier ql67vb0i b8f54698-cdab-44cb-85b1-24b203999636 -- POST / 200 285.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,499 mnist_classifier_MNISTClassifier ql67vb0i 76aeb497-a696-4cdc-9389-ff400f9e9104 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,499 mnist_classifier_MNISTClassifier ql67vb0i 559af26b-77b5-4bb3-bc80-f01b4912e6b2 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,499 mnist_classifier_MNISTClassifier ql67vb0i c35fb5a6-8796-4cba-b818-bfa505fafa6c -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,500 mnist_classifier_MNISTClassifier ql67vb0i c3e486c0-36c0-4da7-828d-d09b4627a6d9 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,500 mnist_classifier_MNISTClassifier ql67vb0i 5249c92c-3bfa-4bb7-b27d-f2e2a8cb3037 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,500 mnist_classifier_MNISTClassifier ql67vb0i 329ab1ca-8576-4a2a-afa9-3d1a57040c67 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,501 mnist_classifier_MNISTClassifier ql67vb0i 631e408c-7733-4473-a26e-7e3fa5ca9a20 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,501 mnist_classifier_MNISTClassifier ql67vb0i 85f84a1e-f619-45b5-a05d-eb2f1ac85cdc -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,501 mnist_classifier_MNISTClassifier ql67vb0i e302017d-4cb7-4329-9bf4-959946a702f0 -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,502 mnist_classifier_MNISTClassifier ql67vb0i 77e87f84-4ee4-4e81-8456-8f0a3963b575 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,502 mnist_classifier_MNISTClassifier ql67vb0i 0f155efe-6fa8-428f-a168-52a87420d63c -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,502 mnist_classifier_MNISTClassifier ql67vb0i c91038ec-b5fa-4a0e-887f-f2ade680b7a5 -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,503 mnist_classifier_MNISTClassifier ql67vb0i e4e43ef1-adb3-477f-b5d5-7035febab1d9 -- POST / 200 236.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,503 mnist_classifier_MNISTClassifier ql67vb0i 153f3731-0b28-4600-8069-702d4cfae777 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,503 mnist_classifier_MNISTClassifier ql67vb0i a9e23557-8023-48f1-b7cc-0f08c3546989 -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,504 mnist_classifier_MNISTClassifier ql67vb0i 0c555a69-d2b6-4c3a-b633-a2fdee8da83b -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,504 mnist_classifier_MNISTClassifier ql67vb0i d761348a-509a-45c9-9849-fa059d3ea444 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,504 mnist_classifier_MNISTClassifier ql67vb0i e40088ec-388c-40cd-b2b5-77a0d84f405f -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,504 mnist_classifier_MNISTClassifier ql67vb0i 89b5321b-8fb1-4922-97b9-f7f9f973341d -- POST / 200 222.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,504 mnist_classifier_MNISTClassifier ql67vb0i bf395499-3c46-4b1f-b4eb-f9358581b9dd -- POST / 200 220.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,506 mnist_classifier_MNISTClassifier ql67vb0i d17c29fb-3d29-472c-925f-6d4c467f825b -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,507 mnist_classifier_MNISTClassifier ql67vb0i eed36527-acba-40f6-8288-1e2a17c048e3 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,507 mnist_classifier_MNISTClassifier ql67vb0i a4cccfe0-7472-47c2-8912-94fe7d1f59d1 -- POST / 200 222.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,508 mnist_classifier_MNISTClassifier ql67vb0i daa3e556-6b54-4cf6-aa2e-7d2a7b746bcf -- POST / 200 220.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,511 mnist_classifier_MNISTClassifier ql67vb0i 1a1606b9-8bbc-430d-84ed-70309f52f981 -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,515 mnist_classifier_MNISTClassifier ql67vb0i bcc0b847-4661-433d-8a4a-df8fcf94b521 -- POST / 200 219.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,516 mnist_classifier_MNISTClassifier ql67vb0i ab15d0e4-088a-4e37-969e-e9b9b0d3d160 -- POST / 200 219.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,516 mnist_classifier_MNISTClassifier ql67vb0i c9b7d503-6d31-401d-a647-893030177608 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,517 mnist_classifier_MNISTClassifier ql67vb0i 33427a04-4b18-4750-830d-29b8d087d24d -- POST / 200 219.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,517 mnist_classifier_MNISTClassifier ql67vb0i a90b5e57-167e-44b1-bf05-5bff554add1c -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,517 mnist_classifier_MNISTClassifier ql67vb0i 5397e8df-e943-494e-b9a3-f5b42e4d412e -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,518 mnist_classifier_MNISTClassifier ql67vb0i 5c259d79-c913-49f6-bcbe-d0f226eadede -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,518 mnist_classifier_MNISTClassifier ql67vb0i 9d1b222e-72b4-4368-93c4-533a04986fd6 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,518 mnist_classifier_MNISTClassifier ql67vb0i 605180c4-9434-45c6-9681-5a45cc2c5cfb -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,518 mnist_classifier_MNISTClassifier ql67vb0i 48a19cfd-5b26-480a-82f8-64ac3726ad33 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,519 mnist_classifier_MNISTClassifier ql67vb0i dda211ec-85c2-49f8-82a0-c90a5889c6d9 -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,521 mnist_classifier_MNISTClassifier ql67vb0i 14569d79-ff08-44a5-9e19-2b829e76db5c -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,522 mnist_classifier_MNISTClassifier ql67vb0i 0069bde9-9753-47b1-abf3-3b222e645da5 -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,522 mnist_classifier_MNISTClassifier ql67vb0i 25165412-4f24-4a5d-a55b-a6e35dc7f01f -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,522 mnist_classifier_MNISTClassifier ql67vb0i 82443b67-4ae3-4a59-ae6d-e219dc0863b0 -- POST / 200 213.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,523 mnist_classifier_MNISTClassifier ql67vb0i 1a175402-e6ca-4860-b7d8-b7ca33546496 -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,523 mnist_classifier_MNISTClassifier ql67vb0i 90b02414-2aa5-4769-bf52-8a799e6b86fa -- POST / 200 211.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,523 mnist_classifier_MNISTClassifier ql67vb0i f1f2d540-2f38-4b1f-b37a-9004bed7f0ae -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,524 mnist_classifier_MNISTClassifier ql67vb0i 5b13d625-ce04-4181-9f72-4c0ec47f3d9f -- POST / 200 206.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,524 mnist_classifier_MNISTClassifier ql67vb0i d7b04b8b-0f5e-4b37-b49a-1c3edc75d0ab -- POST / 200 206.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,525 mnist_classifier_MNISTClassifier ql67vb0i b8f2d4a8-c015-41d0-95f0-7abb5614f025 -- POST / 200 206.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,525 mnist_classifier_MNISTClassifier ql67vb0i 20054db0-8838-48bb-9a54-b9ddc609ec4e -- POST / 200 160.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,525 mnist_classifier_MNISTClassifier ql67vb0i 240d0cec-e112-412c-b30e-1ef39e9ff874 -- POST / 200 160.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,526 mnist_classifier_MNISTClassifier ql67vb0i 5c4e9010-b1c6-454a-adb4-3b90ee947b0f -- POST / 200 159.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,526 mnist_classifier_MNISTClassifier ql67vb0i 56fd77c0-364a-4b35-8c73-a31b5a306c00 -- POST / 200 157.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,526 mnist_classifier_MNISTClassifier ql67vb0i 681c87af-6484-488f-89d9-ec332200c5eb -- POST / 200 160.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,529 mnist_classifier_MNISTClassifier ql67vb0i 99d71783-866c-43eb-bbb2-dfe589f2b5fa -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,565 mnist_classifier_MNISTClassifier ql67vb0i 925022fd-b25f-4d08-a2a0-e4b7cc47243f -- POST / 200 195.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,598 mnist_classifier_MNISTClassifier ql67vb0i 23ba131e-0f15-4bf8-b72f-fea7e09bd873 -- POST / 200 227.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,598 mnist_classifier_MNISTClassifier ql67vb0i 2d5e5ac3-5660-43ad-b093-7d19e400b6c3 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,598 mnist_classifier_MNISTClassifier ql67vb0i 65179c8f-8550-4283-aef6-9ba8405cd2a7 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,598 mnist_classifier_MNISTClassifier ql67vb0i dcb5485c-e58c-4a0f-8b65-4df62b587279 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,599 mnist_classifier_MNISTClassifier ql67vb0i 9e3e78dc-879b-418e-8f56-6e6b19096031 -- POST / 200 222.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,599 mnist_classifier_MNISTClassifier ql67vb0i 759d2e08-bcb9-4400-b13b-47935ef49ebf -- POST / 200 220.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,599 mnist_classifier_MNISTClassifier ql67vb0i db6d76fe-b260-4ca7-924c-00740df30da3 -- POST / 200 220.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,876 mnist_classifier_MNISTClassifier ql67vb0i 1edcd446-a357-469a-8f94-c827198fdca6 -- POST / 200 382.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,878 mnist_classifier_MNISTClassifier ql67vb0i bce80703-19cb-48e9-8c92-0a7ae47232b3 -- POST / 200 384.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:57,879 mnist_classifier_MNISTClassifier ql67vb0i dfae33db-7b3e-477c-a8fc-08c4845ca64b -- POST / 200 347.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,054 mnist_classifier_MNISTClassifier ql67vb0i 749e750c-d806-4932-89c4-cb259f0801aa -- POST / 200 517.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,054 mnist_classifier_MNISTClassifier ql67vb0i ecdfa67a-2340-4809-822f-0cd7f933cab2 -- POST / 200 517.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,055 mnist_classifier_MNISTClassifier ql67vb0i 1ea99ba4-9436-4f14-b8e8-becb77280c35 -- POST / 200 517.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,056 mnist_classifier_MNISTClassifier ql67vb0i c91e8277-87a1-476b-910a-c62e62e327fc -- POST / 200 518.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,056 mnist_classifier_MNISTClassifier ql67vb0i 73e01c67-8e17-4917-90d7-e3bf33cd6dfd -- POST / 200 518.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,057 mnist_classifier_MNISTClassifier ql67vb0i d71e2f33-d3d9-464e-bc5d-8acb689a1b59 -- POST / 200 518.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,058 mnist_classifier_MNISTClassifier ql67vb0i 5a506da1-598b-476c-9315-088734057e8f -- POST / 200 519.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,058 mnist_classifier_MNISTClassifier ql67vb0i 5675d521-e454-4b8a-a530-5591a3edad58 -- POST / 200 518.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,060 mnist_classifier_MNISTClassifier ql67vb0i f2167efd-4b09-4d5a-9380-5ac47bd00646 -- POST / 200 518.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,060 mnist_classifier_MNISTClassifier ql67vb0i 4c101281-a01d-41c1-b3fc-f343324e6ac2 -- POST / 200 518.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,061 mnist_classifier_MNISTClassifier ql67vb0i 223eb4e1-5f53-46e7-8db0-626697f60d98 -- POST / 200 518.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,061 mnist_classifier_MNISTClassifier ql67vb0i cd1f526a-e8d7-4b5e-9f13-e9c8213797e3 -- POST / 200 516.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,062 mnist_classifier_MNISTClassifier ql67vb0i 1089607b-4ca4-4da2-af90-b3a823c90613 -- POST / 200 519.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,062 mnist_classifier_MNISTClassifier ql67vb0i b8200b9a-f704-4928-9a08-a7579163fc9c -- POST / 200 516.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,063 mnist_classifier_MNISTClassifier ql67vb0i c8882ea6-49ca-4f74-b8f7-912c239454d0 -- POST / 200 518.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,063 mnist_classifier_MNISTClassifier ql67vb0i 1e80e639-0e97-4b1d-a2e0-195783244237 -- POST / 200 515.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,063 mnist_classifier_MNISTClassifier ql67vb0i 744dd577-19bf-41f4-b3e5-a58e66b6b23e -- POST / 200 513.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,064 mnist_classifier_MNISTClassifier ql67vb0i 7f1a56cd-fe14-4934-99b1-2af9ad394166 -- POST / 200 516.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,064 mnist_classifier_MNISTClassifier ql67vb0i fda0030c-eb39-44fd-a06f-45f6ad2b9e2e -- POST / 200 515.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,064 mnist_classifier_MNISTClassifier ql67vb0i 5a0f5000-aed9-40ab-a513-1555d9e19ff4 -- POST / 200 515.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,065 mnist_classifier_MNISTClassifier ql67vb0i c2f898f5-c999-4326-b6fc-65f145f0b9f4 -- POST / 200 514.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,065 mnist_classifier_MNISTClassifier ql67vb0i fe616be1-0f60-4e8d-8aae-02500c83503a -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,065 mnist_classifier_MNISTClassifier ql67vb0i c6a6c799-3d1d-4992-a5bf-cd8588e1956b -- POST / 200 514.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,065 mnist_classifier_MNISTClassifier ql67vb0i 5e87b2dc-9c32-409b-b7b3-5f6f762aadb0 -- POST / 200 463.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,066 mnist_classifier_MNISTClassifier ql67vb0i c73a8214-6f2f-4e9d-b885-3e0911722f99 -- POST / 200 463.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,066 mnist_classifier_MNISTClassifier ql67vb0i e180897d-97c2-43b3-8a97-2d1f84014fab -- POST / 200 463.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,067 mnist_classifier_MNISTClassifier ql67vb0i 7daa4fa6-5ae6-489e-9afc-6d764f38c292 -- POST / 200 463.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,067 mnist_classifier_MNISTClassifier ql67vb0i 5658316e-bbba-4340-bf07-931ba02ec1d2 -- POST / 200 464.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,068 mnist_classifier_MNISTClassifier ql67vb0i 9d6975ef-76e5-4236-b3fe-0a6a4baf2a3f -- POST / 200 464.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,069 mnist_classifier_MNISTClassifier ql67vb0i 37888f10-3aba-4cef-930a-5146c8efbcc4 -- POST / 200 465.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,071 mnist_classifier_MNISTClassifier ql67vb0i 2eeee0a6-1915-440c-b421-a8d65f8f0076 -- POST / 200 467.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,072 mnist_classifier_MNISTClassifier ql67vb0i 2402cb93-85d4-41ed-a6aa-aa4cdc486edc -- POST / 200 468.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,073 mnist_classifier_MNISTClassifier ql67vb0i c662eec6-e86e-4617-bc94-2fe4f7f4138c -- POST / 200 467.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,073 mnist_classifier_MNISTClassifier ql67vb0i ac5a07af-aa0e-439e-90c5-9c5a37db4fda -- POST / 200 467.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,073 mnist_classifier_MNISTClassifier ql67vb0i 8a1b081b-b46d-4010-a17c-476958a135cb -- POST / 200 459.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,074 mnist_classifier_MNISTClassifier ql67vb0i 6a6dfc5a-8633-4592-9ac0-30979b565224 -- POST / 200 462.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,074 mnist_classifier_MNISTClassifier ql67vb0i 10df894e-1a70-44da-9ba5-324cfdb3752e -- POST / 200 457.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,075 mnist_classifier_MNISTClassifier ql67vb0i d5c5e254-ecab-43bc-89f9-37847f84d6be -- POST / 200 456.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,077 mnist_classifier_MNISTClassifier ql67vb0i 25c50271-f8e2-4621-ae23-71a2b2fc9eaf -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,078 mnist_classifier_MNISTClassifier ql67vb0i 905f3d90-597e-42c4-acf4-837c872d517f -- POST / 200 458.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,080 mnist_classifier_MNISTClassifier ql67vb0i 74534adc-5f3f-4617-8cc3-7e5691d5480f -- POST / 200 459.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,080 mnist_classifier_MNISTClassifier ql67vb0i 0e041e2e-48bf-4c26-8f57-44041e8c3eef -- POST / 200 459.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,081 mnist_classifier_MNISTClassifier ql67vb0i 1cf40eff-a45f-43d1-83e0-107d7811e7bb -- POST / 200 459.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,081 mnist_classifier_MNISTClassifier ql67vb0i 9eee3949-c301-42c8-9cf6-a2e4b3e1a14f -- POST / 200 458.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,081 mnist_classifier_MNISTClassifier ql67vb0i ffb6692d-3ddc-4d92-9735-83381af12218 -- POST / 200 456.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,081 mnist_classifier_MNISTClassifier ql67vb0i bb869021-ab51-48f6-a1b2-54645da3b7f6 -- POST / 200 456.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,081 mnist_classifier_MNISTClassifier ql67vb0i bf0acace-0dc4-43e6-bca1-b3017dcd5d9e -- POST / 200 454.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,082 mnist_classifier_MNISTClassifier ql67vb0i f6f94ee0-3f67-45d6-afe4-646a92385bab -- POST / 200 450.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,082 mnist_classifier_MNISTClassifier ql67vb0i 14bf1daf-4a8b-4847-bd07-7055dbb947f0 -- POST / 200 453.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,082 mnist_classifier_MNISTClassifier ql67vb0i d6ea3b57-a26c-43fc-b265-63283ce7336b -- POST / 200 449.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,082 mnist_classifier_MNISTClassifier ql67vb0i 0e966b87-3b5d-45c0-92a9-a6cf4c1fa553 -- POST / 200 452.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,082 mnist_classifier_MNISTClassifier ql67vb0i 88f4ea3e-ac3d-4aac-84b9-2282a926a5f0 -- POST / 200 449.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,082 mnist_classifier_MNISTClassifier ql67vb0i 3c24684d-85e1-4e5f-88b9-3e99ad122e43 -- POST / 200 446.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,083 mnist_classifier_MNISTClassifier ql67vb0i 50ce330c-8c6f-4ae2-8527-dba23a72b0de -- POST / 200 445.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,083 mnist_classifier_MNISTClassifier ql67vb0i bd700b65-ea73-4ba1-8f3f-bb6cfccff9dd -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,083 mnist_classifier_MNISTClassifier ql67vb0i 2a519bdb-bafd-4c66-9c1b-c71a503ead83 -- POST / 200 443.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,083 mnist_classifier_MNISTClassifier ql67vb0i f4f9b863-f431-4840-bf01-292ae630b4b4 -- POST / 200 442.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,083 mnist_classifier_MNISTClassifier ql67vb0i 5d72a538-8965-44bc-93b2-3ff1f10ad726 -- POST / 200 441.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,083 mnist_classifier_MNISTClassifier ql67vb0i d1000caf-5376-4662-937b-7fa7f69f1733 -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,084 mnist_classifier_MNISTClassifier ql67vb0i 703e59fc-ac2a-49e6-9aeb-79464588c608 -- POST / 200 439.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,084 mnist_classifier_MNISTClassifier ql67vb0i c3cccf1d-d2c2-4724-b05f-44719ce54106 -- POST / 200 440.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,084 mnist_classifier_MNISTClassifier ql67vb0i 555993f4-dc59-4af3-bcc6-57dfaccee754 -- POST / 200 440.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,084 mnist_classifier_MNISTClassifier ql67vb0i 6c8ad35e-fb71-4d12-9e9b-a6629cb259ae -- POST / 200 431.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,084 mnist_classifier_MNISTClassifier ql67vb0i 8b8a0803-299f-4d25-8591-cee22b5b53b4 -- POST / 200 431.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,085 mnist_classifier_MNISTClassifier ql67vb0i 2c462e4e-912a-49d5-ad8b-596bf9579841 -- POST / 200 430.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,086 mnist_classifier_MNISTClassifier ql67vb0i 3770d4ae-a410-4090-a267-69c2125e7e21 -- POST / 200 430.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,089 mnist_classifier_MNISTClassifier ql67vb0i af439aca-9b0f-402c-8182-9fdc7e32a57f -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,090 mnist_classifier_MNISTClassifier ql67vb0i 1e5e506f-83a1-41a8-925d-0269a89e3742 -- POST / 200 275.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,094 mnist_classifier_MNISTClassifier ql67vb0i 485d980d-71e5-46e4-b3b1-6ccce1a5976f -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,095 mnist_classifier_MNISTClassifier ql67vb0i 692e6511-e184-41b5-be55-2451be87af7d -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,098 mnist_classifier_MNISTClassifier ql67vb0i 41de685d-573c-4236-8213-8c240baa8cb2 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,098 mnist_classifier_MNISTClassifier ql67vb0i 96b79452-8d84-47a4-a47e-eafef563bed7 -- POST / 200 283.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,098 mnist_classifier_MNISTClassifier ql67vb0i 46a3b88e-15ec-41ab-afa1-f48eb313b2e8 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,099 mnist_classifier_MNISTClassifier ql67vb0i 70305e8d-e8c5-401f-bb2b-696ac3a0ef1c -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,101 mnist_classifier_MNISTClassifier ql67vb0i ff881a95-8c03-4fcc-9e56-1bdeac8532f3 -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,101 mnist_classifier_MNISTClassifier ql67vb0i 43a30a5a-d7ce-4b99-bdea-b402d50d42fb -- POST / 200 283.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,103 mnist_classifier_MNISTClassifier ql67vb0i 31935215-f88c-4eec-a355-3dc21b9bd24d -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,110 mnist_classifier_MNISTClassifier ql67vb0i 031eb896-e7ed-4f55-9551-ee449699e1ef -- POST / 200 289.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,110 mnist_classifier_MNISTClassifier ql67vb0i 9b64a214-2e5e-4585-a513-20884575ff38 -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,111 mnist_classifier_MNISTClassifier ql67vb0i 69010cdf-01d5-4be3-ad72-f9f48f4a2d96 -- POST / 200 289.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,111 mnist_classifier_MNISTClassifier ql67vb0i 8d960b33-a7da-474b-8af3-8f2ff892bd01 -- POST / 200 289.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,112 mnist_classifier_MNISTClassifier ql67vb0i 0e3a4628-69df-4ab0-9120-99d8e58e58d7 -- POST / 200 289.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,114 mnist_classifier_MNISTClassifier ql67vb0i 38eafd5f-1da8-4910-93bd-9562f502aba3 -- POST / 200 290.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,116 mnist_classifier_MNISTClassifier ql67vb0i 8fd77d8d-6cc5-46ca-936c-6b380149f3b0 -- POST / 200 291.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,117 mnist_classifier_MNISTClassifier ql67vb0i 15c75b4b-a8e5-48ba-b5bb-796bf8ed7d8c -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,117 mnist_classifier_MNISTClassifier ql67vb0i 2a384a69-fe9e-4c4c-afa3-c9ff0b5089b8 -- POST / 200 290.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,117 mnist_classifier_MNISTClassifier ql67vb0i 7b4cec34-3809-4db0-b93f-6563837879f0 -- POST / 200 291.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i 5bb99867-f166-4e65-85b2-abaf71a78fa2 -- POST / 200 290.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i 803c2ec2-31b9-4646-841d-4aa4ffcacf24 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i 292e7e20-a110-4897-a4d8-6f39127b3758 -- POST / 200 287.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i 936d8270-ab18-43a2-bdb5-a61978895f34 -- POST / 200 287.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i 9f79c95e-8c17-473f-8584-82c5b05fca3c -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i dd8ed083-933d-4496-912c-35502fbbb582 -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,118 mnist_classifier_MNISTClassifier ql67vb0i 83e31efc-8503-48b7-8c1f-010ef579f4dc -- POST / 200 285.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,119 mnist_classifier_MNISTClassifier ql67vb0i 7a35a7cb-fc97-4710-8769-82c6d6923f39 -- POST / 200 285.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,119 mnist_classifier_MNISTClassifier ql67vb0i b2d7cac2-45f3-4d57-81eb-a9e27289d799 -- POST / 200 286.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,119 mnist_classifier_MNISTClassifier ql67vb0i a57202d4-25d4-45a7-95dd-64715a248c19 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,119 mnist_classifier_MNISTClassifier ql67vb0i 8159c5e3-950a-4b9f-916c-e2708761f76d -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,120 mnist_classifier_MNISTClassifier ql67vb0i e1f988e3-62ac-4b62-8bad-c2b12daf3e5a -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,120 mnist_classifier_MNISTClassifier ql67vb0i dae668a6-a706-47ff-b823-7d024fd12ec7 -- POST / 200 230.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,399 mnist_classifier_MNISTClassifier ql67vb0i b0dbe853-a628-4843-90ea-5b8cefc324ac -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,400 mnist_classifier_MNISTClassifier ql67vb0i 3a75bcdc-a90f-47ce-9a1b-e101bf4df706 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,401 mnist_classifier_MNISTClassifier ql67vb0i 797aca86-4190-483d-88dd-6c873e094f50 -- POST / 200 270.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,402 mnist_classifier_MNISTClassifier ql67vb0i 4e07c81a-8fd2-4866-ad09-00b348f17623 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,402 mnist_classifier_MNISTClassifier ql67vb0i e4de400b-f37d-42e7-8d38-71af3a4444cc -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,403 mnist_classifier_MNISTClassifier ql67vb0i a1d393bb-a8d6-4b48-b5d3-570ad0415f2c -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,403 mnist_classifier_MNISTClassifier ql67vb0i 415f56fd-ac04-4fb4-8a47-1304359feee8 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,404 mnist_classifier_MNISTClassifier ql67vb0i 6f8f83d3-6c70-4f94-84e8-2c6f3fe176d0 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,404 mnist_classifier_MNISTClassifier ql67vb0i 39f6a064-013d-4391-80ce-1a80f6adfa7c -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,405 mnist_classifier_MNISTClassifier ql67vb0i 53bc5f9f-1b9b-4e76-86d0-1f19040505ee -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,406 mnist_classifier_MNISTClassifier ql67vb0i 710f674b-0b14-4640-b5f8-a6f45c2e40b1 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,407 mnist_classifier_MNISTClassifier ql67vb0i a5f06783-9955-45ac-808f-fd16f1b30e0c -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,408 mnist_classifier_MNISTClassifier ql67vb0i 4eb3a101-9c06-4d4f-aa82-b06aca227d01 -- POST / 200 271.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,408 mnist_classifier_MNISTClassifier ql67vb0i b8b5d9c7-6fcc-4023-8ab9-ac23082a8ba8 -- POST / 200 270.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,409 mnist_classifier_MNISTClassifier ql67vb0i d8cb56eb-ceab-4143-a586-a7e6001d5302 -- POST / 200 270.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,410 mnist_classifier_MNISTClassifier ql67vb0i fe402b0b-9cda-432a-8dd3-d049e4fca7ef -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,413 mnist_classifier_MNISTClassifier ql67vb0i 3163a379-5420-4517-857d-b98e3f8d94b2 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,415 mnist_classifier_MNISTClassifier ql67vb0i dfd0bb7a-43fe-4285-a9ad-fe1857fa7a44 -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,415 mnist_classifier_MNISTClassifier ql67vb0i e02d82a5-c0c2-4a1f-9f7b-57505656b47f -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,415 mnist_classifier_MNISTClassifier ql67vb0i 5ac31532-8315-448b-82f1-dda6385e4c60 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,416 mnist_classifier_MNISTClassifier ql67vb0i 499a1065-cdf6-46c0-90cf-d91edd407e28 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,416 mnist_classifier_MNISTClassifier ql67vb0i 423c52c8-9408-4f7f-92e8-5ad85d1d2707 -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,416 mnist_classifier_MNISTClassifier ql67vb0i ac40890b-94c9-44f0-9db2-ff2d7704a153 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,417 mnist_classifier_MNISTClassifier ql67vb0i b5b9d15d-0905-4840-a2fd-c09c7b6458c4 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,417 mnist_classifier_MNISTClassifier ql67vb0i 0d189d9f-53df-48ac-846c-456547cdf3f7 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,417 mnist_classifier_MNISTClassifier ql67vb0i 001061c7-5f75-4044-b608-8e0ea956b223 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,418 mnist_classifier_MNISTClassifier ql67vb0i d0b7795d-8a2b-4237-862c-9555c0624bdc -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,418 mnist_classifier_MNISTClassifier ql67vb0i 55926bd5-b8f0-4ff1-b84b-7336ae265614 -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,418 mnist_classifier_MNISTClassifier ql67vb0i dd98ee61-1134-40b9-a68b-423f8a7a6388 -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,418 mnist_classifier_MNISTClassifier ql67vb0i 34f842e2-495c-4131-96a7-c96787e50a65 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,419 mnist_classifier_MNISTClassifier ql67vb0i b85197e1-bd7d-4414-9d7c-ddcd3e1ae721 -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,419 mnist_classifier_MNISTClassifier ql67vb0i 0093636f-7267-4b15-b462-5c02f7c1b7cc -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,419 mnist_classifier_MNISTClassifier ql67vb0i 6116f68e-f53c-42d4-9919-d5052b337558 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,419 mnist_classifier_MNISTClassifier ql67vb0i dc7024de-da9f-4cbc-a837-7ea71e4b13b2 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,419 mnist_classifier_MNISTClassifier ql67vb0i e339d55b-5b6a-45b4-ac34-2de042317bbc -- POST / 200 262.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,420 mnist_classifier_MNISTClassifier ql67vb0i 0bd854b1-efa0-434e-a6cc-8be5b7ca6654 -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,420 mnist_classifier_MNISTClassifier ql67vb0i 30b5d7df-ef94-414a-a8c4-2483cf2a7d89 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,420 mnist_classifier_MNISTClassifier ql67vb0i 6033a584-96ac-4599-ab3d-12ed7bba679e -- POST / 200 199.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,420 mnist_classifier_MNISTClassifier ql67vb0i 169b269b-4dba-4de4-9e64-0d6de22bd4df -- POST / 200 198.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,421 mnist_classifier_MNISTClassifier ql67vb0i 1221b587-a54b-4a83-8732-be3c17605a25 -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,421 mnist_classifier_MNISTClassifier ql67vb0i 0bebdaa6-5d02-49b4-ba85-4b5ddde912d2 -- POST / 200 189.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,422 mnist_classifier_MNISTClassifier ql67vb0i 1c7402de-da58-4848-91f1-73fbe7116487 -- POST / 200 198.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,424 mnist_classifier_MNISTClassifier ql67vb0i 5690901d-ffea-4a73-ab44-bebe0103905d -- POST / 200 197.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,424 mnist_classifier_MNISTClassifier ql67vb0i b05f7eee-a8b2-479a-a3a6-44ef50874807 -- POST / 200 192.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,424 mnist_classifier_MNISTClassifier ql67vb0i 3dcfb512-0cc7-4f4c-a282-6752d9ea4a7a -- POST / 200 188.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,425 mnist_classifier_MNISTClassifier ql67vb0i eb6f6ea8-7565-4266-85ff-84136a50797d -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,425 mnist_classifier_MNISTClassifier ql67vb0i d266ab01-f1ed-4337-8b70-188adb2de9a8 -- POST / 200 187.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,426 mnist_classifier_MNISTClassifier ql67vb0i cccd83cd-cf67-485c-85b6-fd6f8f36b9a2 -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,426 mnist_classifier_MNISTClassifier ql67vb0i b2d8b3b5-4911-4934-997b-4a6bfbb0777e -- POST / 200 185.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,426 mnist_classifier_MNISTClassifier ql67vb0i c6cfb7e2-bb8a-4101-83a3-375d689812c7 -- POST / 200 191.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,426 mnist_classifier_MNISTClassifier ql67vb0i 5aadc0e3-0302-4324-a46a-594487e257cb -- POST / 200 175.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,427 mnist_classifier_MNISTClassifier ql67vb0i d8fb8f51-3f17-4415-ba1d-5c0240fcf937 -- POST / 200 184.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,427 mnist_classifier_MNISTClassifier ql67vb0i 8d127bc0-5225-407b-a2dc-b88c80ff6607 -- POST / 200 182.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,427 mnist_classifier_MNISTClassifier ql67vb0i 9640167c-27d3-44a2-86fa-a465d119f947 -- POST / 200 182.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,428 mnist_classifier_MNISTClassifier ql67vb0i ae7729df-cbc8-4cb6-93bb-859f11da18c2 -- POST / 200 182.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,428 mnist_classifier_MNISTClassifier ql67vb0i c827521c-62d4-405d-90ad-9dbb4475032a -- POST / 200 175.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,429 mnist_classifier_MNISTClassifier ql67vb0i ae19dd0c-8031-4c3e-b9bb-0d9ace5d8561 -- POST / 200 176.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,430 mnist_classifier_MNISTClassifier ql67vb0i f0d34013-265a-4527-bad5-8825eb4b7298 -- POST / 200 176.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,430 mnist_classifier_MNISTClassifier ql67vb0i 0e69cefc-40b6-40c1-ae5f-2efae5fb3f83 -- POST / 200 177.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,431 mnist_classifier_MNISTClassifier ql67vb0i 5f6d0c0a-307d-417f-b917-fe2b0f4651f3 -- POST / 200 177.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,431 mnist_classifier_MNISTClassifier ql67vb0i 0b15b418-6e59-4790-b231-5f8157413c64 -- POST / 200 177.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,431 mnist_classifier_MNISTClassifier ql67vb0i 1f03e1c3-0310-415f-9f66-b16600d775b8 -- POST / 200 177.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,432 mnist_classifier_MNISTClassifier ql67vb0i e3a106f9-b60d-4e32-b71d-f05afb4f6d84 -- POST / 200 176.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,432 mnist_classifier_MNISTClassifier ql67vb0i 15190968-a065-4137-9353-6c575e92a0b0 -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,432 mnist_classifier_MNISTClassifier ql67vb0i b77c2cd6-09d9-42e7-8ffb-8b338b968c25 -- POST / 200 175.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,432 mnist_classifier_MNISTClassifier ql67vb0i abfa1a4f-84c7-4af8-8165-de5b6b8983e6 -- POST / 200 175.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,432 mnist_classifier_MNISTClassifier ql67vb0i 504aa8d9-d48f-4bdb-85ef-643457bd23d9 -- POST / 200 173.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,433 mnist_classifier_MNISTClassifier ql67vb0i 586426d7-6de4-49b9-959f-62d076217887 -- POST / 200 171.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,481 mnist_classifier_MNISTClassifier ql67vb0i 8807eb41-c4a0-4b7d-98e2-5923a3e45d5a -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,530 mnist_classifier_MNISTClassifier ql67vb0i ba2fcbda-790d-4978-b1c6-60b932ae18b7 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,531 mnist_classifier_MNISTClassifier ql67vb0i df8fd6a7-c611-4d66-a0fe-e6e50a499f4b -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,532 mnist_classifier_MNISTClassifier ql67vb0i 58f38d07-2274-4269-9db7-2369614d4135 -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,532 mnist_classifier_MNISTClassifier ql67vb0i 2658016b-e7ee-4af8-862b-cc69d0b52751 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,533 mnist_classifier_MNISTClassifier ql67vb0i 69a79e3f-f29b-4ea4-a0c8-3ed7ece05a53 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,534 mnist_classifier_MNISTClassifier ql67vb0i 7e2484d9-a045-4c64-8476-fda7a9978c48 -- POST / 200 267.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,534 mnist_classifier_MNISTClassifier ql67vb0i 91d1e0a3-4cab-471b-94a7-0ad6f42b4544 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,535 mnist_classifier_MNISTClassifier ql67vb0i 78b36373-f6e9-4fdc-a7be-ab32bc795f06 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,537 mnist_classifier_MNISTClassifier ql67vb0i fef8ed9e-89db-4dc9-9e3e-1a23c5d42d80 -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,538 mnist_classifier_MNISTClassifier ql67vb0i 87d9623b-5c4a-49e1-9407-4064a94fbdcb -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,539 mnist_classifier_MNISTClassifier ql67vb0i eab291ea-f7c9-4d46-a327-257bddc7e74a -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,541 mnist_classifier_MNISTClassifier ql67vb0i 10f2ceaa-d5f1-4eca-a083-7b9d5f6706d8 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,541 mnist_classifier_MNISTClassifier ql67vb0i d9128137-57d1-40fd-9b30-cebef841e16a -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,542 mnist_classifier_MNISTClassifier ql67vb0i 22de1188-9e91-4c32-a9ac-334fb10e63a2 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,543 mnist_classifier_MNISTClassifier ql67vb0i 700557aa-e6ee-431f-bde0-6a4e663f0f0b -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,544 mnist_classifier_MNISTClassifier ql67vb0i 55577daf-4cfb-4987-a129-5b7487ba172f -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,544 mnist_classifier_MNISTClassifier ql67vb0i 8bebb33c-ddd2-4edb-a748-95f5584caaba -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,544 mnist_classifier_MNISTClassifier ql67vb0i da22a629-c22d-4816-93ae-2879418198dd -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,545 mnist_classifier_MNISTClassifier ql67vb0i efc462a6-517e-406b-baaf-87879b1b4536 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,545 mnist_classifier_MNISTClassifier ql67vb0i 63997af2-6b7b-493a-a095-6eeabf9b16b1 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,545 mnist_classifier_MNISTClassifier ql67vb0i 62a47577-ed4c-46d6-ba0e-9963da5a8233 -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,545 mnist_classifier_MNISTClassifier ql67vb0i 34876c4e-25ea-4c21-941b-41f9969911cf -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,545 mnist_classifier_MNISTClassifier ql67vb0i abdcc439-f242-40c2-ac96-2f142160eb42 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,546 mnist_classifier_MNISTClassifier ql67vb0i e80b207f-be3f-4241-9cc0-d8b3aa50e0c2 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,546 mnist_classifier_MNISTClassifier ql67vb0i ff6d8acb-e649-4150-8763-23d7fa8a7d10 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,546 mnist_classifier_MNISTClassifier ql67vb0i 0833363f-a433-403e-b1e9-6b5c75454398 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,546 mnist_classifier_MNISTClassifier ql67vb0i 056fe0c2-9ac2-4a81-8a6d-e43c7da4535e -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,546 mnist_classifier_MNISTClassifier ql67vb0i 8175792f-0754-4c02-b99d-d2011ad9f5d5 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,547 mnist_classifier_MNISTClassifier ql67vb0i c6958d60-73a4-4dfb-9258-d07e1c819030 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,547 mnist_classifier_MNISTClassifier ql67vb0i d0262a3c-fa2c-42f9-8559-2a152afa9c58 -- POST / 200 254.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,547 mnist_classifier_MNISTClassifier ql67vb0i f80c885e-8640-46be-a267-568e48e8153e -- POST / 200 254.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,547 mnist_classifier_MNISTClassifier ql67vb0i e5300cd2-4def-484a-a14a-f082a028bff3 -- POST / 200 145.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,548 mnist_classifier_MNISTClassifier ql67vb0i b5c65a47-b9e5-4d36-a3db-c9ca882c3e8a -- POST / 200 140.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,548 mnist_classifier_MNISTClassifier ql67vb0i 2048adb3-2222-4c4d-9c2d-7d12a1cfac31 -- POST / 200 139.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,633 mnist_classifier_MNISTClassifier ql67vb0i a554eb2f-48a5-458c-bfcf-8d9e8354ded9 -- POST / 200 195.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,656 mnist_classifier_MNISTClassifier ql67vb0i 55c8f5ee-6b32-4c8d-8509-78aad2233318 -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,658 mnist_classifier_MNISTClassifier ql67vb0i d2e1e1d1-a1b4-4778-bb33-952d3c9af832 -- POST / 200 219.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,658 mnist_classifier_MNISTClassifier ql67vb0i f333ca40-96e2-4c62-804b-b89466325066 -- POST / 200 219.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,659 mnist_classifier_MNISTClassifier ql67vb0i 5c34a1f2-5445-412a-a4c9-a3b06c9ba362 -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,661 mnist_classifier_MNISTClassifier ql67vb0i ea6917b9-55fb-4e13-9bae-2d56983b94f9 -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,661 mnist_classifier_MNISTClassifier ql67vb0i 2fa312cc-12de-4ed7-acdd-56cb93d947c4 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,662 mnist_classifier_MNISTClassifier ql67vb0i ffeb5662-23ce-40be-912c-777be4d72f2d -- POST / 200 221.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,664 mnist_classifier_MNISTClassifier ql67vb0i 277daa71-a4da-4d6a-91bf-ad91411047a8 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,664 mnist_classifier_MNISTClassifier ql67vb0i db304b36-092d-4b8d-989f-ef78e2fd5ae4 -- POST / 200 221.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,664 mnist_classifier_MNISTClassifier ql67vb0i 00453962-a59d-4e4e-9e4b-7972a2ae02c6 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,664 mnist_classifier_MNISTClassifier ql67vb0i ee381959-76c3-47fa-b958-c8b4fb34c795 -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,665 mnist_classifier_MNISTClassifier ql67vb0i 35ec2080-bb57-41c0-8043-bd34cd2b1d07 -- POST / 200 201.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,665 mnist_classifier_MNISTClassifier ql67vb0i e2556e03-a9cd-4a8a-ae49-e6e4a34a967a -- POST / 200 114.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,935 mnist_classifier_MNISTClassifier ql67vb0i 748919e0-b871-41fc-83b9-c4cf7b86c5ff -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,936 mnist_classifier_MNISTClassifier ql67vb0i 9d540596-a716-4db2-a8a8-1171b36a5a0e -- POST / 200 379.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,937 mnist_classifier_MNISTClassifier ql67vb0i b54a6d14-95b7-4b6b-9405-ece936c8c692 -- POST / 200 382.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,939 mnist_classifier_MNISTClassifier ql67vb0i 077a168a-7264-4a99-9657-1b4427f380c8 -- POST / 200 378.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,939 mnist_classifier_MNISTClassifier ql67vb0i 67a95ed4-73f5-43cf-872c-08233dc5e8fa -- POST / 200 379.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,940 mnist_classifier_MNISTClassifier ql67vb0i 087c6e78-3031-49ac-b489-aac4a4df5896 -- POST / 200 379.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,943 mnist_classifier_MNISTClassifier ql67vb0i 0d2c5ab9-3396-47a4-9cf4-13fba95dea56 -- POST / 200 381.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,944 mnist_classifier_MNISTClassifier ql67vb0i 572510d3-1213-4041-8b38-06909bad00d5 -- POST / 200 382.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,946 mnist_classifier_MNISTClassifier ql67vb0i 922dd8d1-f628-41d0-b24b-3ee4a59c829c -- POST / 200 384.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,948 mnist_classifier_MNISTClassifier ql67vb0i be8ded0e-73fe-4b75-be6d-38ea2639b1da -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,949 mnist_classifier_MNISTClassifier ql67vb0i 51833f92-fd3e-408f-a185-b24c26cb3348 -- POST / 200 387.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,950 mnist_classifier_MNISTClassifier ql67vb0i 4587c16e-ce13-4c5f-a028-d7cd99c40c8b -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,951 mnist_classifier_MNISTClassifier ql67vb0i 2e75b77c-cdf2-436c-a4cc-0ad3b9a09abb -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,952 mnist_classifier_MNISTClassifier ql67vb0i 7ec402e1-ad8d-4060-b71c-ca2de663da86 -- POST / 200 389.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,953 mnist_classifier_MNISTClassifier ql67vb0i c3641072-9b4c-4910-b5b8-949a6f63c5fa -- POST / 200 390.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,953 mnist_classifier_MNISTClassifier ql67vb0i 24295296-6f7a-4c8d-b7e7-e7145d5be246 -- POST / 200 389.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,953 mnist_classifier_MNISTClassifier ql67vb0i e2c536a7-7a3c-48fa-8183-99c239138ba3 -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,954 mnist_classifier_MNISTClassifier ql67vb0i 3ed5d6d0-33c6-4dad-92f6-a040a0cc49d8 -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,954 mnist_classifier_MNISTClassifier ql67vb0i 4658bbaa-120f-4185-babd-cb06ec7be932 -- POST / 200 390.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,954 mnist_classifier_MNISTClassifier ql67vb0i a5a93196-a3db-4e3f-9881-a7b7ec7a5988 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,955 mnist_classifier_MNISTClassifier ql67vb0i 35354c05-f5f8-4dea-bff8-7d458427de82 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,956 mnist_classifier_MNISTClassifier ql67vb0i bbb40c95-743d-4808-9c31-1ffd2d49f0a9 -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,959 mnist_classifier_MNISTClassifier ql67vb0i f49e516c-5cd9-47ae-93d2-dd53f1edf9ad -- POST / 200 391.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,960 mnist_classifier_MNISTClassifier ql67vb0i f9fcd06c-45f3-46eb-9f93-aa168aeacb95 -- POST / 200 376.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,962 mnist_classifier_MNISTClassifier ql67vb0i 67a2b98d-66be-4083-9c84-d0a80f638ece -- POST / 200 392.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,962 mnist_classifier_MNISTClassifier ql67vb0i 4c7f5b07-2cd3-498f-bbd2-06e8704a44f0 -- POST / 200 392.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,964 mnist_classifier_MNISTClassifier ql67vb0i 9c8f1324-79d8-4aa2-b7a9-b0a135ae892c -- POST / 200 393.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,967 mnist_classifier_MNISTClassifier ql67vb0i 780ebb52-8498-4e0e-a3d6-8de898246496 -- POST / 200 394.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,968 mnist_classifier_MNISTClassifier ql67vb0i fc28aa1c-d934-4389-8ca4-4de5cfc5b7ee -- POST / 200 395.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,969 mnist_classifier_MNISTClassifier ql67vb0i 9d625228-f0c7-4f3e-886b-57651d8cf8b5 -- POST / 200 395.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,970 mnist_classifier_MNISTClassifier ql67vb0i 613b7d94-5d29-4c12-a7b9-38651c08c87e -- POST / 200 396.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,971 mnist_classifier_MNISTClassifier ql67vb0i a756709f-5c57-4186-9296-5b9438cf7473 -- POST / 200 396.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,972 mnist_classifier_MNISTClassifier ql67vb0i 39964d88-9314-44a8-aa68-8df50de105e1 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,974 mnist_classifier_MNISTClassifier ql67vb0i 4965c3a5-1137-4b47-816b-720e6073be1c -- POST / 200 395.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,975 mnist_classifier_MNISTClassifier ql67vb0i eff4494b-6835-488d-93f4-f70dbd0fd7d7 -- POST / 200 395.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,977 mnist_classifier_MNISTClassifier ql67vb0i 4f536e88-8549-42c6-87db-8591c27ad8cf -- POST / 200 396.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,982 mnist_classifier_MNISTClassifier ql67vb0i f95cf546-0b2f-4b77-b9f7-b57d6210a321 -- POST / 200 399.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,983 mnist_classifier_MNISTClassifier ql67vb0i e7bf6fca-ad13-4f39-acaa-f95657afce3d -- POST / 200 400.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,984 mnist_classifier_MNISTClassifier ql67vb0i 189c26e2-cea5-4a6f-b28d-7400b886e4e4 -- POST / 200 400.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,984 mnist_classifier_MNISTClassifier ql67vb0i 9f5e2dd5-be79-4ddc-b138-524c5395c79a -- POST / 200 401.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,984 mnist_classifier_MNISTClassifier ql67vb0i f2702e38-4dbe-4923-ab88-69cde24c4c0f -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,985 mnist_classifier_MNISTClassifier ql67vb0i f500270f-94ee-4e91-9d33-7d9025f2a075 -- POST / 200 399.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,985 mnist_classifier_MNISTClassifier ql67vb0i 1ae1e41d-cb38-4b4a-8c31-b9bb0981a89a -- POST / 200 398.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,985 mnist_classifier_MNISTClassifier ql67vb0i 8f18057d-6167-42b5-90fc-777460efa4ca -- POST / 200 397.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,985 mnist_classifier_MNISTClassifier ql67vb0i 2916cd37-2dc3-43be-971a-93862a6f9c57 -- POST / 200 397.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,986 mnist_classifier_MNISTClassifier ql67vb0i 92f9eb8e-c032-431e-ac2c-b6720aef2ff7 -- POST / 200 396.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,986 mnist_classifier_MNISTClassifier ql67vb0i d361b1af-0829-4466-bdc3-26d2757e2e13 -- POST / 200 396.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,986 mnist_classifier_MNISTClassifier ql67vb0i 5f4acdd2-56d9-4077-8a01-e754c6419a17 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,987 mnist_classifier_MNISTClassifier ql67vb0i 56484e77-b192-4094-9680-a5b281c582d0 -- POST / 200 395.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:58,989 mnist_classifier_MNISTClassifier ql67vb0i e6fc9443-09d1-46e1-9bca-7637156fce1c -- POST / 200 314.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,013 mnist_classifier_MNISTClassifier ql67vb0i d9a01260-9047-4abc-b848-7fbbb6d69906 -- POST / 200 338.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,014 mnist_classifier_MNISTClassifier ql67vb0i 3203fca2-5dd4-4e8c-a951-425c7e1bed4e -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,018 mnist_classifier_MNISTClassifier ql67vb0i 4b0bae64-9e8a-4570-86c4-3aab9df665a4 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,018 mnist_classifier_MNISTClassifier ql67vb0i a5028f59-43f8-4810-8f6e-16d31cf16e7b -- POST / 200 405.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,019 mnist_classifier_MNISTClassifier ql67vb0i d3ed2a5b-08b5-4e77-97f2-b90669c74388 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,019 mnist_classifier_MNISTClassifier ql67vb0i 3ac15266-9b8e-4d75-8784-0a6d35d8ff4b -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,020 mnist_classifier_MNISTClassifier ql67vb0i 9122f876-21d0-4f03-8d71-ace77e1b62fe -- POST / 200 402.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,021 mnist_classifier_MNISTClassifier ql67vb0i d039a009-a7ff-4546-809a-2b23929c80be -- POST / 200 403.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,021 mnist_classifier_MNISTClassifier ql67vb0i a5c2e3b9-7975-4e51-985f-5a996137e94b -- POST / 200 402.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,021 mnist_classifier_MNISTClassifier ql67vb0i 50da55c4-176d-4c45-b6f5-015dc644c689 -- POST / 200 403.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,021 mnist_classifier_MNISTClassifier ql67vb0i 8488428a-7136-4612-ac76-d4f16bf217ff -- POST / 200 402.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,021 mnist_classifier_MNISTClassifier ql67vb0i 67fbe481-b55d-497c-9d2b-e77f18f1319e -- POST / 200 402.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,022 mnist_classifier_MNISTClassifier ql67vb0i 25345f59-3bc0-4b60-9b2b-82dbf038f476 -- POST / 200 402.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,022 mnist_classifier_MNISTClassifier ql67vb0i 7953d41a-97c1-4da4-ad15-f2503a9415c8 -- POST / 200 401.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,022 mnist_classifier_MNISTClassifier ql67vb0i 0efd60cf-777a-4927-a266-5f4f6ae90819 -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,022 mnist_classifier_MNISTClassifier ql67vb0i 6463084f-8a37-4a79-b2c2-1aae86816d5e -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,022 mnist_classifier_MNISTClassifier ql67vb0i e5b40ee1-bad6-4c34-8ec1-51e7d51dffea -- POST / 200 356.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,023 mnist_classifier_MNISTClassifier ql67vb0i deefbc77-2954-4fd7-84bb-85b02331b33a -- POST / 200 356.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,023 mnist_classifier_MNISTClassifier ql67vb0i b0d9380f-ead0-4578-bb7c-f1f65fea773b -- POST / 200 349.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,023 mnist_classifier_MNISTClassifier ql67vb0i 2a97b228-2f4f-400e-9dab-eac69c79a867 -- POST / 200 349.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,077 mnist_classifier_MNISTClassifier ql67vb0i af01ea22-dc09-4905-a73e-0a221820a194 -- POST / 200 337.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,096 mnist_classifier_MNISTClassifier ql67vb0i aa4244dc-b02a-41a2-b354-012ef189a2e5 -- POST / 200 356.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,099 mnist_classifier_MNISTClassifier ql67vb0i 094a05f1-7658-4cc0-a98c-76b7cae2fe8c -- POST / 200 357.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,102 mnist_classifier_MNISTClassifier ql67vb0i 945851b9-e905-4f0c-8e5e-5d84b644df6e -- POST / 200 359.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,103 mnist_classifier_MNISTClassifier ql67vb0i fe88d7e4-4de7-4a42-983f-acbcc1334638 -- POST / 200 361.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,105 mnist_classifier_MNISTClassifier ql67vb0i dcb69cfb-a82b-48be-8d31-535132d70d6b -- POST / 200 361.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,108 mnist_classifier_MNISTClassifier ql67vb0i 3eb7c0f4-c45a-4c65-9867-bae6d245d5aa -- POST / 200 364.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,108 mnist_classifier_MNISTClassifier ql67vb0i 02f189b6-d2f1-4bd6-b393-3eb40d7df022 -- POST / 200 363.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,109 mnist_classifier_MNISTClassifier ql67vb0i 1089c35f-ea35-4c7f-931e-d414de05488b -- POST / 200 363.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,110 mnist_classifier_MNISTClassifier ql67vb0i 51103501-7349-4075-a8a6-4edb38ae5516 -- POST / 200 363.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,110 mnist_classifier_MNISTClassifier ql67vb0i cf325038-41c7-4636-b170-efee66c127e0 -- POST / 200 363.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,111 mnist_classifier_MNISTClassifier ql67vb0i 871fec26-258a-4a29-8c0f-4bb1d3f06319 -- POST / 200 362.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,112 mnist_classifier_MNISTClassifier ql67vb0i fcc19755-d722-49a6-9322-329b96b57773 -- POST / 200 361.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,112 mnist_classifier_MNISTClassifier ql67vb0i 69ee72cd-b985-48de-943c-5578c82952e1 -- POST / 200 360.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,112 mnist_classifier_MNISTClassifier ql67vb0i 59d5ecf8-e832-4d90-8543-e928fe0c17ca -- POST / 200 213.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,113 mnist_classifier_MNISTClassifier ql67vb0i 77e30c5a-9d79-41ff-9ce5-14a4249a278b -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,113 mnist_classifier_MNISTClassifier ql67vb0i 79e6df55-bada-4496-8d0e-c9923bb42a6f -- POST / 200 361.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,114 mnist_classifier_MNISTClassifier ql67vb0i cd95d593-5c3f-4cd6-be93-84363ac35d55 -- POST / 200 361.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,114 mnist_classifier_MNISTClassifier ql67vb0i a81dde86-ec9b-46b9-a822-53b5315e5739 -- POST / 200 218.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,115 mnist_classifier_MNISTClassifier ql67vb0i 2c43a226-7568-4e04-a39c-abe222837335 -- POST / 200 216.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,115 mnist_classifier_MNISTClassifier ql67vb0i 9a280620-cf5d-4ff5-afa4-11b53c204494 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,115 mnist_classifier_MNISTClassifier ql67vb0i fce93e93-00d0-47d4-92bf-46a5298f89c9 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,115 mnist_classifier_MNISTClassifier ql67vb0i 5f1d433c-573c-415e-a0c7-de0b90564204 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,115 mnist_classifier_MNISTClassifier ql67vb0i 04c6a9b3-0dd1-4102-8c18-b9ccf1c1f32f -- POST / 200 214.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,115 mnist_classifier_MNISTClassifier ql67vb0i 7c066235-a4a7-44fb-9379-7d8f69b646dd -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,116 mnist_classifier_MNISTClassifier ql67vb0i 79d2e4ff-b333-4ecc-91d1-f77b922b4bc9 -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,116 mnist_classifier_MNISTClassifier ql67vb0i bac1fdbb-7bb8-47aa-b9fa-6721b23c81b9 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,116 mnist_classifier_MNISTClassifier ql67vb0i ecd71a7a-a7ed-4c53-b45d-22f86f1fa192 -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,116 mnist_classifier_MNISTClassifier ql67vb0i 862fc835-6a7f-4bbc-9656-e5693df157ca -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,116 mnist_classifier_MNISTClassifier ql67vb0i 45a57a6f-0764-444f-a266-6ebeb3894844 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,248 mnist_classifier_MNISTClassifier ql67vb0i 8bf0f483-35aa-45f5-9e8d-66155985933d -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,249 mnist_classifier_MNISTClassifier ql67vb0i bab170ef-a382-4316-bfd4-a3c5a709d0f3 -- POST / 200 306.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,249 mnist_classifier_MNISTClassifier ql67vb0i 485b89e6-cc15-4642-b84c-81ed2c80294b -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,250 mnist_classifier_MNISTClassifier ql67vb0i 644d0cd9-3c42-46d6-84b9-10eca0196529 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,252 mnist_classifier_MNISTClassifier ql67vb0i b8bad8da-3561-470e-9aa7-6d64cd6ecefc -- POST / 200 220.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,253 mnist_classifier_MNISTClassifier ql67vb0i 48eda9ce-58a6-4980-9d62-fd8023d93ad2 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,254 mnist_classifier_MNISTClassifier ql67vb0i cf3a39e6-7cb2-4313-a826-777d36369384 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,256 mnist_classifier_MNISTClassifier ql67vb0i dc341af5-9dd2-4e75-8555-c84186ed4f6f -- POST / 200 225.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,260 mnist_classifier_MNISTClassifier ql67vb0i 9c5bfccd-c02b-4a24-8287-33aaf92c5a97 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,261 mnist_classifier_MNISTClassifier ql67vb0i d799c30f-da20-43ea-ae87-923b1d751e3e -- POST / 200 228.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,262 mnist_classifier_MNISTClassifier ql67vb0i f9d5f937-eaa9-4de2-b336-3f12e64d9b7c -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,262 mnist_classifier_MNISTClassifier ql67vb0i f97f0f8f-5fa4-4a59-9b79-0fc014e21cb3 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,264 mnist_classifier_MNISTClassifier ql67vb0i 55538857-ac33-4824-94e7-98006338b747 -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,264 mnist_classifier_MNISTClassifier ql67vb0i 3b5d0a3e-923a-4f72-b81e-d23d366c348e -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,264 mnist_classifier_MNISTClassifier ql67vb0i 345b9cd9-bd96-4c47-bade-ea71a9470f18 -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,266 mnist_classifier_MNISTClassifier ql67vb0i e15c4c39-5bce-4d36-9d4f-8032578b59bd -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,266 mnist_classifier_MNISTClassifier ql67vb0i a9866a3a-68bc-47e8-b310-cb9f9a359f2c -- POST / 200 225.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,267 mnist_classifier_MNISTClassifier ql67vb0i 8d797a0c-8caf-4655-bfd6-95a8b176ade5 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,269 mnist_classifier_MNISTClassifier ql67vb0i 643c93d5-8931-41b9-a5ed-b31465987586 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,271 mnist_classifier_MNISTClassifier ql67vb0i f7eaf75f-2f4f-4bd1-9063-f3726c507149 -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,271 mnist_classifier_MNISTClassifier ql67vb0i 11ce5179-9bb9-417d-989c-c74e1ca60261 -- POST / 200 219.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,271 mnist_classifier_MNISTClassifier ql67vb0i 7df95549-eb22-450e-8929-43833b86500f -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,272 mnist_classifier_MNISTClassifier ql67vb0i b7dcfc12-f549-49cd-8396-f0a4ba7d5232 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,273 mnist_classifier_MNISTClassifier ql67vb0i 03d74fbc-9b38-441d-be02-fe46c7b80758 -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,278 mnist_classifier_MNISTClassifier ql67vb0i 83f61af8-0210-4d80-8042-be4bc0ffec3c -- POST / 200 231.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,284 mnist_classifier_MNISTClassifier ql67vb0i 3ca0b3f6-5bad-4976-8db5-4a4d1b79efb8 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,285 mnist_classifier_MNISTClassifier ql67vb0i c982c6b4-0918-4f7a-bd19-105806b6d5e4 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,285 mnist_classifier_MNISTClassifier ql67vb0i 537e609c-bbd7-43ea-81a3-169f1d8476bd -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,289 mnist_classifier_MNISTClassifier ql67vb0i 57eb5b6a-4134-4c64-9cb9-884474b1395a -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,291 mnist_classifier_MNISTClassifier ql67vb0i 0f361943-86c2-460d-b967-697cc74908be -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,296 mnist_classifier_MNISTClassifier ql67vb0i e5a08aa3-61d9-4240-aa24-6d87b63f4190 -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4650) INFO 2026-06-03 00:26:59,305 mnist_classifier_MNISTClassifier ql67vb0i d4e243bf-afd2-438f-8ea5-a6ca7bda1a7e -- POST / 200 249.5ms
Processed 1000 requests in 5.14 seconds
Throughput: 194.58 requests/second

Ray Serve 会自动缓冲请求并在各个副本之间进行负载均衡。

容错能力#

在生产环境中，进程和机器故障不可避免。Ray Serve 的设计使得 Serve 堆栈中的每个主要组件（控制器、副本和代理）即使在发生故障时也能恢复，同时确保应用持续处理流量。

Serve 还可以从更严重的底层设施故障中恢复，例如整个节点或 Pod 故障。如果部署在 KubeRay 上，Serve 甚至可以从头节点（Head Node）故障或整个头 Pod 故障中恢复。

有关 Ray Serve 容错的更多信息，请参阅 Ray Serve 容错指南。

监控部署#

在运行大规模部署时，监控至关重要。Ray 仪表板显示了 Serve 的指标，如请求吞吐量、延迟和错误率。它还实时显示集群资源使用情况、副本状态以及整体部署健康状况。仪表板还允许您检查集群中各个副本的日志。

为了调试，Ray 提供了分布式调试工具，允许您将调试器附加到集群中正在运行的副本上。有关更多信息，请参阅 Ray Serve 监控文档。

结论#

在本教程中，您：

使用生产最佳实践通过 Ray Serve 部署了 PyTorch 模型。
启用了动态请求批处理以优化性能。
配置了自动伸缩和分片 GPU 分配，以实现在集群上的高效扩展。
使用并发异步请求测试了服务。

使用 Ray Serve 大规模部署 PyTorch 模型#

设置#

定义 PyTorch 模型#

定义 Ray Serve 部署#

配置自动伸缩和资源分配#

使用并发请求测试端点#

容错能力#

监控部署#

结论#

延伸阅读#

文档

教程

资源