Skip to content

TorchScript server #990

@lutzroeder

Description

@lutzroeder

Prototype exploring to use the Python Server to load and serve TorchScript models.

Example:

import torch
import torchvision
import netron
model = torchvision.models.resnet34()
model = torch.jit.script(model)
traced_model = torch.jit.trace(model, torch.zeros([1, 3, 224, 224]), strict=True)
torch._C._jit_pass_inline(traced_model.graph)
netron.serve('resnet34', traced_model)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions