Skip to content

feat: add auto into --runtime or alike to auto select best suitable runtime #1024

Description

@xieofxie

It is easy to tell from ort (an onnx file) and ort-genai (a folder with genai_config.json)

As a follow up of #1015

Folder itself is not enough if we support transformer style inference, it is still using ort not ort-genai

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions