Add support for batched decoding api#795

abetlen merged 11 commits into

mainabetlen/llama-cpp-python:mainfrom

add-support-for-llama-batchabetlen/llama-cpp-python:add-support-for-llama-batchCopy head branch name to clipboard