[LoRA serialization] fix: duplicate unet prefix problem.#5991

sayakpaul merged 3 commits into

mainhuggingface/diffusers:mainfrom

fix/lora-serialization-formathuggingface/diffusers:fix/lora-serialization-formatCopy head branch name to clipboard