Qwen-Image-i2L: Training Strategies for Image-to-LoRA Generation

Qwen-Image-i2L is an innovative model designed to convert an image directly into a LoRA model's weights, aiming to compress the typically lengthy LoRA training process into a single model pass. The development faced challenges due to computational constraints and parameter management, leading to the implementation of a two-layer fully-connected architecture and stronger image encoding models. The Qwen-Image-i2L-Style version demonstrated strong style extraction but lacked detail preservation, prompting further iterations like Qwen-Image-i2L-Coarse and Qwen-Image-i2L-Fine, which improved detail preservation at the cost of style preservation. The final version, Qwen-Image-i2L-Bias, used differential training to align the dataset distribution and patched together a mixture of expert architectures for better performance. The model, while not yet matching conventionally trained LoRAs, shows promise for future development and serves as an effective initialization for LoRA training. The project highlights the potential and challenges of the ambitious "Image-to-LoRA" concept, with ongoing efforts to enhance model capabilities.