July 2024 Summaries

AuraSR V2, the latest version of the single-step GAN upscaler, has been released by the team, addressing several limitations identified in its predecessor. While AuraSR V1 was based on the Adobe Gigagan paper and faced issues upscaling JPG compressed images without artifacts, the new version incorporates a degradation process similar to ESRGAN training to better handle various image degradations. Improvements in V2 also include a revised training approach using 256-pixel tiles of 1024-pixel images, which aligns more closely with the inference process and helps reduce excessive detail addition. Another enhancement is the introduction of the upscale_4x_overlapped inference method, which minimizes seams in images by averaging results from overlapping tiles. Although AuraSR V2 retains the same architecture as V1, making it a straightforward replacement, it better preserves details in "in the wild" images compared to other models like RealESRGAN, and the model is now available on Huggingface and deployed to fal's AuraSR endpoint. Plans for AuraSR V3 include using higher resolution images and a new architecture to further enhance the model's capabilities.

AuraFlow v0.1 is a newly released open-source AI model from Team fal, designed for text-to-image generation and boasting significant advancements in scalability and efficiency. Despite concerns about the decline of open-source AI, AuraFlow reaffirms the community's resilience and innovation, featuring optimized training methods that enhance its performance. Developed in collaboration with researcher Simo, the model leverages advanced techniques such as maximal-update-parameterization and a unique approach to captioning, drawing inspiration from models like DALL·E 3. AuraFlow's architecture has been fine-tuned to maximize hardware utilization, making it not only powerful but also adaptable to various computational environments. The developers plan to continue refining the model, with future versions potentially more accessible for consumer-grade hardware. They encourage community experimentation and contributions, aiming to establish AuraFlow as a foundational tool for future AI developments.