Logo image
Exploring Incompatible Knowledge Transfer in Few-shot Image Generation
Conference proceeding

Exploring Incompatible Knowledge Transfer in Few-shot Image Generation

Yunqing Zhao, Chao Du, Milad Abdollahzadeh, Tianyu Pang, Min Lin, Shuicheng Yan and Ngai-Man Cheung
Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online), Vol.2023-, pp.7380-7391
06/2023

Abstract

Computer architecture Computer vision Degradation Estimation Image and video synthesis and generation Image synthesis Information filters Training
Few-shot image generation (FSIG) learns to generate diverse and high-fidelity images from a target domain using a few (e.g., 10) reference samples. Existing FSIG methods select, preserve and transfer prior knowledge from a source generator (pretrained on a related domain) to learn the target generator. In this work, we investigate an underexplored issue in FSIG, dubbed as incompatible knowledge transfer, which would significantly degrade the realisticness of synthetic samples. Empirical observations show that the issue stems from the least significant filters from the source generator. To this end, we propose knowledge truncation to mitigate this issue in FSIG, which is a complementary operation to knowledge preservation and is implemented by a lightweight pruning-based method. Extensive experiments show that knowledge truncation is simple and effective, consistently achieving state-of-the-art performance, including challenging setups where the source and target domains are more distant. Project Page: yunqing-me.github.io/RICK.

Metrics

1 Record Views

Details

Logo image