(Conference Paper) Image Cropping Assisted By Modeling Inter-Patch Relations
Tianpei Lian 连天培 ¹, Zhiguo Cao 曹治国 ¹, Hao Lu 陆昊 ¹, Zijin Wu ¹, Weicai Zhong ²
¹ School of Artificial Intelligence and Automation, Huazhong University of Science and Technology
华中科技大学 人工智能与自动化学院
² Huawei CBG Consumer Cloud Service Big Data Platform Dept
华为消费者云服务 大数据平台部
2021 IEEE International Conference on Image Processing (ICIP), 2021-08-23
Abstract
Image cropping is a common way to enhance the aesthetic quality of images. Huge industrial demand and the tediousness of image cropping make automatic image cropping a prosperous task. Existing works, however, face two difficulties: objects are easily truncated and key components of images are discarded by the model. The key to solving this problem is to understand the relations between different components of an image.
These relations break the limit of spatial distance and reflect the contextual information in images, which help the model decide whether to retain a component. Motivated by this, a patch-related graph module is proposed to model the relations between different patches of an image. The patch-related features are extracted by a graph convolution layer and then fused with the original local features by a proposed gated unit.
Moreover, a gradient layer is designed to embed the edge information in the input. The edge-prior input helps the model read the contents of images and reserve the main objects completely. Experimental results show that our model grasps the inter-patch relations well and performs competitively with other state-of-the-art approaches.
Multiplexed stimulated emission depletion nanoscopy (mSTED) for 5-color live-cell long-term imaging of organelle interactome
Yuran Huang, Zhimin Zhang, Wenli Tao, Yunfei Wei, Liang Xu, Wenwen Gong, Jiaqiang Zhou, Liangcai Cao, Yong Liu, Yubing Han, Cuifang Kuang, Xu Liu
Opto-Electronic Advances
2024-07-05