This website requires JavaScript.

SAPA: Similarity-Aware Point Affiliation for Feature Upsampling

Hao LuWenze LiuZixuan YeHongtao FuYuliang LiuZhiguo Cao
Sep 2022
摘要
We introduce point affiliation into feature upsampling, a notion thatdescribes the affiliation of each upsampled point to a semantic cluster formedby local decoder feature points with semantic similarity. By rethinking pointaffiliation, we present a generic formulation for generating upsamplingkernels. The kernels encourage not only semantic smoothness but also boundarysharpness in the upsampled feature maps. Such properties are particularlyuseful for some dense prediction tasks such as semantic segmentation. The keyidea of our formulation is to generate similarity-aware kernels by comparingthe similarity between each encoder feature point and the spatially associatedlocal region of decoder features. In this way, the encoder feature point canfunction as a cue to inform the semantic cluster of upsampled feature points.To embody the formulation, we further instantiate a lightweight upsamplingoperator, termed Similarity-Aware Point Affiliation (SAPA), and investigate itsvariants. SAPA invites consistent performance improvements on a number of denseprediction tasks, including semantic segmentation, object detection, depthestimation, and image matting. Code is available at:https://github.com/poppinace/sapa
展开全部
图表提取

暂无人提供速读十问回答

论文十问由沈向洋博士提出,鼓励大家带着这十个问题去阅读论文,用有用的信息构建认知模型。写出自己的十问回答,还有机会在当前页面展示哦。

Q1论文试图解决什么问题?
Q2这是否是一个新的问题?
Q3这篇文章要验证一个什么科学假设?
0
被引用
笔记
问答