Sparse Reconstruction for Weakly Supervised Semantic Segmentation

Ke Zhang, Wei Zhang, Yingbin Zheng, Xiangyang Xue



For better understanding and management of massive images, semantic segmentation aims to identify the semantic label of pixels of images, i.e., assign each pixel in an image to one of pre-defined semantic categories.

Most state-of-the-art rely on training set that every pixel of images are annotated, which is time-consuming and limited in resources.


The main difficulty of faced by the weakly supervised semantic segmentation task:


We use "evaluation" of classifiers instead of training a classifier

Substantiation is given by the costs of samples reconstructed by the subspace of each semantic class

New criterion for evaluation of classifiers:

Our Approach

Iterative Merge Update:




[Kohli et al., 2009] P. Kohli, L. Ladick`y, and P.H.S. Torr. Robust higher order potentials for enforcing label consistency. IJCV, 82(3):302–324, 2009.

[Ladicky et al., 2009] L. Ladicky, C. Russell, P. Kohli, and P.H.S. Torr. Associative hierarchical crfs for object class image segmentation. In ICCV, 2009.

[Ladicky et al., 2010] L. Ladicky, C. Russell, P. Kohli, and P. Torr. Graph cut based inference with co-occurrence statistics. ECCV, 2010.

[Munoz et al., 2010] Daniel Munoz, J Andrew Bagnell, and Martial Hebert. Stacked hierarchical labeling. In ECCV, 2010.

[Shotton et al., 2008] J. Shotton, M. Johnson, and R. Cipolla. Semantic texton forests for image categorization and segmentation. In CVPR, 2008.

[Vezhnevets et al., 2011] A. Vezhnevets, V. Ferrari, and J.M. Buhmann. Weakly supervised semantic segmentation with a multi-image model. In ICCV, 2011.

[Vezhnevets et al., 2012] A. Vezhnevets, V. Ferrari, and J.M. Buhmann. Weakly supervised structured output learning for semantic segmentation. In CVPR, 2012.

[back to index]