Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published February 24, 2022 | Submitted
Report Open

FreeSOLO: Learning to Segment Objects without Annotations

Abstract

Instance segmentation is a fundamental vision task that aims to recognize and segment each object in an image. However, it requires costly annotations such as bounding boxes and segmentation masks for learning. In this work, we propose a fully unsupervised learning method that learns class-agnostic instance segmentation without any annotations. We present FreeSOLO, a self-supervised instance segmentation framework built on top of the simple instance segmentation method SOLO. Our method also presents a novel localization-aware pre-training framework, where objects can be discovered from complicated scenes in an unsupervised manner. FreeSOLO achieves 9.8% AP₅₀ on the challenging COCO dataset, which even outperforms several segmentation proposal methods that use manual annotations. For the first time, we demonstrate unsupervised class-agnostic instance segmentation successfully. FreeSOLO's box localization significantly outperforms state-of-the-art unsupervised object detection/discovery methods, with about 100% relative improvements in COCO AP. FreeSOLO further demonstrates superiority as a strong pre-training method, outperforming state-of-the-art self-supervised pre-training methods by +9.8% AP when fine-tuning instance segmentation with only 5% COCO masks. Code is available at: github.com/NVlabs/FreeSOLO

Additional Information

Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) Part of this work was done when XW was an intern at NVIDIA, and CS was with The Univerity of Adelaide.

Attached Files

Submitted - 2202.12181.pdf

Files

2202.12181.pdf
Files (6.0 MB)
Name Size Download all
md5:cd2a68286bc5dca68593fa123f763c9e
6.0 MB Preview Download

Additional details

Created:
August 20, 2023
Modified:
October 23, 2023