Mask R-CNN

lastmod 2024-02-06created 2017-10-2531 edits

We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition. Mask R-CNN is simple to train and adds only a small overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to generalize to other tasks, e.g., allowing us to estimate human poses in the same framework. We show top results in all three tracks of the COCO suite of challenges, including instance segmentation, bounding-box object detection, and person keypoint detection. Without tricks, Mask R-CNN outperforms all existing, single-model entries on every task, including the COCO 2016 challenge winners. We hope our simple and effective approach will serve as a solid baseline and help ease future research in instance-level recognition. Code will be made available.

Categories

• MaskRCNN:Paper: paper translation.
• MaskRCNN:Example:VideoReadWrite - Video Read & Write Python example for the Mask R-CNN demo.
• MaskRCNN:Example:ExcelReport - outputs a report of Mask R-CNN results as an Excel file.
• Detectron2#Logging fields - how to read each graph when viewing the post-training log files in Korean: 텐서보드 (TensorBoard).

Documentation

Mask R-CNN

https://arxiv.org/abs/1703.06870

Implementation

Keras implementation of MaskRCNN object detection.

https://github.com/fizyr/keras-maskrcnn

Faster R-CNN and Mask R-CNN in PyTorch 1.0 (maskrcnn-benchmark)

facebook research

Mask R-CNN for Object Detection and Segmentation (Keras and TensorFlow)

https://github.com/matterport/Mask_RCNN

See also

• Faster R-CNN
• Object Recognition
• Path Aggregation Network for Instance Segmentation (PANet)
• Instance segmentation
• Semantic Segmentation
• Detectron
• Detectron2
• RetainNet
• RetinaMask
• Fully Convolutional One-Stage Object Detection (FCOS)
• Mask Scoring R-CNN (MS R-CNN)
• TensorMask
• Mesh R-CNN
• Mask2Former - feels like Masked-RCNN with a Transformer attached?

Favorite site

• From R-CNN to Mask R-CNN
• [Recommended] sogangori - MASK R-CNN ¹
• Mask R-CNN | TensorMSA
• (Translation) A short story about Image Segmentation: from R-CNN to Mask R-CNN
• Mask R-CNN | TensorMSA
• MASK R-CNN - Myeongsang (Meditation) : Naver Blog
• Key models using CNN - (4) : Semantic Segmentation
• Part 1: First steps in Semantic Segmentation!

Project site

• Github - Mask R-CNN project site (Keras and TensorFlow)
• Github - CharlesShang/FastMaskRCNN TensorFlow
• Github - roytseng-tw/Detectron.pytorch

Guide

• Image segmentation with Mask R-CNN
• Mask R-CNN - a summary focused on terminology
• lazyer.tistory.com - MaskRCNN

References