アノテーションの補助・自動化をするPolygon RNN, Polygon RNN++

アノテーションは高コスト

Tasks and Annotations

Polygon RNN

  1. polygon RNNは領域分割アノテーションを半自動化することで、アノテーションの手伝いができるモデル
  2. 領域分割を『物体の頂点を探索する問題』として解く
  3. CNNで特徴量を抽出し、探索済みの頂点を時系列としてRNNに入れることで新たな頂点を探索する
  4. 人の修正を介在させることができる
Overview of Polygon RNN

Polygon RNNの構造

Feature Extractor with VGG
Vortex prediction with RNN

Polygon RNNの性能

Polygon RNNの問題点

Polygon RNN++の概要

強化学習でIoUを最大化する

Evaluator Network

Gated Graph Neural Networks

Encoderの変更

Polygon RNN++の結果

まとめ

Reference

  • L. Castrejon et al. Annotating object instances with a polygon-rnn.
  • D. Acuna et al. Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++
  • R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning
  • S. J. Rennie et al. Self-critical sequence training for image captioning

--

--

--

Data Scientist (Engineer) in Japan Twitter : https://twitter.com/AkiraTOSEI LinkedIn : https://www.linkedin.com/mwlite/in/亮宏-藤井-999868122

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Akihiro FUJII

Akihiro FUJII

Data Scientist (Engineer) in Japan Twitter : https://twitter.com/AkiraTOSEI LinkedIn : https://www.linkedin.com/mwlite/in/亮宏-藤井-999868122

More from Medium

Colorful Image Colorization

A Review of Contrastive Learning for Unpaired Image to Image Translation

Review: VPGNet — A Multi-Task Network for Autonomous Driving

Why Image Augmentation — Part 1