In this article, I present a total of 84 papers and articles published in 2020 that I found particularly interesting. For the sake of clarity, I divide them into 12 sections. My personal summary for 2020 is as follows.

— — — — — My personal summary for 2020 — — — — —

In 2020, Transformer model made a huge leap forward. In natural language processing, GPT-3, a large scale Transformer model, has achieved high accuracy in many tasks. Using a large amount of data and a large number of parameters, it has surpassed Big Transfer, which had the highest accuracy in image classification.
Fractal image datasets that are free of discriminatory elements and…


Summary for Week 26, 2021 (June 27~)

Featured Paper/News in This Week.

Machine Learning in the Real World


On the differences between Transformer and CNN, why Transformer matters, and what its weaknesses are.

About this post

This article discusses some of the interesting research and insights in Transformer x Computer Vision research since the advent of Vision Transformer. The four themes of this article are as follows

  1. Differences in receptive fields sizes and behavior between Transformer and CNN
  2. Is Self-Attention essential for Transformer?
  3. Weaknesses of Vision Transformers and directions for improvement
  4. The rapid expansion of the Transformer and why it is so important

As a summary of this article, my view is as follows:

  • Since Vision Transformer, the scope of application of Transformer has expanded rapidly. I personally think that the reason for this is that…

Week 25, 2021 (June 20~)

Featured Paper/News in This Week.

Machine Learning in the Real World


Week 24, 2021 (June 13~)

Featured Paper/News in This Week.


Week 23 (June 6~ ), 2021

Featured Paper/News in This Week.


Week 13 , 2021 (28 March ~ )

※The date of publication of the paper or article is not necessarily the same week

Featured Paper/News in This Week.


Week 12 , 2021

※The date of publication of the paper or article is not necessarily the same week

Featured Paper/News in This Week.


※ The date of publication of the paper or article is not necessarily the same week.

Featured Paper/News in This Week.


Featured Paper/News in This Week.

Akihiro FUJII

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store