Arbitrary-Oriented Scene Text Detection
via Rotation Proposals

Overview

This paper introduces a novel rotation-based framework for arbitrary-oriented text detection in natural scene images. We present the Rotation Region Proposal Networks (RRPN), which is designed to generate inclined proposals with text orientation angle information. The angle information is then adapted for bounding box regression to make the proposals more accurately fit into the text region in orientation. The Rotation Region-of-Interest (RRoI) pooling layer is proposed to project arbitrary-oriented proposals to the feature map for a text region classifier. The whole framework is built upon region proposal based architecture, which ensures the computational efficiency of the arbitrary-oriented text detection comparing with previous text detection systems.

We conduct experiments using the rotation-based framework on three real-world scene text detection datasets, and demonstrate its superiority in terms of effectiveness and efficiency over previous approaches.


Code

The code can be downloaded from github.

Please cite our paper if you use the code in your research: 

@article{ma2018arbitrary,
    title={Arbitrary-Oriented Scene Text Detection via Rotation Proposals},
    author={Ma, Jianqi and Shao, Weiyuan and Ye, Hao and Wang, Li and Wang, Hong and Zheng, Yingbin and Xue, Xiangyang},
    journal={IEEE Transactions on Multimedia},
    volume={20}, 
    number={11}, 
    pages={3111-3122}, 
    year={2018}
}

Related Publication

  • J. Ma, W. Shao, H. Ye, L. Wang, H. Wang, Y. Zheng, X. Xue
    Arbitrary-Oriented Scene Text Detection via Rotation Proposals [pdf]
    IEEE Transactions on Multimedia, vol. 20, no. 11, pp. 3111-3122, 2018.
[Back]