A New Native Video Filtering based on OpenGL ES for Mobile Platform

Sari Wijayanti, Burhan Alfironi Muktamar, Sunu Wibirama, Agus Bejo

Abstract


In the last five years, there have been many Android applications implementing video filter or video effect as an excellent feature. Open CV is an open source computer vision library that can be simply and easily used for video filtering in Android application. However, using OpenCV library for video filtering commonly yields a bigger size of Android application. The concept of “Develop for Billion People†has enforced the developers to optimize the size of their applications to preserve resources and size of memory—as not all Android devices come with sufficiently large memory. On the other hand, OpenGL ES does not burden the filtering process because of its smaller size when it is implemented during the application development. In this research, we present a new native video processing technique using OpenGL ES. We implement the proposed method on a native video file without decreasing its quality before video filtering process. The experiments were conducted with five different mobile devices. We compared several metrics including: quality of the resulted video, file size of the apk, power consumption, and memory usage. Based on the experimental results, OpenGL ES produces smaller file size of apk (2 MB) compared with the produced file size of apk by Open CV (20MB). The resulted file after video filtering possesses same properties as observed before video filtering. Additionally, OpenGL ES uses more efficient power with 0.1965 mAh, while OpenCV consumes 0.283 mAh. Finally, video filtering with OpenGL ES uses 29.3% lesser memory than video filtering with OpenCV. The proposed method is proven to be more appropriate with “Develop for Billion People†as it preserves more computational resources compared with the existing video filtering technique in Android.

Keywords


video processing; video filter; OpenCV; OpenGL ES

Full Text:

PDF

References


Google Developers Guide. (2019) OpenGL ES. [Online]. Available: https://developer.android.com/guide/topics/graphics/opengl.

B. van der Wielen. (2018) Insight into the 2.3 Billion Android Smartphones in Use around the World. [Online]. Available: https://newzoo.com/insights/articles/insights-into-the-2-3-billion- android-smartphones-in-use-around-the-world/.

A. Kaehler and G. Bradski, Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library, California, United States of America: O'Reilly, 2017.

B. Radovic, G. Miljkovic, B. Bogicevic, and V. Mihic, “Rendering of digital video content through OpenGL ES on Smart TV,†in 2013 21st Telecommunications Forum Telfor, TELFOR 2013 - Proceedings of Papers, 2013, pp. 709–712.

E. Angel, “The Case for Teaching Computer Graphics with WebGL: A 25-Year Perspective,†IEEE Comput. Graph. Appl., vol. 37, no. 2, pp. 106–112, 2017.

M. Borg and C. J. Debono, “Fast High Definition Video Rendering on Mobile Devices,†in Proc. 18th Mediterr. Electrotech. Conf. MELECON 2016, 2016, pp. 18–20.

V. P. S., S. Kamath, H. Sarojadevi, and N. N. Chiplunkar, “An Approach for Bitstream Video Watermarking on Mobile Device,†in Proc. of. International conference on Signal Processing, Communication, Power and Embedded System (SCOPES), 2016, pp. 578–583.

P. S. Venugopala, A. A. Nayak, H. Sarojadevi, and N. N. Chiplunkar, “Various challenges in video watermarking for Android mobile devices,†in Proc. - IEEE Int. Conf. Inf. Process. ICIP, 2015, pp. 248–253.

S. B. Chaudhari and S. A. Patil, “Real Time Video Processing and Object Detection on Android Smartphone,†in Proc. of International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO), 2015.

K. M. bin Saipullah, A. Anuar, N. A. binti Ismail, and Y. Soo, “Real-Time Video Processing Using Native Programming on Android Platform,†in 2012 IEEE 8th Int. Colloq. Signal Process. its Appl., pp. 276–281, 2012.

C. Wu, B. Yang, W. Zhu, and Y. Zhang, “Toward High Mobile GPU Performance Through Collaborative Workload Offloading,†IEEE Trans. Parallel Distrib. Syst., vol. 29, no. 2, pp. 435–449, 2018.

J. Song, P. Wang, Q. Miao, R. Liu, and B. Huang, “The Reconnection of Contour Lines from Scanned Color Images of Topographical Maps Based on GPU Implementation,†IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 10, no. 2, pp. 400–408, 2017.

Y. Shen, M. Yang, B. Wei, C. T. Chou, and W. Hu, “Learn to Recognise: Exploring Priors of Sparse Face Recognition on Smartphones,†IEEE Trans. Mob. Comput. vol. 16, no. 6, pp. 1705–1717, 2017.

Z. Zhang and C. Yin, “Research on video rendering on android,†in Proc. of The 8th International Conference on Wireless Communications, Networking and Mobile Computing, 2012, pp. 1– 4.

J. Luo, J. Chen, L. Han, and M. Li, “Video after-effect rendering based on pipelining principle,†in Proc. - 6th Int. Conf. Internet Comput. Sci. Eng. ICICSE 2012, 2012, pp. 102–106.

Google Developers Guide. (2019) Platform Architecture. [Online]. Available: https://developer.android.com/guide/platform.

S. Wibirama, H. A. Nugroho, and K. Hamamoto, "Evaluating 3D Gaze Tracking in Virtual Space: A Computer Graphics Approach," Entertainment Computing, Vol. 21, pp. 11-17, 2017.




DOI: http://dx.doi.org/10.18517/ijaseit.9.3.7329

Refbacks

  • There are currently no refbacks.



Published by INSIGHT - Indonesian Society for Knowledge and Human Development