Object Detection in Online Proctoring Through Two Camera Using Faster-RCNN


  • I Wayan Suardinata State Politechnic of Banyuwangi
  • Vivien Arief Wardhany State Politechnic of Banyuwangi




Computer vision, Machine learning, Object detection, Pose detection, Proctoring


The COVID-19 pandemic has prompted changes in teaching methods from offline to online, including the implementation of exams. But many reports say that the potential for online exam cheating is very high which can compromise the credibility of the exam. The online exam monitoring system using one camera makes it difficult for officers to make decisions because of the lack of evidence and supporting data. In this study, we propose a monitoring approach using two cameras, namely a camera on a laptop to get a front view of the participant and a cellphone camera to get a side view of the examinee but because of the complexity of the problem, at this stage we only focus on the side camera. Implementation begins with the collection of video recording data, custom data sets for training and pretrained datasets from the zoo model. Training is carried out using a custom dataset to detect objects that are not recognized by the pretrained dataset. The evaluation of the training results using the COCO evaluator showed the average of the bbox-AP is 59,169. The fraud detection process is carried out using 6 exam videos with a total of 192,929 frames, producing two outputs, namely object detection videos and csv files. The csv file contains the frame number, time, object detected in each frame. The next process is to analyze the csv file and mark frames that have the potential to be fraudulent. The evaluation results show an accuracy of 0.884615385 and a recall of 0.821428571


Haotian Li, Min Xu, Yong Wang, Huan Wei, Huamin Qu. 2021. A Visual Analytics Approach to Facilitate the Proctoring of Online Exams. 2021. arXiv:2101.07990v1 [cs.HC] 20 Jan 2021

Darwin L. King and Carl J. Case. 2014. E-cheating: Incidence and trends among college students. Issues in Information Systems 15, 1 (2014), 20–27.

Jeroen Janz, Community for Learning Innovation, https://www.erasmusmagazine.nl/ en/2020/09/10/eur-considers-using-second-camera-in-proctored-online-exams. Diakses pada 24 Maret 2021

Chia Yuan Chuang, Scotty D. Craig, and John Femiani. 2017. Detecting probable cheating during online assessments based on time delay and head pose. Higher Education Research & Development 36, 6 (2017), 1123–1137. https://doi.org/10.1080/07294360.2017. 1303456

Ahmad Khawaji, Fang Chen, Jianlong Zhou, and Nadine Marcus. 2014. Trust and cognitive load in the text-chat environment: the role of mouse movement. In the 26th Australian Computer-Human Interaction Conference on Designing Futures - the Future of Design, OZCHI ’14, Sydney, New South Wales, Australia, December 2-5, 2014. ACM, New York, NY, USA, 324–327. https://doi.org/10.1145/ 2686612.2686661

Darwin L. King and Carl J. Case. 2014. E-cheating: Incidence and trends among college students. Issues in Information Systems 15, 1 (2014), 20–27.

Gennaro Costagliola, Vittorio Fuccella, Massimiliano Giordano, and Giuseppe Polese. 2009. Monitoring online tests through data visualization. IEEE Transactions on Knowledge and Data Engineering. 21, 6 (2009), 773–784. https://doi.org/10.1109/TKDE.2008.133

Xuanchong Li, Kai-min Chang, Yueran Yuan, and Alexander Hauptmann. 2015. Massive open online proctor: Protecting the credibility of MOOCs certificates. In the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW 2015, Vancouver, BC, Canada. Association for Computing Machinery, New York, NY, USA, 1129–1137. https://doi.org/10.1145/ 2675133.2675245

Gosia Migut, Dennis Koelma, Cees G. M. Snoek, and Natasa Brouwer. 2018. Cheat me not: Automated proctoring of digital exams on bring-your-own-device. In the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, ITiCSE 2018, Larnaca, Cyprus. ACM, New York, NY, USA, 388. https://doi.org/10.1145/3197091.3205813




How to Cite

I. W. Suardinata and V. A. Wardhany, “Object Detection in Online Proctoring Through Two Camera Using Faster-RCNN”, Jartel, vol. 13, no. 2, pp. 120-127, Apr. 2023.