The impact of text pre-processing to determine the similarity in students assignments

ABSTRACT

The aim of this paper is to appraise of the problems of plagiarism in students assignments. We focus on pre-processing techniques of Slovak texts assignments such as removing stop words, replacing synonyms, lemmatization, using of readability index. The main goal of this paper is find out if we can identify original student assignment and plagiarism of original student assignment based on their readability. Based on the result of further experimentation, we find which combinations of pre-processing techniques and methods for determining the similarity of students assignments are the most suitable, if we want to detect similarity as exactly as possible and for particular techniques to find out the extent in detection of categorised types of plagiarism.

References

1. Chudá, D., Návrat, P.: Support for checking plagiarism in e-learning, Procedia -Social and Behavioral Sciences, Volume 2, Issue 2, Innovation and Creativity in Education, 2010, Pages 3140--3144, ISSN 1877--0428
2. DuBay, W. H.: The Principles of Readability. Impact Information, Costa Mesa, 2004.
3. Flesch, R.: A new readability yardstick In Journal of Applied Psychology, Volume 32, 1948, 221--233.
4. Jones, K. O.: Practical Issues for Academics Using the Turnitin Plagiarism Detection Software, In Proceedings of the 9th international Conference on Computer Systems and Technologies and Workshop For PhD Students in Computing(Gabrovo, Bulgaria, June 12-13, 2008). B. Rachev and A. Smrikarov, Eds. CompSysTech '08, vol. 374. ACM, New York, NY, P. IV-1.
5. Lukashenko, R., Graudina, V., and Grundspenkis, J. 2007. Computer-based plagiarism detection methods and tools: an overview. In Proceedings of the 2007 international Conference on Computer Systems and Technologies (Bulgaria, June 14 - 15, 2007). B. Rachev, A. Smrikarov, and D. Dimov, Eds. CompSysTech '07, vol. 285. ACM, New York, NY, 1--6.
6. Návrat, P., Taraba, T., Bou Ezzeddine, A., Chudá, D.: Context Search Enhanced by Readability Index. In: IFIP AI Milan Italy, Artificial Intelligence in Theory and Practice II, Springer Boston, ISBN 978-0-387-09694-0, 2008
7. Zahoranský, D., Polášek, I.: Rule Based Phonetic Search Approaches for Central Europe. In SISY 2010, 8th International Symposium on Intelligent Systems and Informatics, Subotica, Serbia, September 2010. -: IEEE, 2010. - ISBN 978-1-4244-7395-3. - P. 71--76

Index Terms

• Applied computing

  • Education

  • Enterprise computing

• Computing methodologies

  • Artificial intelligence

    • Natural language processing

      • Language resources

  • Machine learning

    • Learning paradigms

      • Unsupervised learning

        • Cluster analysis