Actas de congresos
Optimization of algorithm to identification of duplicate tuples through similarity phonetic based on multithreading
Fecha
2011-12-01Registro en:
Parallel and Distributed Computing, Applications and Technologies, PDCAT Proceedings, p. 299-304.
10.1109/PDCAT.2011.58
2-s2.0-84856660893
4644812253875832
4035066471503413
5914651754517864
0000-0002-9325-3159
0000-0002-7449-9022
Autor
Universidade Estadual Paulista (Unesp)
Institución
Resumen
Aiming to ensure greater reliability and consistency of data stored in the database, the data cleaning stage is set early in the process of Knowledge Discovery in Databases (KDD) and is responsible for eliminating problems and adjust the data for the later stages, especially for the stage of data mining. Such problems occur in the instance level and schema, namely, missing values, null values, duplicate tuples, values outside the domain, among others. Several algorithms were developed to perform the cleaning step in databases, some of them were developed specifically to work with the phonetics of words, since a word can be written in different ways. Within this perspective, this work presents as original contribution an optimization of algorithm for the detection of duplicate tuples in databases through phonetic based on multithreading without the need for trained data, as well as an independent environment of language to be supported for this. © 2011 IEEE.