Source selection languages: a usability evaluation
Registro en:
978-1-4503-5827-9
instname:Universidad de Bogotá Jorge Tadeo Lozano
reponame:Repositorio Institucional de la Universidad de Bogotá Jorge Tadeo Lozano
Autor
Galpin, Ixent
Abel, Edward
Paton, Norman W.
Institución
Resumen
When looking to obtain insights from data, and given numerous
possible data sources, there are certain quality criteria that retrieved
data from selected sources should exhibit so as to be most fit-forpurpose.
An effective source selection algorithm can only provide
good results in practice if the requirements of the user have been
suitably captured, and therefore, an important consideration is how
users can effectively express their requirements.
In this paper, we carry out an experiment to compare user performance
in two different languages for expressing user requirements
in terms of data quality characteristics, pairwise comparison of criteria
values, and single objective constrained optimization. We employ
crowdsourcing to evaluate, for a set of tasks, user ability to choose
effective formulations in each language. The results of this initial
study show that users were able to determine more effective formulations
for the tasks using pairwise comparisons. Furthermore, it
was found that users tend to express a preference for one language
over the other, although it was not necessarily the language that
they performed best in.