-
What is Hiding in Medicine's Dark Matter? Learning with Missing Data in Medical Practices
Authors:
Neslihan Suzen,
Evgeny M. Mirkes,
Damian Roland,
Jeremy Levesley,
Alexander N. Gorban,
Tim J. Coats
Abstract:
Electronic patient records (EPRs) produce a wealth of data but contain significant missing information. Understanding and handling this missing data is an important part of clinical data analysis and if left unaddressed could result in bias in analysis and distortion in critical conclusions. Missing data may be linked to health care professional practice patterns and imputation of missing data can…
▽ More
Electronic patient records (EPRs) produce a wealth of data but contain significant missing information. Understanding and handling this missing data is an important part of clinical data analysis and if left unaddressed could result in bias in analysis and distortion in critical conclusions. Missing data may be linked to health care professional practice patterns and imputation of missing data can increase the validity of clinical decisions. This study focuses on statistical approaches for understanding and interpreting the missing data and machine learning based clinical data imputation using a single centre's paediatric emergency data and the data from UK's largest clinical audit for traumatic injury database (TARN). In the study of 56,961 data points related to initial vital signs and observations taken on children presenting to an Emergency Department, we have shown that missing data are likely to be non-random and how these are linked to health care professional practice patterns. We have then examined 79 TARN fields with missing values for 5,791 trauma cases. Singular Value Decomposition (SVD) and k-Nearest Neighbour (kNN) based missing data imputation methods are used and imputation results against the original dataset are compared and statistically tested. We have concluded that the 1NN imputer is the best imputation which indicates a usual pattern of clinical decision making: find the most similar patients and take their attributes as imputation.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
An Informational Space Based Semantic Analysis for Scientific Texts
Authors:
Neslihan Suzen,
Alexander N. Gorban,
Jeremy Levesley,
Evgeny M. Mirkes
Abstract:
One major problem in Natural Language Processing is the automatic analysis and representation of human language. Human language is ambiguous and deeper understanding of semantics and creating human-to-machine interaction have required an effort in creating the schemes for act of communication and building common-sense knowledge bases for the 'meaning' in texts. This paper introduces computational…
▽ More
One major problem in Natural Language Processing is the automatic analysis and representation of human language. Human language is ambiguous and deeper understanding of semantics and creating human-to-machine interaction have required an effort in creating the schemes for act of communication and building common-sense knowledge bases for the 'meaning' in texts. This paper introduces computational methods for semantic analysis and the quantifying the meaning of short scientific texts. Computational methods extracting semantic feature are used to analyse the relations between texts of messages and 'representations of situations' for a newly created large collection of scientific texts, Leicester Scientific Corpus. The representation of scientific-specific meaning is standardised by replacing the situation representations, rather than psychological properties, with the vectors of some attributes: a list of scientific subject categories that the text belongs to. First, this paper introduces 'Meaning Space' in which the informational representation of the meaning is extracted from the occurrence of the word in texts across the scientific categories, i.e., the meaning of a word is represented by a vector of Relative Information Gain about the subject categories. Then, the meaning space is statistically analysed for Leicester Scientific Dictionary-Core and we investigate 'Principal Components of the Meaning' to describe the adequate dimensions of the meaning. The research in this paper conducts the base for the geometric representation of the meaning of texts.
△ Less
Submitted 31 May, 2022;
originally announced May 2022.
-
Semantic Analysis for Automated Evaluation of the Potential Impact of Research Articles
Authors:
Neslihan Suzen,
Alexander Gorban,
Jeremy Levesley,
Evgeny Mirkes
Abstract:
Can the analysis of the semantics of words used in the text of a scientific paper predict its future impact measured by citations? This study details examples of automated text classification that achieved 80% success rate in distinguishing between highly-cited and little-cited articles. Automated intelligent systems allow the identification of promising works that could become influential in the…
▽ More
Can the analysis of the semantics of words used in the text of a scientific paper predict its future impact measured by citations? This study details examples of automated text classification that achieved 80% success rate in distinguishing between highly-cited and little-cited articles. Automated intelligent systems allow the identification of promising works that could become influential in the scientific community.
The problems of quantifying the meaning of texts and representation of human language have been clear since the inception of Natural Language Processing. This paper presents a novel method for vector representation of text meaning based on information theory and show how this informational semantics is used for text classification on the basis of the Leicester Scientific Corpus.
We describe the experimental framework used to evaluate the impact of scientific articles through their informational semantics. Our interest is in citation classification to discover how important semantics of texts are in predicting the citation count. We propose the semantics of texts as an important factor for citation prediction.
For each article, our system extracts the abstract of paper, represents the words of the abstract as vectors in Meaning Space, automatically analyses the distribution of scientific categories (Web of Science categories) within the text of abstract, and then classifies papers according to citation counts (highly-cited, little-cited).
We show that an informational approach to representing the meaning of a text has offered a way to effectively predict the scientific impact of research papers.
△ Less
Submitted 26 April, 2021;
originally announced April 2021.
-
Principal Components of the Meaning
Authors:
Neslihan Suzen,
Alexander Gorban,
Jeremy Levesley,
Evgeny Mirkes
Abstract:
In this paper we argue that (lexical) meaning in science can be represented in a 13 dimension Meaning Space. This space is constructed using principal component analysis (singular decomposition) on the matrix of word category relative information gains, where the categories are those used by the Web of Science, and the words are taken from a reduced word set from texts in the Web of Science. We sh…
▽ More
In this paper we argue that (lexical) meaning in science can be represented in a 13 dimension Meaning Space. This space is constructed using principal component analysis (singular decomposition) on the matrix of word category relative information gains, where the categories are those used by the Web of Science, and the words are taken from a reduced word set from texts in the Web of Science. We show that this reduced word set plausibly represents all texts in the corpus, so that the principal component analysis has some objective meaning with respect to the corpus. We argue that 13 dimensions is adequate to describe the meaning of scientific texts, and hypothesise about the qualitative meaning of the principal components.
△ Less
Submitted 18 September, 2020;
originally announced September 2020.
-
Automatic Short Answer Grading and Feedback Using Text Mining Methods
Authors:
Neslihan Suzen,
Alexander Gorban,
Jeremy Levesley,
Evgeny Mirkes
Abstract:
Automatic grading is not a new approach but the need to adapt the latest technology to automatic grading has become very important. As the technology has rapidly became more powerful on scoring exams and essays, especially from the 1990s onwards, partially or wholly automated grading systems using computational methods have evolved and have become a major area of research. In particular, the deman…
▽ More
Automatic grading is not a new approach but the need to adapt the latest technology to automatic grading has become very important. As the technology has rapidly became more powerful on scoring exams and essays, especially from the 1990s onwards, partially or wholly automated grading systems using computational methods have evolved and have become a major area of research. In particular, the demand of scoring of natural language responses has created a need for tools that can be applied to automatically grade these responses. In this paper, we focus on the concept of automatic grading of short answer questions such as are typical in the UK GCSE system, and providing useful feedback on their answers to students. We present experimental results on a dataset provided from the introductory computer science class in the University of North Texas. We first apply standard data mining techniques to the corpus of student answers for the purpose of measuring similarity between the student answers and the model answer. This is based on the number of common words. We then evaluate the relation between these similarities and marks awarded by scorers. We then consider an approach that groups student answers into clusters. Each cluster would be awarded the same mark, and the same feedback given to each answer in a cluster. In this manner, we demonstrate that clusters indicate the groups of students who are awarded the same or the similar scores. Words in each cluster are compared to show that clusters are constructed based on how many and which words of the model answer have been used. The main novelty in this paper is that we design a model to predict marks based on the similarities between the student answers and the model answer.
△ Less
Submitted 19 December, 2019; v1 submitted 27 July, 2018;
originally announced July 2018.
-
Diophantine Approximation and applications in Interference Alignment
Authors:
Faustin Adiceam,
Victor Beresnevich,
Jason Levesley,
Sanju Velani,
Evgeniy Zorin
Abstract:
This paper is motivated by recent applications of Diophantine approximation in electronics, in particular, in the rapidly developing area of Interference Alignment. Some remarkable advances in this area give substantial credit to the fundamental Khintchine-Groshev Theorem and, in particular, to its far reaching generalisation for submanifolds of a Euclidean space. With a view towards the aforement…
▽ More
This paper is motivated by recent applications of Diophantine approximation in electronics, in particular, in the rapidly developing area of Interference Alignment. Some remarkable advances in this area give substantial credit to the fundamental Khintchine-Groshev Theorem and, in particular, to its far reaching generalisation for submanifolds of a Euclidean space. With a view towards the aforementioned applications, here we introduce and prove quantitative explicit generalisations of the Khintchine-Groshev Theorem for non-degenerate submanifolds of $\mathbb{R}^n$. The importance of such quantitative statements is explicitly discussed in Section 4.7.1 of Jafar's monograph `Interference Alignment - A New Look at Signal Dimensions in a Communication Network', Foundations and Trends in Communications and Information Theory, Vol. 7, no. 1, 2010.
△ Less
Submitted 11 June, 2015;
originally announced June 2015.
