Optimal $F$-score Clustering for Bipartite Record Linkage
Authors:
Eric A. Bai,
Olivier Binette,
Jerome P. Reiter
Abstract:
Probabilistic record linkage is often used to match records from two files, in particular when the variables common to both files comprise imperfectly measured identifiers like names and demographic variables. We consider bipartite record linkage settings in which each entity appears at most once within a file, i.e., there are no duplicates within the files, but some entities appear in both files.…
▽ More
Probabilistic record linkage is often used to match records from two files, in particular when the variables common to both files comprise imperfectly measured identifiers like names and demographic variables. We consider bipartite record linkage settings in which each entity appears at most once within a file, i.e., there are no duplicates within the files, but some entities appear in both files. In this setting, the analyst desires a point estimate of the linkage structure that matches each record to at most one record from the other file. We propose an approach for obtaining this point estimate by maximizing the expected $F$-score for the linkage structure. We target the approach for record linkage methods that produce either (an approximate) posterior distribution of the unknown linkage structure or probabilities of matches for record pairs. Using simulations and applications with genuine data, we illustrate that the $F$-score estimators can lead to sensible estimates of the linkage structure.
△ Less
Submitted 4 December, 2023; v1 submitted 23 November, 2023;
originally announced November 2023.
Research Note: Bayesian Record Linkage with Application to Chinese Immigrants in Raleigh-Durham (ChIRDU) Study
Authors:
Eric A. Bai,
Madeleine Beckner,
Botao Ju,
Jerome P. Reiter,
Ted Mouw,
M. Giovanna Merli
Abstract:
Many population surveys do not provide information on respondents' residential addresses, instead offering coarse geographies like zip code or higher aggregations. However, fine resolution geography can be beneficial for characterizing neighborhoods, especially for relatively rare populations such as immigrants. One way to obtain such information is to link survey records to records in auxiliary d…
▽ More
Many population surveys do not provide information on respondents' residential addresses, instead offering coarse geographies like zip code or higher aggregations. However, fine resolution geography can be beneficial for characterizing neighborhoods, especially for relatively rare populations such as immigrants. One way to obtain such information is to link survey records to records in auxiliary databases that include residential addresses by matching on variables common to both files. In this research note, we present an approach based on probabilistic record linkage that enables matching survey participants in the Chinese Immigrants in Raleigh-Durham (ChIRDU) Study to records from InfoUSA, an information provider of residential records. The two files use different Chinese name romanization practices, which we address through a novel and generalizable strategy for constructing records' pairwise comparison vectors for romanized names. Using a fully Bayesian record linkage model, we characterize the geospatial distribution of Chinese immigrants in the Raleigh-Durham area.
△ Less
Submitted 21 October, 2023;
originally announced October 2023.
