improving database quality through eliminating duplicate records

Clicks: 82
ID: 172160
2006
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal
Popular

Ranked #276 of 292 articles by views in Proceedings of the National Academy of Sciences of the United States of America

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 292 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Abstract
Redundant or duplicate data are the most troublesome problem in database management and applications. Approximate field matching is the key solution to resolve the problem by identifying semantically equivalent string values in syntactically different representations. This paper considers token-based solutions and proposes a general field matching framework to generalize the field matching problem in different domains. By introducing a concept of String Matching Points (SMP) in string comparison, string matching accuracy and efficiency are improved, compared with other commonly-applied field matching algorithms. The paper discusses the development of field matching algorithms from the developed general framework. The framework and corresponding algorithm are tested on a public data set of the NASA publication abstract database. The approach can be applied to address the similar problems in other databases.
Reference Key
wei2006dataimproving Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors ;Mingzhen Wei;Andrew H Sung;Martha E Cather
Journal Proceedings of the National Academy of Sciences of the United States of America
Year 2006
DOI
10.2481/dsj.5.127
URL
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

No comments yet. Be the first to comment on this article.