Data cleansing for service-oriented architecture

Abstract

Service-Oriented Architecture (SOA) is a new paradigm for integrating distributed software, especially e-Business application. It is essential to exchange reliable data between services. In this paper, we propose a methodology for detecting and cleansing dirty data between services, which is different from cleansing static and large data on database systems. We also develop a data cleansing service based on SOA. The service for cleansing interacting data makes it possible to improve the quality of services and to manage data effectively for a variety of SOA-based applications. As an empirical study, we applied this service to clean dirty data between CRM and ERP services and showed that the dirty data rate could be reduced by more than 30%. © Springer-Verlag Berlin Heidelberg 2005.