IPSJ Digital Courier
Online ISSN : 1349-7456
ISSN-L : 1349-7456
Example-Based Outlier Detection for High Dimensional Datasets
Cui ZhuHiroyuki KitagawaChristos Faloutsos
Author information
JOURNAL FREE ACCESS

2005 Volume 1 Pages 234-243

Details
Abstract

Detecting outliers is an important problem, in applications such as fraud detection, financial analysis, health monitoring and so on. It is typical of most such applications to possess high dimensional datasets. Many recent approaches detect outliers according to some reasonable, pre-defined concepts of an outlier (e.g., distance-based, density-based, etc.). Most of these concepts are proximity-based which define an outlier by its relationship to the rest of the data. However, in high dimensional space, the data becomes sparse which implies that every object can be regarded as an outlier from the point of view of similarity. Furthermore, a fundamental issue is that the notion of which objects are outliers typically varies between users, problem domains or, even, datasets. In this paper, we present a novel solution to this problem, by detecting outliers based on user examples for high dimensional datasets. By studying the behavior of projections of such a few outlier examples in the dataset, the proposed method discovers the hidden view of outliers and picks out further objects that are outstanding in the projection where the examples stand out greatly. Our experiments on both real and synthetic datasets demonstrate the ability of the proposed method to detect outliers that match users' intentions.

Content from these authors
© 2005 by the Information Processing Society of Japan
Previous article Next article
feedback
Top