Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Data Stream Mining and Analysis: Clustering Evolving Data
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.ORCID iD: 0000-0001-7199-8080
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Streaming data is becoming more prevalent in our society every day. With the increasing use of technologies such as the Internet of Things (IoT) and 5G networks, the number of possible data sources steadily increases. Therefore, there is a need to develop algorithms that can handle the massive amount of data we now generate.

Data mining is an area of research where data is mined to gain an understanding of data and its underlying structure. When we move to streaming data, and the corresponding sub-domain data stream mining, restrictions are imposed on the algorithms that can be used. Data streams are possibly endless, and their instances arrive rapidly, can often only be processed once or a few times, and often evolve as the data is generated over time.

This thesis explores data-driven techniques to model and analyze evolving data streams. We focus on slower data streams where incremental updates are not necessary, and the interest lies in analyzing its behavior over longer time periods. We aim to evaluate existing and develop novel algorithms and techniques suitable for analyzing these types of data streams. We use both supervised and unsupervised learning methods to model the user/system behaviors, and the methods and algorithms are evaluated on various datasets.

Specifically, we investigate regression and clustering algorithms to mine streaming data for user/system behavior patterns. We also design an algorithm capable of modeling user/system behavior in a single evolving data stream, which is easy to use and capitalizes on prior knowledge from the history of the stream. Furthermore, we design a clustering algorithm that takes advantage of multiple data streams, where each stream represents a part of the entire system, to model various aspects of the user/system behavior. Finally, we review the current state-of-the-art methods for evaluating data stream clustering algorithms and identify aspects that should be considered for the future.

Place, publisher, year, edition, pages
Karlskrona: Blekinge Tekniska Högskola, 2024. , p. 231
Series
Blekinge Institute of Technology Doctoral Dissertation Series, ISSN 1653-2090 ; 1
Keywords [en]
Data Stream Mining, Clustering, Data Streams, Data Mining
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:bth-25539ISBN: 978-91-7295-472-4 (print)OAI: oai:DiVA.org:bth-25539DiVA, id: diva2:1809390
Public defence
2024-01-24, Karlskrona, 09:00 (English)
Opponent
Supervisors
Available from: 2023-11-17 Created: 2023-11-03 Last updated: 2023-12-12Bibliographically approved
List of papers
1. Detection of Residents' Abnormal Behaviour by Analysing Energy Consumption of Individual Households
Open this publication in new window or tab >>Detection of Residents' Abnormal Behaviour by Analysing Energy Consumption of Individual Households
2017 (English)In: Proceedings of the 17th IEEE International Conference on Data Mining Workshops (ICDMW) / [ed] Gottumukkala, R; Ning, X; Dong, G; Raghavan, V; Aluru, S; Karypis, G; Miele, L; Wu, X, IEEE, 2017, p. 729-738Conference paper, Published paper (Refereed)
Abstract [en]

As average life expectancy continuously rises, assisting the elderly population with living independently is of great importance. Detecting abnormal behaviour of the elderly living at home is one way to assist the eldercare systems with the increase of the elderly population. In this study, we perform an initial investigation to identify abnormal behaviour of household residents using energy consumption data. We conduct an experiment in two parts, the first to identify a suitable prediction algorithm to model energy consumption behaviour, and the second to detect abnormal behaviour. This approach allows for an initial step for the elderly care that has a low cost, is easily deployable, and is non-intrusive.

Place, publisher, year, edition, pages
IEEE, 2017
Series
International Conference on Data Mining Workshops, ISSN 2375-9232
Keywords
Energy consumption, Predictive models, Smart meters, Correlation, Senior citizens
National Category
Computer Sciences
Identifiers
urn:nbn:se:bth-15565 (URN)10.1109/ICDMW.2017.101 (DOI)000425845700096 ()978-1-5386-3800-2 (ISBN)
Conference
IEEE International Conference on Data Mining series (ICDM), New Orleans
Funder
Knowledge Foundation, 20140032
Available from: 2018-01-11 Created: 2018-01-11 Last updated: 2024-11-26Bibliographically approved
2. Profiling of household residents' electricity consumption behavior using clustering analysis
Open this publication in new window or tab >>Profiling of household residents' electricity consumption behavior using clustering analysis
2019 (English)In: Lect. Notes Comput. Sci., Springer Verlag , 2019, p. 779-786Conference paper, Published paper (Refereed)
Abstract [en]

In this study we apply clustering techniques for analyzing and understanding households’ electricity consumption data. The knowledge extracted by this analysis is used to create a model of normal electricity consumption behavior for each particular household. Initially, the household’s electricity consumption data are partitioned into a number of clusters with similar daily electricity consumption profiles. The centroids of the generated clusters can be considered as representative signatures of a household’s electricity consumption behavior. The proposed approach is evaluated by conducting a number of experiments on electricity consumption data of ten selected households. The obtained results show that the proposed approach is suitable for data organizing and understanding, and can be applied for modeling electricity consumption behavior on a household level. © Springer Nature Switzerland AG 2019.

Place, publisher, year, edition, pages
Springer Verlag, 2019
Series
Lecture Notes in Computer Science ; 11540
Keywords
Ambient Assisted Living, Non-intrusive remote monitoring, Assisted living, Clustering analysis, Clustering techniques, Electricity-consumption, Household level, Number of clusters, Remote monitoring, Electric power utilization
National Category
Computer Sciences
Identifiers
urn:nbn:se:bth-18593 (URN)10.1007/978-3-030-22750-0_78 (DOI)000589285300076 ()2-s2.0-85068459816 (Scopus ID)9783030227494 (ISBN)
Conference
International Conference on Computational Science, ICCS, Faro, Algarve, 12 June 2019 through 14 June 2019
Available from: 2019-09-09 Created: 2019-09-09 Last updated: 2025-01-17Bibliographically approved
3. Monitoring Household Electricity Consumption Behaviour for Mining Changes
Open this publication in new window or tab >>Monitoring Household Electricity Consumption Behaviour for Mining Changes
2019 (English)Conference paper, Oral presentation only (Refereed)
Abstract [en]

In this paper, we present an ongoing work on using a household electricity consumption behavior model for recognizing changes in sleep patterns. The work is inspired by recent studies in neuroscience revealing an association between dementia and sleep disorders and more particularly, supporting the hypothesis that insomnia may be a predictor for dementia in older adults. Our approach initially creates a clustering model of normal electricity consumption behavior of the household by using historical data. Then we build a new clustering model on a new set of electricity consumption data collected over a predefined time period and compare the existing model with the built new electricity consumption behavior model. If a discrepancy between the two clustering models is discovered a further analysis of the current electricity consumption behavior is conducted in order to investigate whether this discrepancy is associated with alterations in the resident’s sleep patterns. The approach is studied and initially evaluated on electricity consumption data collected from a single randomly selected anonymous household. The obtained results show that our approach is robust to mining changes in the resident daily routines by monitoring and analyzing their electricity consumption behavior model.

National Category
Computer Sciences
Identifiers
urn:nbn:se:bth-18651 (URN)
Conference
3rd International Workshop on Aging, Rehabilitation and Independent Assisted Living (ARIAL), International Joint Conferenec on Artificial Intelligence (IJCAI), August 10-16, 2019, Macao, China.
Projects
Scalable resource-efficient systems for big data analytics
Note

open access

Available from: 2019-09-12 Created: 2019-09-12 Last updated: 2023-11-03Bibliographically approved
4. Modeling Evolving User Behavior via Sequential Clustering
Open this publication in new window or tab >>Modeling Evolving User Behavior via Sequential Clustering
2020 (English)In: Communications in Computer and Information Science / [ed] Cellier P.,Driessens K., Springer, 2020, Vol. 1168 CCIS, p. 12-20Conference paper, Published paper (Refereed)
Abstract [en]

In this paper we address the problem of modeling the evolution of clusters over time by applying sequential clustering. We propose a sequential partitioning algorithm that can be applied for grouping distinct snapshots of streaming data so that a clustering model is built on each data snapshot. The algorithm is initialized by a clustering solution built on available historical data. Then a new clustering solution is generated on each data snapshot by applying a partitioning algorithm seeded with the centroids of the clustering model obtained at the previous time interval. At each step the algorithm also conducts model adapting operations in order to reflect the evolution in the clustering structure. In that way, it enables to deal with both incremental and dynamic aspects of modeling evolving behavior problems. In addition, the proposed approach is able to trace back evolution through the detection of clusters' transitions, such as splits and merges. We have illustrated and initially evaluated our ideas on household electricity consumption data. The results have shown that the proposed sequential clustering algorithm is robust to modeling evolving behavior by being enable to mine changes and update the model, respectively.

Place, publisher, year, edition, pages
Springer, 2020
Series
Communications in Computer and Information Science, ISSN 18650929
Keywords
Behavior modeling, Clustering evolution, Data mining, Household electricity consumption data, Sequential clustering
National Category
Computer Sciences
Identifiers
urn:nbn:se:bth-18666 (URN)10.1007/978-3-030-43887-6_2 (DOI)000718590300002 ()9783030438869 (ISBN)
Conference
19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD, Würzburg; Germany,16th to the 20th of September 2019
Note

open access

Available from: 2019-09-18 Created: 2019-09-18 Last updated: 2024-01-01Bibliographically approved
5. EvolveCluster: an evolutionary clustering algorithm for streaming data
Open this publication in new window or tab >>EvolveCluster: an evolutionary clustering algorithm for streaming data
2022 (English)In: Evolving Systems, ISSN 1868-6478, E-ISSN 1868-6486, no 4, p. 603-623Article in journal (Refereed) Published
Abstract [en]

Data has become an integral part of our society in the past years, arriving faster and in larger quantities than before. Traditional clustering algorithms rely on the availability of entire datasets to model them correctly and efficiently. Such requirements are not possible in the data stream clustering scenario, where data arrives and needs to be analyzed continuously. This paper proposes a novel evolutionary clustering algorithm, entitled EvolveCluster, capable of modeling evolving data streams. We compare EvolveCluster against two other evolutionary clustering algorithms, PivotBiCluster and Split-Merge Evolutionary Clustering, by conducting experiments on three different datasets. Furthermore, we perform additional experiments on EvolveCluster to further evaluate its capabilities on clustering evolving data streams. Our results show that EvolveCluster manages to capture evolving data stream behaviors and adapts accordingly.

Place, publisher, year, edition, pages
SPRINGER HEIDELBERG, 2022
Keywords
Evolving data stream; Clustering; Data stream clustering
National Category
Computer Sciences
Identifiers
urn:nbn:se:bth-22395 (URN)10.1007/s12530-021-09408-y (DOI)000717906700001 ()2-s2.0-85119001929 (Scopus ID)
Funder
Knowledge Foundation, 20140032
Note

open access

Available from: 2021-11-26 Created: 2021-11-26 Last updated: 2023-11-03Bibliographically approved
6. MultiStream EvolveCluster
Open this publication in new window or tab >>MultiStream EvolveCluster
2023 (English)In: The 36th Canadian Conference on Artificial Intelligence, 2023Conference paper, Published paper (Refereed)
Abstract [en]

This paper proposes a novel multi-stream clustering algorithm, MultiStream EvolveCluster (MS-EC), that can be used for continuous and distributed monitoring and analysis ofevolving time series phenomena. It can maintain evolving clustering solutions separatelyfor each stream/view and consensus clustering solutions reflecting evolving interrelationsamong the streams. Each stream behavior can be analyzed by different clustering techniques using a distance measure and data granularity that is specially selected for it. Theproperties of the MultiStream EvolveCluster algorithm are studied and evaluated withrespect to different consensus clustering techniques, distance measures, and cluster evaluation measures in synthetic and real-world smart building datasets. Our evaluation resultsshow a stable algorithm performance in synthetic data scenarios. In the case of real-worlddata, the algorithm behavior demonstrates sensitivity to the individual streams’ data quality and the used consensus clustering technique.

Keywords
evolve clustering, data stream mining, consensus clustering
National Category
Computer Sciences
Identifiers
urn:nbn:se:bth-25534 (URN)
Conference
The 36th Canadian Conference on Artificial Intelligence, Montreal, 5-9 June 2023
Available from: 2023-11-01 Created: 2023-11-01 Last updated: 2023-11-03Bibliographically approved
7. On Evaluation of Data Stream Clustering Algorithms: A Survey
Open this publication in new window or tab >>On Evaluation of Data Stream Clustering Algorithms: A Survey
(English)Manuscript (preprint) (Other academic)
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:bth-25538 (URN)
Available from: 2023-11-03 Created: 2023-11-03 Last updated: 2023-11-06Bibliographically approved

Open Access in DiVA

fulltext(51625 kB)911 downloads
File information
File name FULLTEXT03.pdfFile size 51625 kBChecksum SHA-512
3affa7860aadbca59587191b186ea1f58a287b1967f75325fa50f0c654556162721f9cdfa83eab5d25f994ff67d4dc2d13a1f95a419ada1f5563df60e85b938c
Type fulltextMimetype application/pdf

Authority records

Nordahl, Christian

Search in DiVA

By author/editor
Nordahl, Christian
By organisation
Department of Computer Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 946 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1956 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf