TY - GEN
T1 - Grand challenge
T2 - 11th ACM International Conference on Distributed Event-Based Systems, DEBS 2017
AU - Rivetti, Nicolo
AU - Busnel, Yann
AU - Gal, Avigdor
N1 - Publisher Copyright:
© 2017 ACM.
PY - 2017/6/8
Y1 - 2017/6/8
N2 - We present a (soft) real-time event-based anomaly detection application for manufacturing equipment, built on top of the general purpose stream processing framework Apache Flink. The anomaly detection involves multiple CPUs and/or memory intensive tasks, such as clustering on large time-based window and parsing input data in RDF-format. The main goal is to reduce end-to-end latencies, while handling high input throughput and still provide exact results. Given a truly distributed setting, this challenge also entails careful task and/or data parallelization and balancing. We propose FlinkMan, a system that offers a generic and efficient solution, which maximizes the usage of available cores and balances the load among them. We illustrates the accuracy and efficiency of FlinkMan, over a 3-step pipelined data stream analysis, that includes clustering, modeling and querying.
AB - We present a (soft) real-time event-based anomaly detection application for manufacturing equipment, built on top of the general purpose stream processing framework Apache Flink. The anomaly detection involves multiple CPUs and/or memory intensive tasks, such as clustering on large time-based window and parsing input data in RDF-format. The main goal is to reduce end-to-end latencies, while handling high input throughput and still provide exact results. Given a truly distributed setting, this challenge also entails careful task and/or data parallelization and balancing. We propose FlinkMan, a system that offers a generic and efficient solution, which maximizes the usage of available cores and balances the load among them. We illustrates the accuracy and efficiency of FlinkMan, over a 3-step pipelined data stream analysis, that includes clustering, modeling and querying.
KW - Anomaly detection
KW - Clustering
KW - Linked-Data
KW - Markov chains
KW - Stream processing
UR - http://www.scopus.com/inward/record.url?scp=85023182369&partnerID=8YFLogxK
U2 - 10.1145/3093742.3095099
DO - 10.1145/3093742.3095099
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85023182369
T3 - DEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems
SP - 274
EP - 279
BT - DEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems
Y2 - 19 June 2017 through 23 June 2017
ER -