Complex Event Processing in the Belly of the Beast

Around 10 years ago I worked as Technical Director for SAIC as a member of an elite group of Internet security experts.   I was responsible for a number of very large global financial corporations (well, actually two).  The leader of our division, called The Center of Information Protection (The CIP), was a very intelligent [...]

KMeans Clustering Now Running on Elastic MapReduce

Stephen Green, blogger and principal investigator of the AURA project in Sun Labs, has moved the state-of-the-art of analytics-as-a-service a few steps forward with the first documented working Mahout application on Amazon’s Elastic MapReduce (EMR).
EMR was announced on April 1st and on April 15th Stephen announced to the Mahout users group that he was going [...]

A Review of Zabbix - Zabbix Rules! (Part 2)

In A Review of Zabbix - Zabbix Rules! (Part 1) we provided a brief introduction to Zabbix in the context of network and security management.  In this post I will discuss Zabbix as an event processing platform.
Zabbix is like most event processing platforms.  Zabbix provides both agent-initiated events as well as server-requested events.  [...]

A Review of Zabbix - Zabbix Rules! (Part 1)

It was 1992, the Internet was still an uncertain “dream technology” by scientists, and I was working at SprintLink.   My role was the lead systems engineer to set up the network and security management center for SprintLink and Managed Router Network (MRN) team.
We used HP Open View Network Node Manager (NNM) for our core network [...]

Trend Prediction in Network Monitoring Systems

Following up on Real-Time Predictive Analytics for Web Servers I thought we should “move up a level” and look at various open network monitoring platforms with trend prediction capabilities.
Our web server management team picked Zabbix to monitor a busy production server and then we started to look into adding predictive analytics afterwards.   Alberto recommended we [...]

Predicting Events with Logistic Regression

In earlier post, CEP by Apache Mahout via the Google MapReduce Framework and Apache Mahout: Real-Time Decisioning in the MapReduce Framework, we started to look at the Google MadReduce framework and the planned analytics of the Apache Mahout development team.  In this post, we will look at the first algorithm mentioned by the Mahout team, [...]

Apache Mahout: Real-Time Decisioning in the MapReduce Framework

Here is a bit of good news for the complex event processing space.  Folks on the Apache Mahout developers mailing list are showing an accelerated interest in topics related to real-time decision-making, starting with a Markov decision process. The Hidden Markov Model (HMM) is listed under “non map-reduce algorithms” on the Mahout wiki.  The developer’s [...]

Lessons Learned from High Tower’s Demise

In November 2008, Aliso Viejo-based High Tower Software, a venture-backed developer of security, compliance, and log management software, shut down.   Like many of our “CEP/ESP vendors”, High Tower orchestrated numerous “awards” for their security information and event management (SIEM) software, However, these fluffy marketing awards were not enough to keep HT from a nose dive.
High [...]

Copyright © 2007-2008, The CEP Blog, All Rights Reserved.