Category: Complex Event
Orwellian Event Processing
Recently we completed the installation and training of an open source Bayesian classifier to replace a rule-based approach to manage forum spam. In a nutshell, we found the rule-based approach was highly prone to both false positives and false negatives; however, a statistical approach using a Bayesian approach has turned out to be far superior. [...]
Read moreProcessing Complex Events at the Large Hadron Collider (LHC)
Here is an excellent Google TechTalk by Dr. Majorie Shapiro (LBL & LHC ATLAS), June 18, 2007, on processing complex events at the LHC called, Supersymmetry, Extra Dimensions and the Origin of Mass: Exploring the Nature of the Universe Using PetaScale Data Analysis. This is really what I would call “real-time CEP.” Bean collisions at [...]
Read moreA Review of Zabbix – Zabbix Rules! (Part 2)
In A Review of Zabbix – Zabbix Rules! (Part 1) we provided a brief introduction to Zabbix in the context of network and security management. In this post I will discuss Zabbix as an event processing platform. Zabbix is like most event processing platforms. Zabbix provides both agent-initiated events as well as server-requested events. In [...]
Read moreThe Cyberwar Against Marketing Hype
When discussing CEP and EP, someone recently blogged: “There is even one person who declared a full fledged cyber war on anybody who uses the term “complex event processing” not in what he believes to be the original intent of past DARPA project in the area of security and military operational applications.” Actually, I think [...]
Read moreReal-Time Predictive Analytics for Web Servers
We recently made the decision to move to Zabbix to monitor one of our busy production Apache web servers. One of the things we need to do in the future is try to predict system outages and take corrective actions before the system actually goes down. For example, recently a busy server experenced an outage [...]
Read moreReasoning and Complexity
In a short follow-up to CEP Software Saves the Universe!, I thought it would be helpful to post some quotes from Wikipedia on reasoning and complexity. Cognitive science sees reasoning by the analogy to a data processing, where relations between observed properties of reasoning are used in numerous models leading to evident logically correct conclusions [...]
Read moreCEP Software Saves the Universe!
Situational awareness is a complex concept that cannot be accomplished by any of the “CEP” software on the market today. In his post, Human CEP: the gut feeling?, Paul Vincent of TIBCO says, [A] firefighter avoiding death by analyzing his situation …. is provided by event-driven CEP systems. The fact of the matter is that [...]
Read moreClassification in Complex Event Processing
Following up on the excellent discussion in Predicting Events with Logistic Regression I think it is time to talk a bit about the importance of classification in complex event processing. CEP is, by definition, about detecting business opportunities and threats in real-time. It follows, that by definition, CEP is centered around classifying and discriminating complex [...]
Read moreApache Mahout: Real-Time Decisioning in the MapReduce Framework
Here is a bit of good news for the complex event processing space. Folks on the Apache Mahout developers mailing list are showing an accelerated interest in topics related to real-time decision-making, starting with a Markov decision process. The Hidden Markov Model (HMM) is listed under “non map-reduce algorithms” on the Mahout wiki. The developer’s [...]
Read morePredictions for the 2009 CEP Market
Reposted (adapted) from The Complex Events Forum: David Luckham: Do you expect the market to expand? No. The entire software market, for the most part, will have a very tough year in 2009, due to a very serious global economic crisis. Firms that have “bet the farm” on capital markets will suffer even more, as [...]
Read more