More on Why Routing is Not Complex Event Processing

Interestingly, CEP is Not BPM, BAM, BRE, BRMS or SOA stimulated many great comments and the rebuttal Smart Order Routing and CEP - Made for Each Other.  James Taylor responded with Business rules, decisions and events.   I followed up with CEP is Not Low Latency Messaging, EAI or ESB and James replied in turn with Still More on Event Processing.  It’s great to see the blogosphere doing so well.  Continuing, I would like to discuss smart order routing (SOR) a bit more and why routing is not CEP.

First of all, let’s ground the discussion a bit by translating “smart order routing” to “rule-based message routing” since in this application “smart”  translates to “using rules” and “order” translates to “message”.    Basically, Mark (and other “new on the routing scene” stream processing players) argue that rule-based message routing is CEP.  I will argue that routing is not even close to CEP.  Here is why,

Let’s take a look at a router on the backbone of the global Internet.   A backbone router has very sophisticated software developed over many decades.   These routers run sophisticated, mature algorithms to determine how to route messages (packets) and use these algorithms to build complex routing tables. 

In addition, these routers process messages (packets) from countless sources and route messages (packets) to countless destinations.  Using some of the terms in early posts (above), there is a great “confluence of events” processed by routers.    Futhermore, there are normally quite complex authentication, authorization and other security parameters managed in a router, all in real time.   Routers do much more, but I don’t want to get too deep into routing in this post.

My point is that, without any doubt, global Internet routers process very “cloudy” “confluence of events” with much more sophistication than order routing applications.    However, we do not call Internet routing “CEP”, regardless of how many connections are processed or how much sophisticated processing occurs.  The reason is because the “C” in “CEP” defines a complexity that is at a higher abstraction than messaging and routing.

If you study the literature on CEP, some of which I posted recently, CEP was envisioned to solve complex event processing problems “on top of the routing layer” because the routing layer is a mature technology layer.  We can route, pure and simple.  Of course, we are always seeking faster, more scaleable and more secure routing. 

I admire some of the startups in the CEP/ESP/EP space for working hard to make money and for aggressively positioning their products and attempting to build market share.   However, issues surface when these same companies seem to believe they are the first companies to work in the event processing or message routing space and that they can define whatever they want as “complex event processing” as long as it benefits their sales targets.

There is no doubt that a router does much more sophisticated event processing than the new rule-based stream processing systems running continuous queries across streaming data.  There is no doubt that a router processes a complex “confluence of events”.   However, we don’t call routers “CEP”. 

We do not call routers “CEP” because CEP is about a higher level of knowledge processing.  CEP was created to detect the “complex events” that happen above the mediation and routing layer.     The literature and original examples on CEP are quite clear on this.

 

Share and Enjoy:
  • Digg
  • StumbleUpon
  • del.icio.us
  • Technorati
  • Facebook
  • Mixx
  • Google
  • Slashdot
  • Furl
  • Reddit
  • Spurl
  • LinkedIn

2 Responses to “More on Why Routing is Not Complex Event Processing”

  1. Hi Tim -

    I thought I would provide a little clarification for you on the difference between smart order routing and a Router. Hope hit helps!

    http://streambase.typepad.com/streambase_stream_process/2008/09/a-pocket-guide-on-routing-for-a-confused-blogger.html

    - Mark

  2. Hi Mark,

    You have demonstrated that you have almost no knowledge of routing, especially global Internet routing. Here is some info on my IEEE paper on this topic, which only scratches the surface on routing. This topic is something I am very familar with, as you can see from my 11 year old paper:

    Internet Exterior Routing Protocol Development: Problems, Issues, and Misconceptions, by Tim Bass

    IEEE Network Magazine, Monterey, CA, p.50-55 (1997)

    http://www.thecepblog.com/pdf/ieee-network-routing-bass.pdf

    Abstract:

    Global routing in the Internet continues to have scalability problems which underscore weaknesses in the design and implementation of the various TCP/IP Exterior Routing Protocols. This paper explores the historical design and development relative to the decision making process in the specification and implementation of Internet External Routing Protocols; and in particular discusses problems associated with provider-based address space allocation.

    ——–

    Mark, the little $30 dollar router that you offer is your view of routing because you have not worked on the Internet backbone, and as many people point out to you, these global routers do much more than your little SOR engine application. You are arguing something you do not have experience with.

    Instead of sniping at me, I kindly suggest that you realize that I have more than 15 years in complex event processing related activities (before the term CEP was coined), routing and the Internet and when I say that routing is not CEP, you should not snipe and trivialize my advice.

    Please read my paper, which is 11 years old Mark, and see how much experience I have in routing, thanks.

    Yours sincerely, Tim

    PS: I will also post this comment on your blog.

Leave a Reply

Copyright © 2007-2008, The CEP Blog, All Rights Reserved.