2009
11.23

Some thoughts Rx Framework & Complex Event Processing

Category: .NET, Programming / Tag: , ,  / Add Comment

Download and Get up to Speed

Get the Rx Framework libs now from here!

Watch the PDC Session

Rx: Reactive Extensions for .NET

Want more? Watch some Channel 9

Rx Video Listing

Some Early Thoughts

This is a game changer!  I can’t wait to get playing with / applying it to my daily .NET life!  I’ll be blogging more on the topic when I have a better grasp of it all and something more interesting to say.

Complex Event Processing

“Complex event processing, or CEP, is primarily an event processing concept that deals with the task of processing multiple events with the goal of identifying the meaningful events within the event cloud.” Wikipedia

I really hope Rx Framework can be applied to complex event processing (CEP)..  *fingers crossed*.   You can see how Rx might relate to “processing multiple events” as its a push model that you can run LINQ over!

Update: Microsoft’s StreamInsight!

StreamInsight takes advantage of the Rx Framework to allow for high performance CEP.

This is how Microsoft describe their CEP offering:

Microsoft StreamInsight is a powerful platform that you can use to develop and deploy complex event processing (CEP) applications. Its high-throughput stream processing architecture and the Microsoft .NET Framework-based development platform enable you to quickly implement robust and highly efficient event processing applications.

By using StreamInsight to develop CEP applications, you can achieve the following tactical and strategic goals for your business:

  • Monitor your data from multiple sources for meaningful patterns, trends, exceptions, and opportunities.
    Analyze and correlate data incrementally while the data is in-flight — that is, without first storing it–yielding very low latency. Aggregate seemingly unrelated events from multiple sources and perform highly complex analyses over time.
  • Manage your business by performing low-latency analytics on the events and triggering response actions that are defined on your business key performance indicators (KPIs).
    Respond quickly to areas of opportunity or threat by incorporating your KPI definitions into the logic of the CEP application, thereby improving operational efficiency and your ability to respond quickly to business opportunities.
  • Mine events for new business KPIs.
  • Move toward a predictive business model by mining historical data to continuously refine and improve your KPI definitions.

Nice!  Good times ahead on the .NET platform.

2 comments so far

Add Your Comment
  1. nielsb said: 2009.11.23 08:13

    As for your thoughts regarding StreamInsight (SI) and SQL Server 2008 R2; at least at this moment, SI has no dependencies on SQL Server 2008 R2 what so ever. For certain operations you may need a SQL Server Compact (CE) db, which stores metadata – but you can definitely use SI against other databases than SQL if you so wish.
    Niels

  2. holsee said: 2009.11.23 09:31

    Thanks Niel for the in depth comment!

    I was mid edit of this post / fixing a log-in bug with this wordpress template when I got your comment. I will be starting to research into the CEP space very soon.

    P.S. I actually posted a StackOverflow question on the subject (http://stackoverflow.com/questions/1784036/microsofts-streaminsight-experiences-sql-server-2008-r2) you could earn some rep with an answer like that ;)

Your Comment

You must be logged in to post a comment.