Getting 'up to speed' with StreamInsight is easier if you take the time to run it and test it out. Roger Jennings expains how to be up and running in nine simple steps, once you've sorted out the prerequisites  Read more...

Whilst getting some courseware ready I was playing around writing some code and I decided to very simply show when a window starts and ends based on you asking for a TumblingWindow of n time units in StreamInsight. I thought this was going to be a two second thing but what I found was something I haven’t yet found documented anywhere until now.  Read more...

I had an hour spare this afternoon so I wanted to have another play with Reactive Extensions in .Net and StreamInsight. I also didn’t want to simply use a console window as a way of gathering events so I decided to use a windows form instead. The task I set myself was this. Whenever I click on my form I want to subscribe to the event and output its location to the console window and also the timestamp of the event.  Read more...

The purpose of this paper is to provide guidance for enriching data integration scenarios by integrating StreamInsight with SQL Server Integration Services. Specifically, we looked at the technical challenges and solutions for such integration, by using a case study based on a customer scenarios in the telecommunications sector.  Read more...

I have mentioned before about doing development for StreamInsight in Linqpad. I have it installed on two separate PCs and I have enabled autocompletion on only one of them. Whilst both versions are an excellent tool, the one with autocompletion enabled is so much easier to use. After enabling autocompletion you can see I now get parameter listing   Read more...

Slightly before the announcement of StreamInsight being available for Linqpad I downloaded it from here. I had seen Roman Schindlauer demonstrate it at Teched and it looked a really good tool to do some StreamInsight dev. You will need .Net 4.0 and StreamInsight installed.  Read more...

An example of building a StreamInsight input adapter for retrieving Twitter data in real-time.  Read more...

In this postI show how you can use StreamInsight to take events coming from SQL Server Profiler in real-time and do some analytics whilst the data is in flight. Here is the solution for that post. The download contains Project that reads events from a previously recorded trace file Project that starts a trace and captures events in real-time from a custom trace definition file (Included) It is a very simple solution and could be extended.  Read more...

The issuing of a Current Time Increment, Cti, in StreamInsight is very definitely one of the most important concepts to learn if you want your Streams to be responsive. A full discussion of how to issue Ctis is beyond the scope of this article but a very good explanation in addition to Books Online can be found in these three articles by a member of the StreamInsight team at Microsoft, Ciprian Gerea.  Read more...

There are a number of ways to issues CTIs (Current Time Increments) into your StreamInsight streams but a quite useful way is to do it declaratively on your source factory like this  Read more...

Using the Trace Management objects API it is possible to capture the events happening on SQL Server or indeed Analysis Services. I got to thinking that this would be a good thing to stream out in real time in StreamInsight and do some analysis “In Flight”. So here is a short video of me doing just that.  Read more...

This tool is excellent when investigating what is going on in your StreamInsight Streams. I was looking through the menu items recently and went to Query => Event Fields I found that there were a couple of columns not added by default to the event viewer (Reminds me of the fact that the Variables viewer in SSIS hides columns also) Latency NewEndTime EnqueueTime Here they all are together. This gives us even more information about what is going on  Read more...

Performing a LEFT OUTER JOIN in TSQL is easy. The same logic in StreamInsight requires a little more work. In this presentation I show exactly how you can perform a LEFT OUTER JOIN on your event streams. Your browser cannot play this video. Learn how to fix this.   Read more...

A quick-start to SQL Server StreamInsight and Complex Event Processing with a step-by-step example on stock quotes.  Read more...

An introduction to SQL Server StreamInsight and Complex Event Processing with a focus on Business Intelligence.  Read more...

Step by step guide to building and debugging a SQL Server StreamInsight input adapter.  Read more...

While typical relational database applications are query-driven, event-driven applications have become increasingly important. Event-driven applications are characterized by high event data rates, continuous queries, and millisecond latency requirements that make it impractical to persist the data in a relational database for processing. These requirements are shared by vertical markets such as manufacturing, oil and gas, utilities, financial services, health care, web analytics, and IT and data center monitoring. Event-driven applications use complex event processing (CEP) technology with the goal of identifying meaningful patterns, relationships and data abstractions from among seemingly unrelated events and trigger immediate response actions.   Read more...