Microsoft (StreamInsight), and Azure Stream Analytics represent a very different model for processing data. They are concerned with processing complex event streams of data (CEPs) from such things as sensors to deduce significant patterns and apply filters. Joe Celko discusses the background to an intriguing technology of complex event processing to establish the difference between data at rest, and data on the move.
2017-10-03
3,971 reads
Whilst getting some courseware ready I was playing around writing some code and I decided to very simply show when a window starts and ends based on you asking for a TumblingWindow of n time units in StreamInsight. I thought this was going to be a two second thing but what I found was something I haven’t yet found documented anywhere until now.
2011-04-21
2,346 reads
I had an hour spare this afternoon so I wanted to have another play with Reactive Extensions in .Net and StreamInsight. I also didn’t want to simply use a console window as a way of gathering events so I decided to use a windows form instead. The task I set myself was this. Whenever I click on my form I want to subscribe to the event and output its location to the console window and also the timestamp of the event.
2011-03-18
2,408 reads
Microsoft StreamInsight™ is designed to assist in developing Complex Event Processing (CEP) applications in .NET This is appropriate for stream sources tsuch as those in manufacturing applications or financial trading applications. StreamInsight provides the means to monitor, manage, and mine several sources simultaneously for conditions,trends, exceptions, opportunities, and defects almost instantly. It is ideal for performing low-latency analytics on the events and triggering response actions, and for mining historical data to continuously refine and improve definitions of alerting conditions. Johan provides a simple explanation of the system in a series of practical articles.
2019-03-26 (first published: 2011-02-04)
470 reads
I have mentioned before about doing development for StreamInsight in Linqpad. I have it installed on two separate PCs and I have enabled autocompletion on only one of them. Whilst both versions are an excellent tool, the one with autocompletion enabled is so much easier to use. After enabling autocompletion you can see I now get parameter listing
2010-12-23
2,439 reads
Slightly before the announcement of StreamInsight being available for Linqpad I downloaded it from here. I had seen Roman Schindlauer demonstrate it at Teched and it looked a really good tool to do some StreamInsight dev. You will need .Net 4.0 and StreamInsight installed.
2010-12-16
2,928 reads
In this postI show how you can use StreamInsight to take events coming from SQL Server Profiler in real-time and do some analytics whilst the data is in flight. Here is the solution for that post. The download contains Project that reads events from a previously recorded trace file Project that starts a trace and captures events in real-time from a custom trace definition file (Included) It is a very simple solution and could be extended.
2010-09-21
2,192 reads
The issuing of a Current Time Increment, Cti, in StreamInsight is very definitely one of the most important concepts to learn if you want your Streams to be responsive. A full discussion of how to issue Ctis is beyond the scope of this article but a very good explanation in addition to Books Online can be found in these three articles by a member of the StreamInsight team at Microsoft, Ciprian Gerea.
2010-09-15
1,779 reads
There are a number of ways to issues CTIs (Current Time Increments) into your StreamInsight streams but a quite useful way is to do it declaratively on your source factory like this
2010-09-09
1,492 reads
Using the Trace Management objects API it is possible to capture the events happening on SQL Server or indeed Analysis Services. I got to thinking that this would be a good thing to stream out in real time in StreamInsight and do some analysis “In Flight”. So here is a short video of me doing just that.
2010-08-31
2,302 reads
In the realm of data science, SQL (Structured Query Language) reigns supreme. It's your...
By Brian Kelley
The bottom line here is this: the idea that a CSP takes care of...
In today's data-driven world, SQL (Structured Query Language) is a blazing-hot skill. It's your...
The below code works for backup files only from local drives. When replaced with...
I have been asked to fine-tune the following SQL that was written by a...
In this scenario, I seek assistance in implementing row-level permissions for a table named...
What are the initial config sizes for the tempdb primary data files, secondary data files, and log files in SQL Server 2022?
See possible answers