Real Time Data Stream

  • Hello forum. I want to introduce myself as Adam. I am a self starter and self motivated learning. I am an Electrical Engineer by trade but find myself investing time in anything I find interesting.

    I have made it my lifes calling to learn as much about SQL as is possible! I have been entrusted to develop an energy monitoring system but I dont know where to start. The first thing I will need to do is develop the data base and be able to successfully route the collected data to the said database.

    This db will receive data every 30 seconds to 1 minute (or ever every few seconds) and drop the data into SQL. I feel comfortable that I can work with that data as it is delivered to create reports. What I want to learn to do is take the real time data and display it in the form of realtime data or graphs. As the newest data arrives the older data becomes part of the live history. An example would be the Dow Jones ticker.

    I do not expect someone to lay out the process of how to do this. I am just asking for someone to point me in the direction so that I can further my education on this subject matter.

    Thank you for your time.

  • There are a few ways to do this and really depends on the task at hand.

    SQL Server Reporting Services is a great tool that will make graphs and reports off the data you have collected. It is as current as the last time the report was loaded (Its web based so refresh the page to see new data). You could probably code something in C# that would refresh the page automatically every minute or so.

    You could also make a custom web application to do something like this. Although this would require knowledge of web technologies (HTML, CSS, JavaScript, Ajax, ASP/PHP/Ruby)

    - Tony Sweet

  • cadam (4/14/2014)


    Hello forum. I want to introduce myself as Adam. I am a self starter and self motivated learning. I am an Electrical Engineer by trade but find myself investing time in anything I find interesting.

    I have made it my lifes calling to learn as much about SQL as is possible! I have been entrusted to develop an energy monitoring system but I dont know where to start. The first thing I will need to do is develop the data base and be able to successfully route the collected data to the said database.

    This db will receive data every 30 seconds to 1 minute (or ever every few seconds) and drop the data into SQL. I feel comfortable that I can work with that data as it is delivered to create reports. What I want to learn to do is take the real time data and display it in the form of realtime data or graphs. As the newest data arrives the older data becomes part of the live history. An example would be the Dow Jones ticker.

    I do not expect someone to lay out the process of how to do this. I am just asking for someone to point me in the direction so that I can further my education on this subject matter.

    Thank you for your time.

    I think you might want to take a look at Microsoft StreamInsight.

    Here's a link: http://technet.microsoft.com/en-us/library/ee362541.aspx

    You'd be able to write an adapter to consume the data being delivered to you, query it on the fly, write it to a database or use some other custom output adapter etc...

  • Definitely checkout StreamInsight. There is a lot of potential there around real-time processing. I stated but never finished (sorry) a blog series on real-time processing. Your can take a look here: http://wp.me/p2TQhX-5l

    If you have any questions let me know and I can see what I can do to help.

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply