Can SSIS test if a url (web page) exists vs. broken link?

  • I have a SQL table that stores URLs (hyperlinks). I presently use a desktop app called Xenu Sleuth to test if these hyperlinks are OK or if any one of them is broken. It's a manual process of copy-n-paste URLs from the sql table into a text file, loading the file into Xenu, and clicking a button; results are then displayed.

    So, I just started wondering if SSIS 2005 could be used to test the URLs that are stored in the sql table? I'm primarily a T-SQL programmer/SSRS report developer, and don't have much advanced experience with SSIS beyond basic ETL projects. Could SSIS test if a URL is accessible vs broken?

    Has anyone ever tried this or have suggestions on how to go about attempting it?

    Ultimately, I'd like to create a method for automatically testing these links on a schedule.

    If it's not feasible (or recommended) to use SSIS to do this, does anyone know of a program that can automatically (on a schedule) identify all embedded URLs on a webpage and spit out the results to a file? (I'm thinking I could have a webpage built locally that is dynamically populated with hyperlinks from the sql table.) From my research, it seems that nearly every application available (desktop or online) requires a user to manually run an application/click a button to perform the assessment rather than letting a process run on its own according to a set schedule.

    Thanks in advance,

    Pete

  • I Googled this link

    http://bytes.com/topic/asp-net/answers/320433-load-web-page-via-windows-form-service

    where he uses the System.Net.WebClient. Haven't tried it in an SSIS Script Task, but I suppose you could, as long as you import that library.

Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply