SSIS- File reading and processing

  • I am having 5 different folder which are placed in my one of the drive.

    Each folders will receive the data in excel.

    For each folder it has its own set of data, so i am going to prepare 5 different transformations.

    Data will be coming on hourly or daily or monthly it depends.

    Task for me is to check those files in those folders and if there are files are being placed, my package should recognize the files and starts processing the data and insert into my database.

    After successfully reading those files it should move those files to archive folder. In case if there is an error those files should be reside on the same folder, but need to have a log file in the same folder stating the reason for the failure.

    In approaches we can accomplish the task. Any suggestions/link.

    Thanks

  • You've outlined what you want to do, which is great, but you haven't asked a question, apart from stating you want suggestions. Suggestions on what? How to receive the files, how to move them, how to read them, how to transform them, how to get it to run every hour?

    Can you be more clear on what your question is please? What part are you struggling with at the moment, and what have you achieved so far?

    Thom~

    Excuse my typos and sometimes awful grammar. My fingers work faster than my brain does.
    Larnu.uk

  • Thanks!

    As i stated earlier i have to do the below

    "Task for me is to check those files in those folders and if there are files are being placed, my package should recognize the files and starts processing the data and insert into my database."

    As of now i have created a simple package to read the excel file and insert them in to database without any issue.

    To do tasks for me

    Were as my request is to check for any errors in those files, if there is an error i have to write a log file.

    I have not moved those files which are read by me in my folder , i have to move those files to another(Archive) folder.

    Need to execute on hourly bases reading from those folders.

    Need assistance(any links) like how to move those folders and error handling in excel file and write error log.

  • OK, so what is your question? Note my use of a question mark to show I am asking one.

    You haven't asked anything, just told us what you want to do.

    Thom~

    Excuse my typos and sometimes awful grammar. My fingers work faster than my brain does.
    Larnu.uk

  • Need assistance(any links) like how to move those folders and error handling in excel file and write error log to text file.

    Any links are there with the above example or how/ what transformations are needed to do the tasks.

  • I suspect that anyone attempting to answer your "question" would type "SSIS move files" and "SSIS error handling" into their favourite search engine and see what comes back. However, you're capable of doing that yourself. If you're moving into a new area then yes, it's going to be a steep learning curve and you'll have to do a lot of research, but nobody else can do that for you. Better for you to come back later and ask questions if there is anything in particular you don't understand in the course of your research.

    John

  • As John said, if you want links on how to do this, you have a variety of Search Engines to choose from for aid. For example: Google, Bing, Yahoo.

    Other than that, the only way we could give you something for this would be to write a huge article on your choices on how to achieve each step you want. Something that would take any of us a significant amount of time, as there's a lot you want to achieve.

    Try searching each step you want to complete, and then, if you are facing problems (for example, you are receiving errors when your attempt to read your data from your data source and can't figure out why) then post.

    Users at SSC are always happy to help solve your problems when you encounter them, but they aren't here to do your work for you, or hold your hand the entire way. You need to make the steps yourself, and we'll push you in the right direction if you're not sure what way to go, or have taken the wrong path. 😎

    Thom~

    Excuse my typos and sometimes awful grammar. My fingers work faster than my brain does.
    Larnu.uk

Viewing 7 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply