SQL Server Integration Services, an ETL tool sold by Microsoft and bundled with SQL Server versions since SQL Server 2005.

learn more… | top users | synonyms

0
votes
1answer
83 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL ...
0
votes
1answer
66 views

Treat database field as a flat file source

We have a partner sending us csv data to a web service of ours that gets sent to a messaging system that is SQL Server based. I am writing data to disk and then importing to another database by using ...
0
votes
2answers
965 views

One SQL Server. One SSIS. Two versions of DTExec.exe?

Is it possible to install and use the 2012 version of the DTExec.exe on a Server 2008R2/SSIS2008 box without installing SSIS 2012? All jobs will be called from the command line, no server agent jobs. ...
0
votes
1answer
490 views

How to sync two tables which are on different databases and servers using SSIS?

I am relatively new to SQL Server's tools. I am on the following situation: On several stored procedures on a database D1 on server S1, I need to use data that is stored on a database D2 on server ...
0
votes
2answers
237 views

Create a read only excel file from SSIS?

Is there a way to create a read only excel file from SSIS?
0
votes
1answer
207 views

Validating Excel Counts against Database Inserts

I have to design a SSIS package which uses Excel Source files and inserts the data into SQL Server Database. The problem is that I've created the packages top transfer data, but now I need to ...
0
votes
2answers
266 views

Loading XML data from SQL Server directly into MarkLogic?

Has anyone loaded XML data from SQL Server to a MarkLogic document store? This would be preferable to dumping XML to file system and then using mlcp. Maybe with SSIS?
0
votes
1answer
4k views

SSIS Get max value in column and create new column?

I'm importing two data sources. The problem is that one data source has a date, the other does not. Everything in the data flow has the same date and is inserted as one transaction into the same ...
0
votes
2answers
569 views

CSV data export to SQL Database with double quote problems [closed]

I am trying to import data from falt files (.CSV) into SQL table. I am able to import them no problem but the data is coming with double quotes. What is the best way of resolving this problem? ...
0
votes
1answer
533 views

Problem with SSIS Variable Expression containing getDate()

Brief Architecture My SSIS package is generating dynamic excel files through Data flow. The file name format is "XYZ_Year_Month_Day_Hour_Minutes.xlsx". So I am using variable with expression which ...
0
votes
1answer
810 views

How to Implement a Retry Feature in SSIS 2012 When a Database Connection Fails?

We have an SSIS 2012 package that supports our internal analytics reporting database by extracting data from an external database server. Last night, for the first time, the package failed due to a ...
0
votes
2answers
261 views

Using IF and other conditions in T-SQL (trying to import data from Oracle using SQL Server SSIS)

I am using SQL Server 2012 SSIS package to fetch data from Oracle and insert it into SQL Server 2012. I am doing it for the first time and every thing is fine i.e. all data from a particular table ...
0
votes
1answer
52 views

how to downgrade a statement for SSIS

Following snippet works within SSIS 2012 --- derive colum block. TOKEN(REPLACE(@[User::FileName],".csv",""),"\\",TOKENCOUNT(REPLACE(@[User::FileName],".csv",""),"\\")) But it does not work within ...
0
votes
1answer
223 views

Does failed task considered to be run to completion in SQL Server maintenance plan terminology?

The replies to my previous question: "How to specify a SQL Server maintenance plan subtask to run unconditionally on success or failure of preceding tasks?" answered me that I should change ...
0
votes
2answers
838 views

Copy data through SSIS package from one machine to another

I have data in few excel sheets which are to be loaded into tables. I've created a few SSIS packages to do this on my local machine. Now I have to move these tables onto my client's machine, which is ...
0
votes
1answer
634 views

SSIS Raw Data Import Into SQL Server 2008 R2 - Truncation and Condensed Data Type

[Intro] I have written a two pack SSIS solution to perform a scheduled hourly update of data from multiple tables in a single db (SRC) to single table on another db (TRG). I get the following errors ...
0
votes
1answer
40 views

Concurreny update error when using SSIS

I am encountering concurrent update error when using OLE DB command to execute a update procedure in SSIS. Below is the segment of code which will check for concurrency update. Currently I removed ...
0
votes
1answer
1k views

Convert rows to columns in SSIS. Unpivot?

If I have data like this "","",WAREHOUSE ID,1,2,3,4,5... "","",WAREHOUSE CODE,BOS,HOU,LAX,NYC,CHI... "","",WAREHOUSE NAME,BOSTON,HOUSTON,LOS ANGELES,NEW YORK CITY,CHICAGO... But want to transform ...
0
votes
2answers
646 views

Import batches of rows from Excel in parallel

We receive an Excel file weekly currently containing about 250k rows. The file grows by about 300 rows each week. In SSIS I've hooked up an Excel source to an OLE DB destination to import the file ...
0
votes
1answer
110 views

Logging of incorrect row in SQL Server Integration Services

I newbie to SQL Server Integration Services and I have a problem: Data loaded from file looks like this: 1 'a' 'b' 2 'a' 'b' 1 'c' 'd' And this rows would be loaded in table like this: CREATE ...
0
votes
1answer
2k views

SSIS transfer SQL server objects task -> Foreign key constraint error

I try to copy a database from 1 server to the other to build a staging environment. I do this with SSID. First I delete the existing database on my staging server, create a new and empty one and then ...
0
votes
0answers
18 views

Help with SSIS Framework- Resolve Referrences in Data Flow

LineageString and StageKey are both unmapped. SSIS is giving me an error between the OLE DB Source and the Add metadata. Add Metadata.Inputs[Derived Column Input].Columns[LineageString] has lineage ...
0
votes
0answers
11 views

Failed to execute IS server package because of error 0x80131904 … System.ComponentModel.Win32Exception: The handle is invalid

I have an SSIS package that is executed every 30 seconds by a SQL Agent Job. Every few days, an execution will fail with this message in the Job History: Failed to execute IS server package ...
0
votes
0answers
39 views

How to measure development quality on remote sites? [closed]

I am part of a team of two managing (inherited) SQL Server Databases, SSIS ETLs and SSRS reporting environments on ~40 customer sites. All development work is done remotely via some form of remote ...
0
votes
0answers
19 views

SSIS Package Not Populating Excel Correctly

I have an SSIS package that populates the details tab of an excel file. Once it is populated there are two pivot tables that derive data from them. I made a change to the Excel file to add two new ...
0
votes
0answers
18 views

SSIS Package Error Unable to locate reference column

I have an SSIS package that worked fine until today. For some reason I am getting this error: [UpdateCurrencyRate by MaxTickTime of DAy [2658]] Error: Unable to locate reference column ...
0
votes
0answers
30 views

Can I print RAISERROR message from SQL task in an SSIS send e-mail task?

I am trying to create an SSIS package with failure constraints for tasks to send an email. Now here is how the email task looks. Some SQL tasks that the email tasks are connected to have SQL ...
0
votes
0answers
57 views

SSIS package fails, Odata connector to SharePoint Online

Using package developed in SSDT2012, deploying to SQL2012. I've worked through many errors/issues to get to this error: Package:Error: Failed to initialize SharePoint Client Runtime. Could ...
0
votes
1answer
31 views

Transposing/Wrangling Database Table

Firstly, transposing is too specific a word for the kind of transform I want to do. I have a software that allows a technician to design custom forms for end users. From the form, I can see every ...
0
votes
1answer
33 views

ssis surrogate key in parent child tables

I have two tables Person & Ownership having one to many relationship (each person have many ownerships). Primary Key is person_id of type GUID. I am developing SSIS package to load data from both ...
0
votes
0answers
23 views

Execute SSIS in C# failed; “to run a SSIS package outside of SQL Server DT you must install FTP download of IS or higher” [duplicate]

I'm trying to run a SSIS package within a C# application, which downloads .csv file from FTP server and stores it localy. The package runs fine within SQL Data Tools, but fails when called in C#, ...
0
votes
1answer
41 views

What is the best SSIS Tasks for String Parsing database fields

What is/are the best SSIS Tasks to use in order to search for string patterns. This relates to standardizing address information. My developer does not have a confident grasp on using Regular ...
0
votes
0answers
25 views

SSIS buffer size and table with many columns

I have an Oracle view with around 10 million rows, each row has about 130 columns, I wrote a SSIS 2012 package which uploads the data of this view into a SQL Server table. The SSIS package fails each ...
0
votes
2answers
29 views

Optional variable/parameter in SSIS

I have a SSIS package which has the following: Data Flow Task OLE DB Source (select * from table1 where DateCol <= ISNULL(@DateVar,DateCol )) OLE DB Destination DateVar variable And I need ...
0
votes
0answers
53 views

SSIS: Check file for row delimiter and dynamicly update row delimiter in Flat File Connection Manager at run time

I am importing about 50 or so txt files into a SQL Server table. All the files have the same layout except that for some files the row delimiter used was {CR}{LF} and for others {LF} was used. ...
0
votes
0answers
43 views

Data Conversion error in SSIS after upgrade

We recently did a server upgrade from 2008 R2 to 2014 as well as upgrading our SSIS packages. Since then we receive an error when reading a flat file. The error is on a column with percentage values ...
0
votes
0answers
46 views

How do you stop an SSIS when an empty text file is processed

I have an SSIS package that pulls a file from an SFTP server, decrypts it, pushes it into a table, then merges into a text file, on to uploading to another SFTP server. This package runs flawlessly ...
0
votes
1answer
48 views

SSIS Package - “Subquery returned more than 1 value” - Inserting one record into a table

SSIS on SQL Server 2008 R2 I have inherited an SSIS package that is failing when importing a spreadsheet. The part of the failure is in a data flow that consists of :- * an Excel Source Data Flow ...
0
votes
1answer
87 views

Communication Link Failure in SQL

I have an SSIS package that runs daily in SQL agent, there are days that the job is failing due to "Communication Link Failure" but sometimes successful. I search the net for some solutions and there ...
0
votes
0answers
20 views

SQL Server 2012 process (Stored procedure in SSIS Package via SQL Agent Job) stays running where it normally ends within 10 minutes

[] SPID 70 : SSISDB.catalog.start_execution;1 SPID 113 : EXECUTE ETL.uspLoadDataStoreData'dbo', 'Project', 0
0
votes
0answers
33 views

commonly used diagram for ETL

A the title indicates. Am i wondering what is the most commonly used diagram to explain an ETL process? In my case the process is rather linear, would a flowchart suffice? or is a Use-case also ...
0
votes
1answer
94 views

Extract data from Oracle DBF files

I'm completely new to Oracle and I was provided with what appears to be an Oracle database backup (170 DBF files and 3 CTL files). I'd like to extract the information using SSIS or Pentaho's Kettle ...
0
votes
0answers
91 views

How to import data from Sqlite into SQL Server 2012

I need to import data from sqlite into SQL Server so we can include it in our data warehouse. Based on previous system volume. Id expect there to be 50-100,000 rows after a couple of years. For ...
0
votes
0answers
30 views

Change SSIS package location

My SSIS Package are located in shared drive with a long path name. To make the packages easier and not to remember long path name, I use "Map my network drive" option and use X: drive as an alias to ...
0
votes
0answers
35 views

Primairy Key constraint error in SSIS with delete

So I have an SSIS package that deletes a bunch of data then inserts the new data. Even though the delete completes without error I am still getting a primary key constraint violation. When I run the ...
0
votes
1answer
54 views

How to Publish Checked-In changes only in Team Foundation Server 2013 to SQL Server?

I would like to ask you how to publish checked-in changes only in Team Foundation Server 2013 to SQL Server? It's a new installation of TFS 2013 - installed by me. Currently when I create new object ...
0
votes
2answers
167 views

problems when importing csv files into SQL using SSIS when the columns are not consistent from quarter to quarter

I am using SSIS to upload a bunch of csv tables into SQLexpress. The csv files are quarterly data files. They are largely consistent but every couple of years a column may be added or an existing ...
0
votes
0answers
68 views

Selected Parameter values is not passing to another tab click in SSRS view report

I built an SSRS Report in which the final report is populated on a tabular formatted report with the combination of many sub reports. The report takes 3 input parameters values as date,fund ...
0
votes
1answer
24 views

SSIS - Update Specific Cell in CSV

I have a pre-defined csv template. The header row begins on row 5. Prior to this I have a date value in cell B2. How do I update this cell value in SSIS?
0
votes
1answer
143 views

“Unspecified Error” when executing SSIS Package

I am executing an "Initial Load" SSIS package, which truncates all ETL tables first, then re-populates them by pulling data from a remote server. I get the dreaded "Unspecified Error" at a different ...