SQL Server Integration Services, an ETL tool sold by Microsoft and bundled with SQL Server versions since SQL Server 2005.

learn more… | top users | synonyms

4
votes
2answers
36 views

SSIS OLEDB Command not firing triggers

Got a bit of a strange one that I can't seem to work out. We have a vendor database ( so we have no control over the table structure, foreign keys, etc...) that's on SQL Server 2012 SP2. We have a ...
1
vote
1answer
37 views

SQL Server Import Export Wizard Error - Server throw Exception

I am trying to move all database tables from one db to another as a nightly job. The first (export) db is running sql server 2008 - SQL Server Authentication - I connect with SQL Server Native Client ...
2
votes
1answer
42 views

Database in SIMPLE recovery model full using SSIS bulk insert task

I have a database in SIMPLE recovery model with 10GB free. The file I am trying to load through SSISs bulk load is 1GB. The table is empty (truncated prior to each loading), is a heap and has no ...
0
votes
0answers
16 views

SQL Agent Job Edit Step: An entry with the same key already exists. (System) [closed]

I'm getting the following error when I try to edit a step for a SQL Server Integration Services Package: "An entry with the same key already exists. (System)" Interestingly, it doesn't occur for a ...
0
votes
1answer
81 views

SSIS: script task on Visual studio 2013 can not open since Visual Studio 2015 was installed

Until the installation of Visual studio 2015, it was always opening Visual studio 2012. Attached the only error he throws, It seems he was trying to open Visual Studio 2015.
0
votes
0answers
22 views

SSIS: Check file for row delimiter and dynamicly update row delimiter in Flat File Connection Manager at run time

I am importing about 50 or so txt files into a SQL Server table. All the files have the same layout except that for some files the row delimiter used was {CR}{LF} and for others {LF} was used. ...
0
votes
0answers
29 views

Data Conversion error in SSIS after upgrade

We recently did a server upgrade from 2008 R2 to 2014 as well as upgrading our SSIS packages. Since then we receive an error when reading a flat file. The error is on a column with percentage values ...
1
vote
0answers
25 views

AWS RDS databases & SSIS

I have 2 AWS RDS databases (A & B) and need to create a datawarehouse with star scheme and slowly changing dimensions within AWS. From a MS background it makes sense to create a SSIS package to ...
5
votes
1answer
38 views

SQL Query not throwing error even if the entered scale value is higher than specified

I need to capture numeric values without truncation. But the output value is getting truncated even though I specified the Scale as '2'. Column 'A' datatype - numeric(5,2) Case 1: Entered value: ...
0
votes
1answer
19 views

Aggregation of duplicate data

We have an interesting problem around duplicate data. Our source files can contain multiple rows of data for a single employee benefit. As an example, a health care benefit could be split up and ...
11
votes
1answer
67 views

Executing SSIS Package from a sproc with different user privileges

I'm having issues with allowing my users to execute SSIS Packages in a reasonable manner due to varying levels of privilege required. The Scenario We've created a data warehouse, with two different ...
1
vote
1answer
29 views

Is this Normal SSIS Foreach Loop Container behavior

I have a Foreach Loop Container that loops through files in a folder. I thought the Loop Container would only look at the files 1 time but apparently it will start back at the top and pick up a file ...
-3
votes
0answers
44 views

SQL Server Denali is required to install Integration Services. It cannot be installed on this version of SQL Server

While creating SSIS integration services catalog encountered below error: current SQL version is : 12.0.4100 SQL Server Denali is required to install Integration Services. It cannot be ...
-4
votes
1answer
35 views

SQL Server and msbi relation and difference [closed]

With SQL Server 2008R2, we have analysis services, reporting services, and data moving and manipulation services with SQL Server Management Studio. So why do we need SSIS, SSRS, and SSAS?
3
votes
1answer
64 views

Starting SSIS Package through SSIS Catalog

I've developed an SSIS package to load files but it is behaving very strangely. I can kick off the package running start_execution on the SSISDB only when I log directly onto the server. Kicking it ...
1
vote
1answer
37 views

SSIS line number from file

I have done some tests in flat file source trying to see if it read the file in order of the number of lines and all of them the number of the line read was inserted in SQL Server equally. I was ...
3
votes
1answer
43 views

How to change Zeros ( 0 ) to NULL in SSIS?

I would like to change some Zeros into NULL using SSIS 2008. In that context I tried "conditional split" where I have set the columns test in question with the following expression: ...
5
votes
1answer
144 views

Best Practice for SQL Server data validation

I have CSV files that I would like to import into SQL Server 2014. Each record in the files has around 20 columns, each of them should be validated for data type compliance as well as some other ...
5
votes
1answer
88 views

How can I restrict the version of the target DB instance in a SSIS package?

How can I restrict an SSIS Package to only execute on SQL Server 2012? Is there a built-in way to do this (metadata?), or do I need to do a query? (Possibly belongs in a new question): I can get ...
4
votes
3answers
341 views

How to correctly discard old backups?

I have an Execute SQL Task in my SSIS control flow that's backing up a number of databases before it proceeds to run the overnight ETL: EXECUTE master.dbo.xp_create_subdir N'G:\Backups\DQ' GO EXECUTE ...
1
vote
0answers
16 views

Populate ID Field by Converting Group Name Values

This is a bit tricky to explain, but here goes. We have a System Rights database that loads system users and system rights or access levels into two different tables. The database is already built ...
1
vote
1answer
37 views

How to set SSIS flat file connection row delimiter to blank line?

I have a text file with the following format: DataColumn1 DataColumn2 DataColumn3 DataColumn1 DataColumn2 DataColumn3 DataColumn1 DataColumn2 DataColumn3 Each row with text in the file delimits a ...
0
votes
0answers
28 views

How do you stop an SSIS when an empty text file is processed

I have an SSIS package that pulls a file from an SFTP server, decrypts it, pushes it into a table, then merges into a text file, on to uploading to another SFTP server. This package runs flawlessly ...
1
vote
1answer
18 views

Conditionally move files in SSIS

I have a simple SSIS package with a ForEach Loop Container with 1 Data Flow task that triggers when a file is present. If that task succeeds, I want to move the input file to a "success" folder. If it ...
2
votes
1answer
44 views

SSIS export to flat file - how to configure all DataTypes for columns w/o manual entry?

In my OLE DB Source to Flat File Destination Data Flow, I have quite a few columns and it's excruciating to manually set each one to decimal with a scale of 4. I tried adjusting my SQL code in the ...
4
votes
1answer
82 views

SQL Server 2014 SSIS Package Ignores Script Task when running as AGENT

Alright, so here's what I have going on. SSIS Package that queries data from our production system and drops them into CSVs. Have a VB script task that uploads them to a third party. Needed a ...
0
votes
1answer
33 views

SSIS Package - “Subquery returned more than 1 value” - Inserting one record into a table

SSIS on SQL Server 2008 R2 I have inherited an SSIS package that is failing when importing a spreadsheet. The part of the failure is in a data flow that consists of :- * an Excel Source Data Flow ...
0
votes
1answer
34 views

Communication Link Failure in SQL

I have an SSIS package that runs daily in SQL agent, there are days that the job is failing due to "Communication Link Failure" but sometimes successful. I search the net for some solutions and there ...
2
votes
1answer
91 views

SSIS package fails intermittently with: Unsafe assembly 'microsoft.sqlserver.integrationservices.server, version=11.0.0.0

I have an SSIS package deployed to the SSIS catalog on my Data warehouse which has run successfully for months. The package is executed by a SQL agent job. Now it fails intermittently with the ...
3
votes
2answers
127 views

What could cause “lagging” in SSIS execute SQL task?

Recently I noticed that the part of my ETL process loading the data into the staging area sometimes takes longer and sometimes shorter. With the following query (executed in the integration services ...
0
votes
1answer
26 views

Change database used for SQL Server Integration Services logging

The SQL Server Best Practices Analyzer noted that my Integration Services' logging table is in a system database. It recommends that I move this to a non-system database. (See here) How do I make ...
0
votes
1answer
26 views

SQL Server Merge mandate

Does the target table need to be identical to source table schematically? Specifically: 1) do they need to have the same number of columns and do the column types must be the same?, 2) do the column ...
9
votes
1answer
156 views

Problem creating a transaction in an SSIS package

I'm working on a package that needs to use a transaction but I'm currently getting the following error: SSIS package "CATS-Package.dtsx" starting. Information: 0x4004300A at Data Flow Task, ...
5
votes
1answer
57 views

Designing a dimensional DB off a normalized source that already implements SCD's

I have built an SSIS ETL to integrate various data sources (one from MySQL, two from SQL Server) into a single SQL Server relational and normalized database, which I've called [NDS]. The SSIS ETL ...
0
votes
0answers
16 views

SQL Server 2012 process (Stored procedure in SSIS Package via SQL Agent Job) stays running where it normally ends within 10 minutes

[] SPID 70 : SSISDB.catalog.start_execution;1 SPID 113 : EXECUTE ETL.uspLoadDataStoreData'dbo', 'Project', 0
0
votes
0answers
24 views

commonly used diagram for ETL

A the title indicates. Am i wondering what is the most commonly used diagram to explain an ETL process? In my case the process is rather linear, would a flowchart suffice? or is a Use-case also ...
1
vote
0answers
18 views

SSIS package version GUID does not stay stable between runs

We have a large quantity of SSIS packages created in visual studio 2008. Currently running on hundreds of servers. We are logging the details of each package before it runs. One of the things we are ...
1
vote
1answer
47 views

T-SQL Check another table rows if match delete them

I am creating a script in SSIS where I want table A to check if rows exist in table B. If they exist, they must be deleted. Table A is an archive table named Customer_archive Table B is a table that ...
0
votes
1answer
42 views

Do you need Table Lock when you have multiple OLE DB connections inserting to the same table?

SSIS is not really my forte. I noticed you have a table lock option on OLE DB destinations where the entire table becomes locked in what I assume is during the transaction of inserting data. What ...
1
vote
0answers
78 views

SQL Server Job Cannot Run SSIS Package Error 0xC00160AE Cluster Environment

I have a 2 machine SQL Cluster and a separate SSIS/SSRS Server. I'm running SQL Server 2014 and Integration Services 12. I'm getting Error 0xC00160AE when trying to run a job from my SQL cluster that ...
1
vote
0answers
22 views

SSIS DTSPackageType behaviour

I created a new SSIS package within Visual Studio 2013 with SSDT BI Tools (12.04.2430.0) installed bu when looking into this package I can see that the DTSPackageType is set to DTSDesigner100. Based ...
1
vote
2answers
34 views

SQL Server 2014 data integration between servers

Given two MS SQL servers, each with a different database, how does one create an SSIS package such that one can run a complex query that fills a temporary table and then transfer that data as a bulk ...
0
votes
1answer
66 views

Extract data from Oracle DBF files

I'm completely new to Oracle and I was provided with what appears to be an Oracle database backup (170 DBF files and 3 CTL files). I'd like to extract the information using SSIS or Pentaho's Kettle ...
0
votes
0answers
52 views

How to import data from Sqlite into SQL Server 2012

I need to import data from sqlite into SQL Server so we can include it in our data warehouse. Based on previous system volume. Id expect there to be 50-100,000 rows after a couple of years. For ...
2
votes
0answers
57 views

SQL Agent - PSexec remote commands causing SSIS packages to hang

First post here, so please be kind! I have a bit of a problem with a set of SQL Agent jobs (SQL Server 2014, running on Windows server 2012 R2) that I am trying to setup. Each job is a multiple step ...
1
vote
0answers
36 views

SSIS package with changes to Excel file

I have an SSIS package that loads up an Excel file on daily bases; from time to time the file changes. It can have additional columns in the Excel worksheets. How can I know if the Excel file has ...
0
votes
1answer
18 views

Whole numbers from sql column using SSIS

Below is the sample SQL. From Source1 tb, I need only whole numbers of Value column into ValueNEW of Destination1 tb as shown in the output pic. --Source1 IF EXISTS (SELECT * FROM sys.objects ...
13
votes
1answer
377 views

Running SSIS package from SQL Agent job owned by a non-sysadmin domain user

I have two SSIS packages that run scheduled overnight (via SQL Server Agent) as part of a larger SSIS deployment, without any issues. Everything is using Windows authentication, and the scheduled job ...
1
vote
0answers
29 views

SSIS Guarantee that all data will be moved to target when running data flows in parallel

My package has the following two tasks which run in parallel. DF - Move source data to target loads a copy of all source data to target via OLEDB Dest - Target and also loads a copy of source PK ...
0
votes
0answers
28 views

Primairy Key constraint error in SSIS with delete

So I have an SSIS package that deletes a bunch of data then inserts the new data. Even though the delete completes without error I am still getting a primary key constraint violation. When I run the ...