SQL Server Integration Services, an ETL tool sold by Microsoft and bundled with SQL Server versions since SQL Server 2005.

learn more… | top users | synonyms

8
votes
0answers
354 views

Can't use Fuzzy Lookup in BIDS

A coworker of mine was having an issue with BIDS. He's doing a simple fuzzy lookup and is only looking against two rows (For Testing Purposes). The weird thing is that when he tries to execute a ...
4
votes
0answers
51 views

Large Variation in Bulk Insert time

So I have a simple Bulk Insert process to take data from our staging table and move it into our datamart. The process is a simple data flow task with default settings for "Rows per batch" and the ...
3
votes
0answers
962 views

SSIS Recordset Destination error

I have an SSIS package targeted at SQL Server 2012. I have it deployed into the Stored Packages in Integration Services and then have a SQL Server Agent job which executes it. The first part of the ...
2
votes
0answers
33 views

SSISDB Retention Period

I have looked into articles to get the size of SSISDB down. One good way to do this was set the retention window for logging lower, currently down to 150 from the default of 365 days. I would like ...
2
votes
0answers
10 views

How to retrieve the distinct domains of a compound domain from DQS using SSIS?

MS Data Quality Services (DQS) has a concept of Compound Domains, which lets you turn say "'99 Chevy Maliboo" into {year:1999, brand:Chevrolet, model:Malibu} SSIS has a "DQS Cleansing" component. It ...
2
votes
0answers
165 views

SQL Agent - PSexec remote commands causing SSIS packages to hang

First post here, so please be kind! I have a bit of a problem with a set of SQL Agent jobs (SQL Server 2014, running on Windows server 2012 R2) that I am trying to setup. Each job is a multiple step ...
2
votes
0answers
171 views

How do I provide a failsafe for retrieval of data from excel to SQL

So say there is a process in place for importing data from excel spreadsheet to SQL using SSIS. And there are two tables, one with new data and one with data from its previous run. I sometimes have ...
2
votes
0answers
76 views

incremental update in HBase using sqoop

i am working on a POC where i need to implement same like SSIS for sql to hadoop. out DW are in SQL Server and we want to create a HBase at central location where all the data from diff DW will be ...
2
votes
0answers
48 views

BULK INSERT clent and session requirements

I'm setting up an ETL process using SQL Server 2014 and SSIS. My Bulk Insert Task is utilizing a source file and format file on ShareA targeting a DB on InstanceA. The package is run via SSA job on ...
2
votes
0answers
1k views

How can I eliminate false “connection string format is not valid” messages from SSIS log?

I have a project that uses the SSIS catalog with project-level connection managers. The connection managers' connection strings are overridden at the server using a project parameters file, to enable ...
2
votes
0answers
229 views

SSIS ASCII requirement: “Code page is 1252 and is required to be 20127”

I have a requirement to export a database to a tab-delimited file in the ASCII format. I am using derived columns to convert any Unicode strings to non-Unicode strings. For example, a former Unicode ...
2
votes
0answers
89 views

SQL Agent AD account gets permission denied for ODBC connections in SSIS packages

We have an AD account specifically created for the agent service and when running SSIS packages that connect to databases we get permission denied even though we have granted that account access to ...
2
votes
0answers
241 views

SSIS: FTP task - concurrent connections

I have created an SSIS package for downloading file from FTP server. When I debug the package, everything goes fine. But when I shedule the package as Job step, it sometimes fails to connect. The job ...
2
votes
0answers
1k views

Why does an SSIS package fail when executed from the IS Catalog?

When executed via the SQL Server Agent under the same user context, is there any reason a package would successfully run when using the file system (i.e. DTExec.exe), but fail to execute when launched ...
2
votes
0answers
318 views

SSIS Bulk Insert Task Operating system error code 1311

I have been running SSIS 2008 R2 Packages for a long time and when ever my Packages trough SQL Server Job accesses FTP Server which is on the same domain it uses correct credentials ,e.g. domain\...
2
votes
0answers
66 views

Integration Service cannot be upgraded/removed

I have SQL Server 2005 Integration Services installed in our server whose version is 5292. It needs to be upgraded to version 5324. After running the patch the summary report says it is upgraded ...
2
votes
0answers
799 views

Importing Excel files with SSIS

I'm trying to import an Excel spreadsheet into SQL Server 2012 using SSIS. There is only one sheet in the file. The file is a SalesForce export. I believe the Sheet name changes depending on when the ...
2
votes
0answers
149 views

How to use a foreach loop with project deployment model

I have a SSIS project that is configured to project deployment model, within this I have two connections one for a flat file and one for a sql db. Both connections are in project mode. Now I want to ...
2
votes
0answers
170 views

Requesting advice on creating a table controlled SQL job scheduler

I have been tasked with cleaning up a series of SQL jobs that send email updates about various data and system conditions in my company. Currently, there are a ton of jobs, each with its own SQL code ...
2
votes
0answers
600 views

Microsoft Visual Studio is Busy

I am working in Visual Studio 2008 on a SSIS package. It is really frustrating that I get "Microsoft Visual Studio is Busy" message quite often. It almost happens every time I try to open a data ...
2
votes
0answers
1k views

Create SSIS package to copy data between SQL Server 2008 installs on different machines?

I'm new to the whole SSIS world. I'm trying to create a process to copy data between SQL Server 2008 environments. I want to be able to run a job to export data from my prod database and then use that ...
2
votes
0answers
656 views

SSIS - Derive column values based on join/subselect from a non-table source

I have a flat file source that contains a lot of duplicate records, which have the same key fields but differ by their "changed date". I need to split this up into two outputs, one for the "latest" ...
1
vote
0answers
18 views

How can I get the actual SSAS error when processing a cube from a SQL Agent job?

I have a SASS cube on one server and a SSIS package on another server that triggers processing the cube. The SSIS package is executed via a scheduled SQL Agent job. I have enabled error reporting for ...
1
vote
0answers
20 views

SSIS: Is it possible to process excel file with dynamic column headers

SSIS: Is it possible to process excel file with dynamic column headers. For instance: Excel file has 5 columns and we process that and save data in a table for all the 5 columns. Now, the scenario ...
1
vote
0answers
27 views

Retrieve data from OLTP MySQL to SQL Server DWH using SSIS

I'm running a BI solution currently reading data from an OLTP SQL Server 2008 to a SQL Server 2012 data warehouse. The ETL phase is implemented with SSIS and runs twice a day. This phase relies on a ...
1
vote
0answers
55 views

How to backup SSIS packages and CUBE Projects from Visual Studio 2013.5?

I'm using VisualStudio 2013.5 to develop SSIS, SSDT and SSAS Cubes (multidimensional and tabular model). I would like to ask you is there a possible to backup SSIS packages and SSAS cubes from ...
1
vote
0answers
116 views

Syncing a SQL Server table with a CSV file

I have recently started a project with sensors that add data to a single CSV file as data the data. I would like to have this data stored in a SQL Server database in a relatively real-time manner. I ...
1
vote
0answers
51 views

LogFile Size increases by SSIS Package execution

On production server we have 125 GB free space. The SSIS package is doing some delete in Transaction. e.g. Insert 3 columns which are mainly business keys into a staging table and then deleting the ...
1
vote
0answers
84 views

SQL Server Agent Jobs starting but is idle

We have a data warehouse with a few databases. Every morning we import data from source systems to our data warehouse. The final step used to be to initiate loading of an Essbase cube by a SQL job ...
1
vote
0answers
70 views

What can cause an “SCD is not compatible with this version of the DataFlow” error?

I created an SSIS package which includes several SCD data flows. This works fine in Visual Studio SSDT, but when scheduled (using SQL Agent), it fails, with this error repeated for each SCD: Code: ...
1
vote
0answers
37 views

SSIS: Trying to configure branching logic in Foreach loop

Full disclosure: I posted this on SQL Server Central yesterday but got no answers. I hope someone here can assist me. I'm working on importing flat files into a database. I have used a Foreach loop ...
1
vote
0answers
32 views

Populate ID Field by Converting Group Name Values

This is a bit tricky to explain, but here goes. We have a System Rights database that loads system users and system rights or access levels into two different tables. The database is already built ...
1
vote
0answers
31 views

SSIS package version GUID does not stay stable between runs

We have a large quantity of SSIS packages created in visual studio 2008. Currently running on hundreds of servers. We are logging the details of each package before it runs. One of the things we are ...
1
vote
0answers
174 views

SQL Server Job Cannot Run SSIS Package Error 0xC00160AE Cluster Environment

I have a 2 machine SQL Cluster and a separate SSIS/SSRS Server. I'm running SQL Server 2014 and Integration Services 12. I'm getting Error 0xC00160AE when trying to run a job from my SQL cluster that ...
1
vote
0answers
29 views

SSIS DTSPackageType behaviour

I created a new SSIS package within Visual Studio 2013 with SSDT BI Tools (12.04.2430.0) installed bu when looking into this package I can see that the DTSPackageType is set to DTSDesigner100. Based ...
1
vote
0answers
48 views

SSIS package with changes to Excel file

I have an SSIS package that loads up an Excel file on daily bases; from time to time the file changes. It can have additional columns in the Excel worksheets. How can I know if the Excel file has ...
1
vote
0answers
34 views

SSIS Guarantee that all data will be moved to target when running data flows in parallel

My package has the following two tasks which run in parallel. DF - Move source data to target loads a copy of all source data to target via OLEDB Dest - Target and also loads a copy of source PK ...
1
vote
0answers
23 views

Handling changing data in the Fact table

We have an employee & benefits data warehouse which is producing incorrect information in the fact table. In File A (Feb), the employee has a leaving date of 27th Feb 2015. In File B (Mar), the ...
1
vote
0answers
34 views

Repeated login issue SQL Server 2008 R2 (SSIS)

I'm trying to figure out an issue I'm currently having with an SQL Server connection - there has been a few issues with timeouts on a SSIS package, where it has failed a login attempt - however as far ...
1
vote
0answers
24 views

How do I save my preferences after moving components around in the SSIS Toolbox?

I'm working with SSIS 2012 (SQL Server Data tools), which runs in the VS 2010 Shell. This is my first time working on a project that required us to install some 3rd party SSIS components. (SSIS-...
1
vote
0answers
225 views

Is there any way to set the default data source for the SQL Server Import and Export Wizard?

When I launch the SQL Server Import and Export Wizard for SQL Server 2014, the selection in the Data source drop-down defaults to .Net Framework Data Provider for ODBC. This happens regardless of ...
1
vote
0answers
87 views

SSIS - The value could not be converted because of a potential loss of data, runs fine in BIDS, not on the server

The value could not be converted because of a potential loss of data I'm getting this error when running an SSIS package from a server job. Normally this is some sort of type error, but I can't see ...
1
vote
0answers
80 views

Is There A Benefit To Using SSIS Packages Over Linked Servers?

We have a new head DBA, and he has decided he does not want us to use linked servers for development moving forward. In addition he would like to replace all existing code that uses linked servers to ...
1
vote
0answers
23 views

How can I prevent SMB digital signing from killing SSIS performance?

My company recently turned on SMB digital signing on the Windows 2012 r2 server that runs SSIS. This has had a severe impact on data transfer performance. The security team did this and I can't get ...
1
vote
0answers
289 views

how to disable and enable SSIS package using commandline?

I have a scenario where SSIS packages are deployed at the customer's site and they have some data issues. Because of this we are developing new packages to fix the corrupted data. When my new ...
1
vote
0answers
814 views

Error while executing SSIS package which contains Script component through SQL Server Agent Job

I have written one SSIS 2012 package which is fetching records from CSV and put it into staging DB and from staging DB , using SSIS script component task, I am inserting data into Dynamics CRM. So far ...
1
vote
0answers
133 views

Oracle 11g SSIS SQL Server 2014 Truncation

We have a nightly SSIS job which downloads data from a Vendor's Oracle system into our SQL Server 2014 system using Oracle's Wallet. On some tables, we've noticed that some VarChar columns have the ...
1
vote
0answers
83 views

expression to transform 'I' to 0

I have data ActiveNonActive columns in and the data are A,I,Empty I have Derived Column to transform data to bit i or empty--->0 and A->1 just want to ask how to use expression transform the 'I' ...
1
vote
0answers
48 views

Run SSIS task regardless of checkpoint

Is it possible to make a task always run, regardless of whether the package starts from scratch or from a checkpoint restart?
1
vote
0answers
124 views

Cross Server and Instance Login SSIS SID or ID Issues

I have some challenging login/SID/ID issues with authentication between databases on separate instances and servers. We have a Development, Test, Pre-Production and Production server/instance ...