Questions tagged [ssis]
SQL Server Integration Services, an ETL tool sold by Microsoft and bundled with SQL Server versions since SQL Server 2005.
1,048
questions
0
votes
0
answers
23
views
Error when trying to setup the ssisdb on new server (An error occurred during service master key decryption)
I have an SQL server 2017 ssisdb backup and password that was used when creating the catalog.
I have restored db on a new server (same sql version) by following the steps given here: https://docs....
- 2,158
-1
votes
0
answers
20
views
Is there a possibility to restore a ssis db on new server with the mdf/ldf attach/replace method?
I want to migrate sql server 2019 to another server (same version). I understand one option is backup/restore. Followed by using the master key..
Is there a possibility to restore a ssis db on new ...
- 2,158
0
votes
0
answers
24
views
Why are SQL SSIS counters zero even though there are packages running on the server?
Why are SSIS performance counters: Buffer memory, Buffers in use, Buffers spooled returning 0 even though there are SSIS packages on the sql server; agent jobs configured to run these SSIS packages.
I ...
- 2,158
0
votes
1
answer
31
views
How to execute SSIS packages on another SQL server's hardware?
I have 20 ssis packages deployed on SQLSvr1 in the SSIS catalog.
They are invoked via the SQL agent jobs on this server.
Suppose I re-create these agent jobs on another SQL Server (SQLSvr2), then will ...
- 2,158
1
vote
0
answers
9
views
Does SSIS `Buffer memory` include `Flat buffer memory` and `Private buffer memory`?
I am looking at ssis perf mon counters to check for memory pressure from running ssis packages.
Does SSIS Buffer memory include Flat buffer memory and Private buffer memory?
- 2,158
1
vote
0
answers
18
views
SSIS in Azure: operation_messages_scaleout event_messages_scaleout tables not populating
We are running SSIS packages in AZure. I am finding that for some reason we have stopped populating the SSISDB tables (operation_messages_scaleout, event_messages_scaleout). It does appear that the ...
- 11
0
votes
0
answers
38
views
SQL statement runs fine in SSMS but does not work in SSIS SQL task
I have SSIS package which loads data to one of the table using SSIS sql task. it is using project parameter. However, it is not loading data into the table at all when package runs. I tried to execute ...
- 95
1
vote
1
answer
43
views
Run MSSQL stored procedures containing SSIS packages using Windows Authentication from another computer
I am new to MSSQL. I have a question about executing MSSQL Stored Procedure.
Let me briefly talk about my development environment first:
PC400 (Computer/Server A), where SQL Server 2012 is installed
...
- 11
0
votes
1
answer
41
views
What is the recommended approach to migrate SSIS and related packages from sql server 2016 to sql server 2019?
I have SSIS packages in msdb database as well as in the ssis catalog (ssis db).
What is the recommended approach to migrate SSIS and related packages from sql server 2016 to sql server 2019?
For ...
- 2,158
0
votes
0
answers
22
views
SSIS packages who contains ('Power Query Source') can not be called by SQL Agent
I have ssis package who use a power query source where I introduced a power query in order to get clear data from a text file and then used a 'OLE DB Destination' to copy the data to a new table in my ...
- 13
0
votes
0
answers
11
views
SSIS Deployment The locale identifier (LCID) 14348 is not supported by SQL Server
When trying to deploy a SSIS package on my local machine I get the following error message
The locale identifier (LCID) 14348 is not supported by SQL Server
And ideas ?
0
votes
0
answers
18
views
Fire a TRIGGER when an SSIS package from the SISSDB catalog starts
I would like to know if there is any way to fire a TRIGGER when an SSIS package from the SISSDB catalog starts?
I need that when a package starts execution, the trigger inserts some information in ...
- 41
2
votes
2
answers
54
views
What is the recommended way to install ssis in a sql server fci configuration?
I am planning a sql server installation with fci.
There will be 2 sql server 2019 instances in active/passive mode; they share the same SAN.
This question is about ssis.
Link: https://docs.microsoft....
- 2,158
-1
votes
2
answers
121
views
SQL Server Agent not running SSIS package
I have followed many articles to create an SSIS pipeline package, deploy it and schedule it.
I'm trying to transfer data from two remote servers, an OLEDB driver that connects to a SQL Server Database ...
-2
votes
1
answer
42
views
SSIS Duplicate Entry for key PRIMARY
I'm creating a simple Pipeline from a SQL Server Database to a MySQL Database, the issue is the pipeline won't work just once, but the more data is added to the first added should also be added in the ...
0
votes
1
answer
27
views
SSIS 2017- Insert Update process not working
I am creating a package to validate data. I am using a lookup object, however, it is not inserting new records. It only updates records and sometimes creates duplicate records.
the original data ...
0
votes
0
answers
22
views
Can a SSMS job which runs an SSIS package be resource limited within a virtual server?
I have a SQL Agent job which runs weekly and executes an SSIS package. The job takes over two hours to complete and in that time it consumes over 90% of the server CPU, this means the replication ...
0
votes
0
answers
63
views
SSIS and SQL Agent job impersonation
I currently have a new SSIS machine. SSIS is used to automate maintenance task such as backups and restores of other servers on the network. We have over 600 servers in our line of business and each ...
- 135
2
votes
0
answers
47
views
SSIS: How to export more than 4000 characters to Excel
I have the following basic setup in SQL 2008 R2. This does not work however as I always get the errors
Error 1 Validation error. SQL to XLS: SQL to XLS: Columns "Original" and "...
- 194
0
votes
1
answer
34
views
MSSQL Server 2019 SSIS installation
Currently our DBA team is tasked with supporting SSIS however we would like to separate the SSIS service from the actual database engine. The reason is to be able to have different teams responsible ...
- 135
0
votes
1
answer
43
views
SQL Agent Job Import Data
I'm having a problem with importing data. I created a package in SSIS and a connection between SSIS and sql server. It all works fine outside SQL Server but I wanted to make a 'Job' SQL Server Agent, ...
0
votes
1
answer
37
views
SSIS detecting sequential duplicates
SSIS/Sql Server/Visual Studio 2019.
I've got a big csv file that has a lot of iffy data. One thing I wanted to do was at least try to recognize sequential lines that are the same and kick the ...
- 283
2
votes
1
answer
105
views
SSIS csv import going slowly
I'm new to SSIS and I'm starting with 2019.
I'm getting a csv with 330 million rows and some of the data is dubious. Some rows I can identify as bad based on a single column value. Other issues I ...
- 283
0
votes
2
answers
55
views
From what volumes of data do data ingestion tools like apache nifi, flume, storm or tools like logstash become relevant?
I'm working in a company that has two legacy data warehouses, which have evolved to unmaintainable monoliths throughout the time. Therefore, they are in dire need of re-form.
I'm investigating a ...
- 103
1
vote
1
answer
173
views
SSIS package error based on database collation
I have this old SSIS package I was using to load utf8-encoded csv files into a database. A very small percentage of the data had unicode characters, and people didn't particularly care if we dropped ...
- 283
0
votes
1
answer
138
views
Inserting in db is extremely slow - SSIS OLE DB Destination
I have been experienced that my DB is experiencing a lot of performance issues and after some time I have observer that an SSIS jobs takes extremely long time to inserting new rows through SSIS OLE DB ...
- 13
0
votes
0
answers
27
views
Finding table name in encrypted SSIS package
I would like to find a table refence in SSIS package but if I check directly the package file, it is encrypted so I guess this is not possible, isn't it?
I tried to find it also on SQL Server agent db ...
- 13
0
votes
0
answers
6
views
SSIS - Attunity 5.0 Oracle destination running for hours yet row count shows data has arrived so why does the dest task look in a hung state?
Using SSDT v14
A simple package that extracts data from a SQL Server view and sends via Attunity to Oracle takes about 5 hours to run, of which 4 hours seems to be the Oracle destination task showing ...
- 257
-2
votes
1
answer
126
views
How to convert default Date format from MM/DD/YY to YYYY/MM/DD HH:MM:SS in SSIS packages?
I don't know what to write in Derived column expression.
Steps-
1.Source - Excel file
2.Derived column
3.Destination - OLE DB Destination
0
votes
0
answers
31
views
Issues connecting to postgresql DB using SSIS ODBC connector
I have an odd issue with ODBC connector: I built a very simple ssis package to read data from a Postgresql DB and then load the data into a sql server DB. To connect to the postgresql DB, i used ODBC ...
- 23
1
vote
1
answer
400
views
SSIS transforming numbers with decimal comma to decimal dot
I'm trying to create a very basic package that copies data from my SQL server into an Excel file.
The data that comes from the server comes with a decimal comma (e.g. 1234,56) - that is how I want it, ...
- 11
-1
votes
1
answer
60
views
Question about Key lookups
I have a table with 100 columns. The Primary key and clustered index are on the column Id - IX01_Id. I have a non-clustered index on Col2 - IX02_Col2.
I have 3 stored procedures that return the ...
- 53
1
vote
1
answer
36
views
SSIS: Can't save "parallel load" option in Oracle destination with Attunity driver, how to solve this?
I am working on an existing SSIS package that has proven to run successfully, however, due to data volume issues, I would like to try enabling the "parallel load" option by selecting the ...
- 257
0
votes
0
answers
30
views
SSIS Why is "Enable Support for AlwaysOn wizard" coming up blank?
I'm setting up SSISDB into a AO on SQL Server 2017 enterprise.
The AO i set some time ago and appears to work fine.
I've added the database to they AO, dashboard is showing everything as green. ...
1
vote
1
answer
24
views
monitor the dataflow component performance of SSIS packages
I want to monitor the performance of each component of dataflow of SSIS packages is this possible and how to do it. I have used the SSIS pipeline counters in the monitor performance but it provides ...
- 15
1
vote
0
answers
64
views
SSIS and SQL Agent - running jobs using proxy vs using MSA
We have multiple servers, each with its own SQL Server instance.
We have external companies that develop applications for us. This companies deploy SSIS packages and run them via SQL Agent.
I'm ...
- 141
0
votes
1
answer
63
views
How to recover missing SQL auto-recover files in SSMS (Microsoft SQL Server Management Studio) after unexpected shutdown
SQL Server Management Studio (SSMS) closed unexpectedly. Many SQL files were open. When SSMS was restarted, it did reopen some auto-recover files, but not all of them, especially one in particular. ...
- 133
1
vote
2
answers
465
views
SQL Server 2019 - using MSA as a proxy account
I'm thinking about using MSA (or gMSA) as proxies inside my SQL Server instances. This proxies would be used for example for running SSIS packages or xp_cmdshell command.
But based on what I've ...
- 141
-1
votes
1
answer
392
views
ODBC connection fails when running with SQL Server Agent
I've changed an SSIS package to use a 64-bit ODBC connection instead of 32-bit.
After deployment it works fine when executing the package but when running a SQL Server Agent job with the package it ...
- 99
0
votes
0
answers
48
views
SSIS Dynamically Loop through SQL Tables
I have been fighting with an SSIS package for sometime now.
I did successfully build a package that will extract data from a specific table by creating a date list from a script task, use a ...
- 397
0
votes
0
answers
13
views
Can the SSIS process pane automatically scroll to the current item when a package is running?
Can the SSIS process pane be made to automatically scroll to the currently processing item into view when a package is running?
To clarify...
I'm still very new to SSIS, and I'm unsure of the proper ...
- 133
0
votes
0
answers
71
views
Getting Error code 0x858C001B while trying to install Integration Services
I need help please.
Our SQL server VMs have just been migrated from one domain to a different domain. Migration was by cloning the VMs so SQL Server instances are untouched.
However, in trying to add ...
- 231
2
votes
0
answers
52
views
SQL Server - Holistic approach to managing permissions from a domain [closed]
We are small IT department and we are changing how our infrastructure works. We are trying to make it more secure, manageable and transparent for auditing.
We are implementing a domain for our servers ...
- 141
0
votes
0
answers
25
views
How does sql server allow job to run ssis package when proxy doesnt have msdbagent permissions?
I have a ssis sql job step with run as proxy account. This is scheduled to run every 6 hours.
The proxy account has required datareader and writer permission on the accounts_db database to be able to ...
- 2,158
0
votes
0
answers
39
views
Does ssis sql job step by default run under context of sql job owner?
Generally TSQL job step runs under context of agent service account when the job owner belongs to sysadmin role. Unless a different user account is set in the advanced pane. However if the job owner ...
- 2,158
0
votes
2
answers
272
views
What is the point of installing integration services without database engine?
My understanding is that the database engine feature of sql server enables us to create databases.
In the SSIS documentation, https://docs.microsoft.com/en-us/sql/integration-services/install-windows/...
- 2,158
0
votes
1
answer
353
views
Granting SSIS permissions - how to use roles and proxies [closed]
I'm new to a SSIS workflow and I'm trying to understand how should I go about grating permissions.
There are many different database-level roles for SSIS, there is SQL Server Agent involved or Proxies....
- 141
0
votes
1
answer
472
views
SSIS: Extract SQL Data and Split across Flat files based on row count
I have created a simple SSIS package that queries a table and extracts data to a flat CSV file. In production this extract could be millions of rows and I want to split the flat file destinations into ...
- 397
1
vote
1
answer
780
views
Security best practices for SSIS package execution via SQL Agent job
We're trying to rein in the number of sysadmins on our servers, and one of the issues we're running into pertains to SQL Agent security -- especially with regard to SSIS jobs and our ETL team. I ...
- 65
2
votes
1
answer
32
views
Identifying elements in SSIS package built in MS Visual Studio 2008
I recognize that these are variables, but I am not sure how to add these elements to the package (or how they are added to begin with), what effect that have or even how to manipulate them. No right ...
- 75