Questions tagged [integration]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
35 views

Creating blank/deleting rows form excel using SSIS

I have an .xlsx file I import data from nightly. Once the import is complete I delete the tables(sheets/tabs) in the excel file using an Execute SQL Task so that the file is blank for the user but ...
0
votes
0answers
19 views

tracking in odi the package which uses a given mapping

I am trying to find the whole lineage and loading process of a certain table column. To begin with i am locating the mapping used to populate the column. To do this i use: select m.name ...
0
votes
0answers
13 views

odi column lineage query

I have no odi experience and i have inherited an oracle data warehouse fed by odi implementations. I need to validate the source to target flows for several fields.My first attempt is to try to create ...
0
votes
1answer
34 views

Alternative methods for client data integration (Azure SQL Database)

I have an application that ingests data from clients on a daily/weekly basis (two different data sets, one daily and the other weekly) into a SQL Azure Database. The clients' data source depends on ...
2
votes
1answer
146 views

Scheduled snapshots of views (without using materialized views or Oracle Golden Gate)?

I have 40 views in an Oracle 18c GIS database that are used in a map in a workorder management system (WMS). The views are served up to the WMS map via a web service. There are an average of 10,...
0
votes
1answer
45 views

Get notification about invalid views

I have 40 views that are integrated/synced to a work order management system on a weekly basis. The views are based on GIS tables which are notoriously messy. Over time, the views can end up becoming ...
0
votes
0answers
38 views

Options for syncing from a MASTER table to a COPY table?

I have a MASTER table and a COPY table in separate databases (both are Oracle 12c). I want to sync the MASTER table with the COPY table on a weekly basis. I can think of a few options for syncing ...
1
vote
3answers
104 views

View: Ignore a left join if it is not used?

I have a web service that references a view called gis_sidewalks_vw. create table gis_sidewalks ( id number(10,0), last_edited_date date ); insert into gis_sidewalks (id, last_edited_date)...
0
votes
3answers
157 views

Integration: Keep two systems in sync

I have a GIS system with 40 tables, ranging from 1,000 to 60,000 rows per table. The tables are the system of record for assets in a municipality. The GIS assets in the tables get integrated to a ...
0
votes
1answer
494 views

SQL Server Integration Services (SSIS) Package Failing with no error

I have some SSIS packages that are executed as steps in a Server Agent Job. The Steps often fail with no error and I have had to add retries. Now the jobs complete but I get the warning exclamation ...
2
votes
1answer
2k views

Register dll to use in SSIS Script Component

I've been asked to register an existing dll file so that it can be referenced in an SSIS script component. I have a dim and distant memory of doing this using gacutil.exe so that was my initial go to....
10
votes
3answers
215 views

Looking for advice on how to integrate data from 100+ client DB's into a centralized reporting database

I am a SQL Developer (not DBA or Architect) for a small (~50 employees) SaaS company. I am tasked with figuring out how to: Offload operational reporting from our 100+ OLTP databases Allow those ...
1
vote
1answer
32 views

Data integration name of best practices to avoid corruption, caused by becoming out of sync?

I have identified an issue in the design of a system and I am trying to find the right language to describe the cause of the issue so I can report it to managers, and get the issue fixed. The problem ...
1
vote
1answer
74 views

How to fix data discrepancies between columns from two tables

The problem: I am working for a retail site that sells various products for cars and trucks. We want to integrate eBay and Amazon API to list our products on these stores. The problem arises when I ...
1
vote
0answers
54 views

Efficient methods/tools for managing a data warehouse pulling data from multiple database applications

Until now I have used an on premise SQL Server 2012 and performed manual ETL operations to create/manage a data warehouse that contains data from multiple database application from different ...
2
votes
1answer
70 views

Data from different tables into one table

I've requirement where I need to store information from different sources in my system and the process that data. When I say from different sources it will be completely different table structure from ...
1
vote
1answer
645 views

decrypt data in column before load into destination

I have a table named city which contains two columns city_id (int) city_name (varbinary) -- encrypted column I want to extract data from this table, transform (decrypt the city_name) and load (...
1
vote
1answer
714 views

SQL User Permissions for Continuous Integration via DbUp and Octopus

Currently, our deverloper group has started using DbUp and Octopus to do Continuous Integration on SQL Database Deployments. We have created a Domain user which will utilized to do the SQL Database ...
1
vote
0answers
2k views

Service Broker received an error message on this conversation

I will first have to say, I am still trying to wrap my brain around all the components of the Service Broker and how they work together, so it's very likely I'm missing something obvious... it's just ...
15
votes
4answers
52k views

Not able to create SSISDB catalog

Getting the error below while trying to create a catalog in sql server 2014 integration services. Any idea what I missed in installation or anywhere else? The catalog backup file 'C:\Program Files\...
7
votes
5answers
15k views

Does MySQL have a version of Change Data Capture?

We're in the process of phasing out an old system and migrating onto a new one. The last time that we phased out an old system, we ran both systems in parallel and integrated data between both until ...
0
votes
0answers
71 views

Merge data using Integration Service

Please Consider this scenario: I have a table in my database. I want move this data in my OLAP database using SSIS.I can move all record from my table to OLAP database.The problem is I don't know how ...
5
votes
3answers
997 views

Can PostgreSQL support integration test with some kind of throwaway overlay?

It's a common problem to write integration tests that include a database. If the test changes the database then it could effect other tests or the next run of itself. I know that I could wrap my test ...