Questions tagged [integration]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
6
votes
5answers
14k views

Does MySQL have a version of Change Data Capture?

We're in the process of phasing out an old system and migrating onto a new one. The last time that we phased out an old system, we ran both systems in parallel and integrated data between both until ...
2
votes
1answer
112 views

Scheduled snapshots of views (without using materialized views or Oracle Golden Gate)?

I have 40 views in an Oracle 18c GIS database that are used in a map in a workorder management system (WMS). The views are served up to the WMS map via a web service. There are an average of 10,...
1
vote
3answers
102 views

View: Ignore a left join if it is not used?

I have a web service that references a view called gis_sidewalks_vw. create table gis_sidewalks ( id number(10,0), last_edited_date date ); insert into gis_sidewalks (id, last_edited_date)...
0
votes
1answer
267 views

SQL Server Integration Services (SSIS) Package Failing with no error

I have some SSIS packages that are executed as steps in a Server Agent Job. The Steps often fail with no error and I have had to add retries. Now the jobs complete but I get the warning exclamation ...
0
votes
0answers
37 views

Options for syncing from a MASTER table to a COPY table?

I have a MASTER table and a COPY table in separate databases (both are Oracle 12c). I want to sync the MASTER table with the COPY table on a weekly basis. I can think of a few options for syncing ...
0
votes
1answer
42 views

Get notification about invalid views

I have 40 views that are integrated/synced to a work order management system on a weekly basis. The views are based on GIS tables which are notoriously messy. Over time, the views can end up becoming ...
0
votes
3answers
126 views

Integration: Keep two systems in sync

I have a GIS system with 40 tables, ranging from 1,000 to 60,000 rows per table. The tables are the system of record for assets in a municipality. The GIS assets in the tables get integrated to a ...
1
vote
1answer
68 views

How to fix data discrepancies between columns from two tables

The problem: I am working for a retail site that sells various products for cars and trucks. We want to integrate eBay and Amazon API to list our products on these stores. The problem arises when I ...
2
votes
1answer
64 views

Data from different tables into one table

I've requirement where I need to store information from different sources in my system and the process that data. When I say from different sources it will be completely different table structure from ...
2
votes
1answer
2k views

Register dll to use in SSIS Script Component

I've been asked to register an existing dll file so that it can be referenced in an SSIS script component. I have a dim and distant memory of doing this using gacutil.exe so that was my initial go to....
10
votes
3answers
183 views

Looking for advice on how to integrate data from 100+ client DB's into a centralized reporting database

I am a SQL Developer (not DBA or Architect) for a small (~50 employees) SaaS company. I am tasked with figuring out how to: Offload operational reporting from our 100+ OLTP databases Allow those ...
1
vote
1answer
31 views

Data integration name of best practices to avoid corruption, caused by becoming out of sync?

I have identified an issue in the design of a system and I am trying to find the right language to describe the cause of the issue so I can report it to managers, and get the issue fixed. The problem ...
5
votes
3answers
910 views

Can PostgreSQL support integration test with some kind of throwaway overlay?

It's a common problem to write integration tests that include a database. If the test changes the database then it could effect other tests or the next run of itself. I know that I could wrap my test ...
1
vote
0answers
54 views

Efficient methods/tools for managing a data warehouse pulling data from multiple database applications

Until now I have used an on premise SQL Server 2012 and performed manual ETL operations to create/manage a data warehouse that contains data from multiple database application from different ...
12
votes
4answers
44k views

Not able to create SSISDB catalog

Getting the error below while trying to create a catalog in sql server 2014 integration services. Any idea what I missed in installation or anywhere else? The catalog backup file 'C:\Program Files\...
1
vote
1answer
578 views

decrypt data in column before load into destination

I have a table named city which contains two columns city_id (int) city_name (varbinary) -- encrypted column I want to extract data from this table, transform (decrypt the city_name) and load (...
1
vote
1answer
657 views

SQL User Permissions for Continuous Integration via DbUp and Octopus

Currently, our deverloper group has started using DbUp and Octopus to do Continuous Integration on SQL Database Deployments. We have created a Domain user which will utilized to do the SQL Database ...
1
vote
0answers
2k views

Service Broker received an error message on this conversation

I will first have to say, I am still trying to wrap my brain around all the components of the Service Broker and how they work together, so it's very likely I'm missing something obvious... it's just ...
0
votes
0answers
68 views

Merge data using Integration Service

Please Consider this scenario: I have a table in my database. I want move this data in my OLAP database using SSIS.I can move all record from my table to OLAP database.The problem is I don't know how ...