Questions tagged [azure-data-factory]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
26 views

Alternative methods for client data integration (Azure SQL Database)

I have an application that ingests data from clients on a daily/weekly basis (two different data sets, one daily and the other weekly) into a SQL Azure Database. The clients' data source depends on ...
0
votes
1answer
74 views

Migrating Azure SQL database to Azure sql Managed instance

What are different options to move database from "Azure sql server" to "Azure sql managed instance", Looks like below options are not possible 1) Azure migration service - Not supporting azure sql ...
2
votes
1answer
18 views

Azure SSIS Deploying in SQL Azure

Does deploying SSIS really required an azure data lake house when deploying on Azure database?. I am currently working on an SSIS project that its database is currently deployed on Azure and I am ...
1
vote
1answer
36 views

Stored procedure to set value to a column must accept returned values from functions

I created a very simple table in Data Mart to store ETL diagnostic information: CREATE TABLE [internal].[etl_status] ( [property_name] VARCHAR(100) NOT NULL PRIMARY KEY, [property_value] ...
0
votes
0answers
65 views

Question about data type to hold large number

I have a line of data that store on Microsft SQL Server 13.0.4 in numeric(32,16). It looks like this 9642327391274.0000000000000000 I try to migrate that database table to another on Azure SQL ...
1
vote
0answers
35 views

How to automatically append updated data

I am currently working with Azure Data Factory to create pipelines that feed from a dataset into tables located in Microsoft SQL Server Management Studio. My issue is that whenever new data is fed ...
2
votes
0answers
32 views

How to implement updates from mySQL operational DB to Azure SQL DB for reporting

We have an operational mySQL DB running on AWS for a transactional system and an Azure SQL DB for reporting with PowerBI. Now I'd like to regularly (e.g. every night) do an update of certain tables ...
0
votes
1answer
119 views

What type of data ingestion does Azure Data Factory use?

This article data-ingestion says that there are two types of data ingestion Data can be streamed in real time or ingested in batches. What type of data ingestion does Azure Data Factory's ...
1
vote
1answer
2k views

Parameter value in Data Factory Triggered pipeline

I have a pipeline configured in azure data factory which basically does create a backup file (JSON) from a cosmosDB dataset and it's saved in a blob storage, my problem comes when I want to schedule ...
0
votes
0answers
36 views

Copying data factory datasets and working with JSON files

Is it just me or is data factory absolutely hopeless? I am working with the V1 version of the product and it is so clunky, it's ridiculous. For instance, we have set up a pipeline which transfers ...
2
votes
1answer
2k views

Azure Data Factory 'Failed Validation' with Folder does not exist

I uploaded whole set of .txt files in my blob storage with folder structure Year/Month/day. I circled the folder structure. Then in the pipeline I have following dataset created. "type": "...