Questions tagged [polybase]

Microsoft SQL Server product to allow SQL queries against relational, Hadoop and Azure blob storage.

Filter by
Sorted by
Tagged with
0 votes
1 answer
59 views

SQL Server 2022 - Polybase External Tables - Create a master key

SQL Server 2022, CU 10 on Windows 2022. I am migrating a SQL Server 2019 database to a new SQL Server 2022 and when attempting to SELECT rows from an external Polybase driven table, I get the ...
Craig Efrein's user avatar
  • 9,640
1 vote
0 answers
321 views

Polybase In SQL server 2019 and 2022 take so long time

I'm using polybase to load data from PostgreSQL and have some problem The PostgreSQl database and SQL server (for my case is SQL server 2022) are in same machine. I create an external table in SQL ...
Duc Trinh's user avatar
1 vote
1 answer
382 views

ETL table from one SQL Server to another SQL Server

I would like to ETL a table from one instance of SQL Server to another instance of SQL Server. I do not want to create an SSIS package. I have tried to extract the data using an External Table on the ...
xhr489's user avatar
  • 805
1 vote
0 answers
56 views

Does polybase support having a table to represent a REST API?

I have customer information in a SQL server table, and the billing information is exposed via REST web api (with customer_id as parameter). I am exploring using polybase to create the polybase table ...
variable's user avatar
  • 3,591
0 votes
1 answer
405 views

Does polybase bring entire external table data onto sql server?

I'm exploring sql polybase using Azure blob storage and other data sources. For blob storage sql server brings the entire blob onto the server and then performs where/join. What is the behaviour when ...
variable's user avatar
  • 3,591
-2 votes
1 answer
332 views

External tables: Why create statistics?

The documentation for Polybase says that creating statistics for External Tables will help getting better execution plans. This question is about when the External Data Source is another SQL Server. I ...
xhr489's user avatar
  • 805
2 votes
1 answer
1k views

PolyBase :: How to setup EXTERNAL DATA SOURCE through ODBC?

Microsoft states that: [...You can also use the generic ODBC connector to connect to additional providers using third-party ODBC drivers.] The reality is much far away form that. I've been trying to ...
Francesco Mantovani's user avatar
0 votes
1 answer
461 views

PolyBase :: Changed database context to 'DWQueue'

I'm installing PolyBase on the latest SQL Server 2019. During the installation I'm incurring in this error: https://www.youtube.com/watch?v=Oxd8yeiBfig (sorry for the video quality) The proposed new ...
Francesco Mantovani's user avatar
1 vote
0 answers
245 views

Polybase converts getdate() to the wrong format

We have two SQL Servers (both running Enterprise version on 15.0.4083.2) where we use queries to External tables via Polybase from one server to the other. We have encountered a strange error when we ...
GHauan's user avatar
  • 603
1 vote
1 answer
1k views

SQL Server 2019 Polybase installation error "The proposed new database owner is already a user or aliased in the database"

I've recently performed an in-place upgrade of the default instance of a SQL Server 2016 to SQL Server 2019 (CU11). I'm trying to add the Polybase feature but am unable to resolve this error that ...
sTTu's user avatar
  • 146
0 votes
1 answer
683 views

Polybase with SQL Server 2019 on Linux or Containers

I would like to install SQL Server 2019 on Linux either a full Linux server (Ubuntu 18.04) or on a Docker container with Polybase. Installing MSSQL 2019 on a Linux Server or a container is relatively ...
Kent Maxwell's user avatar
1 vote
2 answers
288 views

Query to polybase external table giving error "Access to the remote server is denied because no login-mapping exists."

we have successfully created all pre-requisite of creating external tables using SQL Server 2017 Standard Edition CU22 Polybase. The issue we have is the non-sysadmin login can't query those external ...
Praful's user avatar
  • 11
4 votes
4 answers
14k views

Why is Microsoft SQL Server creating a ton of dump files?

How to determine what is causing Microsoft SQL Server to create dump files over and over taking up 170 GB of disk space? How do I troubleshoot what is causing the dumps? The path of the dump files is ...
Tanooki Mario's user avatar
2 votes
3 answers
3k views

SQL Server Polybase Data Movement Service stopping after few seconds

I have been scratching my head for a while now on how to fix this issue, SQL Server Polybase Data Movement Service starts successfully however after a few seconds it just stops. The OS on our server ...
JPVoogt's user avatar
  • 223
1 vote
0 answers
161 views

How to install PolyBase in an availability groups architecture for high availability?

Background: I’m designing a 2 node SQL 2019 availability groups installation hosted in VMs. We would have limited (single node) usage of PolyBase. The Microsoft Docs don’t reference installation for ...
Marshall's user avatar
2 votes
1 answer
969 views

How to ignore columns in parquet/polybase import?

I'm using polybase to import a parquet file. Over time, it is likely we may add or remove named columns in the file. When I add an additional column, I get the below error: External file access ...
Neil P's user avatar
  • 1,274
6 votes
1 answer
4k views

Performance of Polybase

We've been experimenting with Polybase on a SQL Server 2019 (CU2) box, using SQL Server external data sources and the performance has not been good - in most cases a 1400% increase. In each case all ...
Select 'DBA''s user avatar
0 votes
1 answer
250 views

SQL Server 2019 - Polybase -> Cosmos DB (MongoDB Mode) Error with dates

I'm new to polybase. I have linked my SQL Serer 2019 to a third parties Azure cosmos and i am able to query data out of my collection. I am getting an error out when i try to query date fields though. ...
u07ch's user avatar
  • 178
2 votes
0 answers
737 views

PolyBase to CSV File

I'm trying to see if it's possible to create a PolyBase connection to a .CSV file. I'm using the Microsoft Access Text Driver and have set up a system DSN to the folder where the csv file is located. ...
MrTCS's user avatar
  • 699
1 vote
2 answers
1k views

Missing Polybase enable configuration on SQL Server 2017

I installed SQL Server 2017 Enterprise (14.0.3162.1) on my box. With the polybase (Scale-out Group). But when I try to enable through: exec sp_configure @configname = 'polybase enabled', @configvalue ...
DBALUKE HUANG's user avatar
2 votes
1 answer
915 views

Reading decimal mark comma with an external table

SQL Server 2016, SQL Server Management Studio (SSMS). Creating external tables with Transact-SQL and Polybase. How can we read decimals with a decimal mark, comma instead of dot? When using float and ...
SNR's user avatar
  • 139
5 votes
3 answers
2k views

Azure SQL Warehouse - Data Ingestion - Convert a huge fixed width (with commas) file to delimited

I am not even sure if I am framing this question right, but I will try - I have a bunch of huge text files generated from an Oracle export on a Linux system. Each file is about 30 GB in size, and I ...
RK Kuppala's user avatar
  • 2,437
3 votes
1 answer
5k views

Can't stop "SQL Server Polybase Data Movement"

When I start Windows the "SQL Server Polybase Data Movement" service is in the "Change pending..." state and I can't close it. When I try to stop it mmc crashes. In Windows services, the status = ...
xenorack's user avatar
0 votes
1 answer
124 views

Polybase with Cloudera 5.9

We are working on a Proof Of Concept using Polybase with Cloudera. In the polybase documentation it says we can connect to Cloudera 5.5: https://msdn.microsoft.com/en-us/library/mt143174.aspx We ...
Jeremiah's user avatar
3 votes
1 answer
2k views

How does PolyBase collect statistics from external tables?

Books online has this to say about query optimisation in PolyBase: The query optimizer makes a cost-based decision to push computation to Hadoop when doing so will improve query performance. It ...
Michael Green's user avatar