Questions tagged [polybase]

Microsoft SQL Server product to allow SQL queries against relational, Hadoop and Azure blob storage.

Filter by
Sorted by
Tagged with
1 vote
1 answer
86 views

PolyBase :: How to setup EXTERNAL DATA SOURCE through ODBC?

Microsoft states that: [...You can also use the generic ODBC connector to connect to additional providers using third-party ODBC drivers.] The reality is much far away form that. I've been trying to ...
user avatar
0 votes
1 answer
23 views

PolyBase :: Changed database context to 'DWQueue'

I'm installing PolyBase on the latest SQL Server 2019. During the installation I'm incurring in this error: https://www.youtube.com/watch?v=Oxd8yeiBfig (sorry for the video quality) The proposed new ...
user avatar
0 votes
0 answers
30 views

What is the correct type in sys.objects for an external table against another SQL Server

In SQL Server 2019 we use Polybase to create External tables pointing at tables on another SQL Server. When I look at these external tables in sys.objects, they have the type U , meaning USER_TABLE. ...
user avatar
  • 563
1 vote
0 answers
110 views

Polybase converts getdate() to the wrong format

We have two SQL Servers (both running Enterprise version on 15.0.4083.2) where we use queries to External tables via Polybase from one server to the other. We have encountered a strange error when we ...
user avatar
  • 563
0 votes
1 answer
183 views

SQL Server 2019 Polybase error - cant create External table

I am trying to setup an external data source in SQL Server 2019 to another database on the same server. I am doing this to create external table I tried the following to set it up I installed SQL ...
user avatar
1 vote
1 answer
306 views

SQL Server 2019 Polybase installation error "The proposed new database owner is already a user or aliased in the database"

I've recently performed an in-place upgrade of the default instance of a SQL Server 2016 to SQL Server 2019 (CU11). I'm trying to add the Polybase feature but am unable to resolve this error that ...
user avatar
  • 147
0 votes
1 answer
350 views

Polybase with SQL Server 2019 on Linux or Containers

I would like to install SQL Server 2019 on Linux either a full Linux server (Ubuntu 18.04) or on a Docker container with Polybase. Installing MSSQL 2019 on a Linux Server or a container is relatively ...
user avatar
1 vote
2 answers
209 views

Query to polybase external table giving error "Access to the remote server is denied because no login-mapping exists."

we have successfully created all pre-requisite of creating external tables using SQL Server 2017 Standard Edition CU22 Polybase. The issue we have is the non-sysadmin login can't query those external ...
user avatar
  • 11
2 votes
3 answers
7k views

Why is Microsoft SQL Server creating a ton of dump files?

How to determine what is causing Microsoft SQL Server to create dump files over and over taking up 170 GB of disk space? How do I troubleshoot what is causing the dumps? The path of the dump files is ...
user avatar
0 votes
0 answers
983 views

User, group, or role ... already exists in the current database. Changed database context to 'DWConfiguration'. Error code: 0x84BB0001

Most of the question is in the title. My case concerns MS SQL Server 2017 - Developer Edition. The error happens during SQL Server 2017 installation process. While searching for answer online I ...
user avatar
2 votes
1 answer
1k views

SQL Server Polybase Data Movement Service stopping after few seconds

I have been scratching my head for a while now on how to fix this issue, SQL Server Polybase Data Movement Service starts successfully however after a few seconds it just stops. The OS on our server ...
user avatar
  • 223
1 vote
0 answers
105 views

How to install PolyBase in an availability groups architecture for high availability?

Background: I’m designing a 2 node SQL 2019 availability groups installation hosted in VMs. We would have limited (single node) usage of PolyBase. The Microsoft Docs don’t reference installation for ...
user avatar
2 votes
1 answer
622 views

How to ignore columns in parquet/polybase import?

I'm using polybase to import a parquet file. Over time, it is likely we may add or remove named columns in the file. When I add an additional column, I get the below error: External file access ...
user avatar
  • 1,194
6 votes
1 answer
3k views

Performance of Polybase

We've been experimenting with Polybase on a SQL Server 2019 (CU2) box, using SQL Server external data sources and the performance has not been good - in most cases a 1400% increase. In each case all ...
user avatar
0 votes
1 answer
165 views

SQL Server 2019 - Polybase -> Cosmos DB (MongoDB Mode) Error with dates

I'm new to polybase. I have linked my SQL Serer 2019 to a third parties Azure cosmos and i am able to query data out of my collection. I am getting an error out when i try to query date fields though. ...
user avatar
  • 178
2 votes
0 answers
504 views

PolyBase to CSV File

I'm trying to see if it's possible to create a PolyBase connection to a .CSV file. I'm using the Microsoft Access Text Driver and have set up a system DSN to the folder where the csv file is located. ...
user avatar
  • 689
1 vote
2 answers
882 views

Missing Polybase enable configuration on SQL Server 2017

I installed SQL Server 2017 Enterprise (14.0.3162.1) on my box. With the polybase (Scale-out Group). But when I try to enable through: exec sp_configure @configname = 'polybase enabled', @configvalue ...
user avatar
2 votes
1 answer
481 views

Reading decimal mark comma with an external table

SQL Server 2016, SQL Server Management Studio (SSMS). Creating external tables with Transact-SQL and Polybase. How can we read decimals with a decimal mark, comma instead of dot? When using float and ...
user avatar
  • 139
5 votes
3 answers
2k views

Azure SQL Warehouse - Data Ingestion - Convert a huge fixed width (with commas) file to delimited

I am not even sure if I am framing this question right, but I will try - I have a bunch of huge text files generated from an Oracle export on a Linux system. Each file is about 30 GB in size, and I ...
user avatar
  • 2,397
3 votes
1 answer
4k views

Can't stop "SQL Server Polybase Data Movement"

When I start Windows the "SQL Server Polybase Data Movement" service is in the "Change pending..." state and I can't close it. When I try to stop it mmc crashes. In Windows services, the status = ...
user avatar
0 votes
1 answer
120 views

Polybase with Cloudera 5.9

We are working on a Proof Of Concept using Polybase with Cloudera. In the polybase documentation it says we can connect to Cloudera 5.5: https://msdn.microsoft.com/en-us/library/mt143174.aspx We ...
user avatar
3 votes
1 answer
2k views

How does PolyBase collect statistics from external tables?

Books online has this to say about query optimisation in PolyBase: The query optimizer makes a cost-based decision to push computation to Hadoop when doing so will improve query performance. It ...
user avatar