Skip to main content

Questions tagged [google-cloud-platform]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
35 views

Basic setup with Cloud SQL and IAM authentication

Let's say I have a database instance, two databases db1 and db2, and two users user1 and user2@PROJECT_ID.iam (BUILTIN and CLOUD_IAM_SERVICE_ACCOUNT). In other words: resource "...
x-yuri's user avatar
  • 367
0 votes
0 answers
48 views

How to create and manage superusers (like sysadmin) in Google Cloud SQL with SQL Server

I'm a database engineer that works most with SQL Server and with experience with SQL Server and all SQL alternatives in Microsoft Azure and AWS. Recently I had to work with a managed SQL Server ...
Henry Leme's user avatar
0 votes
1 answer
15 views

Google Datastream errors on larger MySQL tables

I have set up a Datastream service, in order to replicate data from Cloud SQL (MySQL) to BigQuery. Everything is set up correctly, connection works. But the weird thing is that only tables < 10mb ...
Spock 's user avatar
  • 101
0 votes
0 answers
12 views

CloudSQL for Postgres S3 extension

In AWS RDS for Postgres, there is an extension called AWS_S3 that provides functions within Postgres that allow me to import data directly from a bucket into a table and export data from a table ...
Jose Rocha's user avatar
0 votes
0 answers
159 views

MongoServerSelectionError: Client network socket disconnected before secure TLS connection was established on GKE Autopilot workload

We are in the process of migrating from CloudRun to GKE Autopilot. We have the same exact environment variables and the LoadBalancer service for the workload has the same port configuration as the ...
ift-436t's user avatar
0 votes
1 answer
212 views

VM Snapshot and SQL Server AG

I have a SQL Server Always On with two nodes. We recently started taking snapshots of the disks, but only on one of the nodes. To ensure that the snapshots are restorable, we decided to perform a ...
Jose Rocha's user avatar
0 votes
0 answers
325 views

How to connect to a postgreSQL database hosted locally on my PC from google colab?

I'm trying to connect to a postgreSQL database on my PC from google colab. I'm using sqlalchemy to attempt this. I have a table named mdl_assign_grades which I'm trying to access. Here's my code: from ...
Bruce Murdock's user avatar
0 votes
1 answer
214 views

Why Postgres on GCP is not using all the available memory?

I have a Postgres instance on GCP with incredibly slow queries. The database structure is very bad, but I believe something else is also affecting performance. Although the instance has 4GB of memory ...
gcstr's user avatar
  • 101
0 votes
1 answer
65 views

Google Cloud for MSSQL: BAK file import takes up an exaggerated amount of space

I was searching a lot about this issue and can't find any relative information. I have a MSSQL Server instances running on Google Cloud for MSSQL, and I'm trying to import a database bak file that was ...
Les's user avatar
  • 1
0 votes
1 answer
45 views

What is ideal configuration for Mysqld.cnf?

I run a news & media blog with over a few million readers every month. I'm currently using Google Cloud with a 32gb ram server with WordPress. My server is hitting 84% memory usage due to the ...
Jaya's user avatar
  • 11
1 vote
0 answers
98 views

How to recover stopped replication on MySQL?

Several times now my Google Cloud MySQL read replica just stopped replication of the master. Visible symptoms are: Replication lags rises on the slave. The Relay_Log_Pos value of show slave status is ...
Laures's user avatar
  • 111
1 vote
1 answer
1k views

Installing pglogical: Find postgres include folder, add all include folders to C_INCLUDE_PATH

I am trying to install the pglogical extension in my postgres database, which I installed on my macOS with homebrew. I am following instructions provided on the GCP blog as I am preparing to migrate ...
Dinosaur Reporter's user avatar
2 votes
1 answer
352 views

MySQL 5.7 won't restart, even without Apparmor disabled on Ubuntu 18.04

After a server restart, while MySQL shows to be running, it's totally inaccessible and everything i've tried to do to rectify hasn't resolved the issue. I'm going to try to make this has easy to read ...
David's user avatar
  • 133
1 vote
1 answer
769 views

How do I see where postgres privileges are coming from for a role?

Im using google cloudsql but this is a more generic postgres question. I have a role (that is already created and managed by cloudsql) called cloudsqliamserviceaccount. The cloudsqliamserviceaccount ...
user1028270's user avatar
0 votes
0 answers
241 views

Google cloud MySQL replication with partition

I recently altered a table in MySQL 8.0 to with new Primary key and created partitions with them to improve the query performance. which worked fine in main instance. My assumption was that the ...
Azar's user avatar
  • 1
0 votes
1 answer
615 views

Same postgres query in two different instances with the same data but with different times

I have the same postgres query running in two different instances restored with the same dump file: one instance in aws rds => https://explain.depesz.com/s/USMO ('PostgreSQL 11.10 on x86_64-pc-...
Igor Gois's user avatar
1 vote
1 answer
4k views

MySqldump Error 2013: Lost Connection MySQL During create database backup

I am use Prestashop. am create a script for auto backup of whole database of my site but from last few given this error and backup terminate at this table. mysqldump: Error 2013: Lost connection to ...
user avatar
1 vote
0 answers
131 views

Restore Stored Procedure from Google Cloud MYSQL?

I accidentally overwrote a MYSQL stored procedure through the Workbench client connected to a GCP MYSQL instance. I tried restoring a previous backup to recover it, but that only restored the tables - ...
Baz's user avatar
  • 111
1 vote
0 answers
37 views

Move Our Google Cloud SQL Instance to Compute Engine

We are running several Cloud SQL Instances on GCP and plan to move all of them to some Compute Engine instances, depending on the applications that use it. Our main concern is cost of the server. We ...
Prabowo Murti's user avatar
0 votes
1 answer
39 views

Any way of forcing MySQL to use smaller files?

This is actually Maria DB. I'm using it on W10 and Linux Mint 18.3. The issue here is that I recently strated to use Google Backup & Sync to sync between my various machines running W10 (I'm ...
mike rodent's user avatar
1 vote
0 answers
59 views

Is necessary to backup Google Firestore DB?

Im working a production app in Google's Firebase Firestore platform, have been development from a very long time (year and a half ago) and now that its in production I'm worried about backing up and ...
Karlo A. López's user avatar
0 votes
2 answers
278 views

Why is an instance forced to reboot?

This is My SQL Project instance log. I set the instance not to shut down automatically. But why does the instance automatically shut down irregularly? 2019-03-28 08:58:13.100 JST 2019-03-27 23:58:13 ...
금융공학thinkpool's user avatar
2 votes
1 answer
652 views

Using mariabackup/xtrabackup vs block level snapshots

I am running a mariadb 10.1 instance with all innodb tables and a replication slave in a k8s cluster on Google Cloud's GKE. I have a scheduled mysqldump that runs every night. But for additional ...
Kyle's user avatar
  • 131
1 vote
1 answer
263 views

Google Cloud SQL lacks raster2pgsql

Google Cloud SQL supports the PostGIS extension, but I haven't seen any documentation regarding how to work with raster data on it. To load raster data into a table, we have to use raster2pgsql driver....
d4nielfr4nco's user avatar
2 votes
0 answers
381 views

How to backup a local database to cloud database?

I am about to start developing a POS software as my new project with python and electron js. It is going to be a desktop application. However, my concern is it should work in both cases when desktop ...
Abbas's user avatar
  • 121
1 vote
0 answers
62 views

Why use Failover replica on Google Cloud RDS?

we are thinking of migrating our MySQL database from our dedicated server to a Google Cloud RDS instance. However I would like to clarify the below: 1) What is the purpose of creating a failover ...
Leonidas's user avatar
2 votes
1 answer
1k views

Mongodb replica set primary and secondary node conf fail when one slave is down

In my env, I had created MongoDB replica set conf for high availability so one server fails should be handled by other also in my conf I have 3 DB server and 1 arbiter too but, my slave's server ...
Akshay Singhal's user avatar
3 votes
0 answers
116 views

Google datastore and materialized paths

Folks from MongoDB have documented a very nice approach of using a data model for tree-like structures: they call it Materialized Paths. Consider following: If I populate this hierarchy using ...
Andrejs Cainikovs's user avatar
0 votes
1 answer
31 views

How do you make manual/one-off log-based queries?

My app engine instances are logging incoming requests and I'd like to be able to run manual/one-off queries for data analysis. As an example, I would like to be able to determine how many requests ...
user avatar
1 vote
3 answers
3k views

Google Cloud SQL Replication Delay

We have a project which does write data on a second generation MySQL 5.6 The master's write behaviour: Average 70 write operations per second. The thing is 2 times a day, application writes data ...
Ozan Temel's user avatar
4 votes
1 answer
5k views

MongoDB crashes with out-of-memory or is being killed by oom-killer

A two shards MongoDB database regularly crashes with out-of-memory error or is being killed by the oom-killer. The system runs on GCE Debian 9.4 with MongoDB v3.6.5, WiredTiger storage engine and ...
ssasa's user avatar
  • 241
3 votes
2 answers
1k views

How to query for certain text in log messages from Google App Engine that are exported to BigQuery?

I have used the 'Create Export' in the Logging section of Google Cloud Platform to export log entries into Big Query for analysis Here is part of the structure of the table in BigQuery that logs the ...
Anthony Kong's user avatar
2 votes
2 answers
1k views

Sync MongoDB Replica set with Remote Replica Set

I'm wondering if it is possible (within reason) to sync a new MongoDB Replica Set(RS) with an RS currently in production. The Problem We have a site running on AWS that has its own MongoDB Replica ...
Eric Uldall's user avatar
0 votes
1 answer
783 views

MySQL compression on Google Cloud SQL

As the Google Cloud SQL is a managed instance of MySQL under the hood, limited to an absolute max on 2nd generation machines of 100GB of RAM, should I be compressing some of my table and index data ? ...
DamagedGoods's user avatar
  • 2,591