middleware between PostgreSQL servers and clients for connection pooling, replication and load balancing

learn more… | top users | synonyms

13
votes
2answers
4k views

Streaming replication and failover on PostgreSQL

I am doing a proof of concept on PostgreSQL replication. After the discussion on forum we decided to go with streaming replication as the performance is good compared to other solutions. PostgreSQL is ...
6
votes
2answers
316 views

Postgres with pgpool architecture

Below is an example pgpool architecture: This implies that you only need to have pgpool on a single server; is this true? When I look at the configuration I also see that you configure backends ...
5
votes
2answers
2k views

Removing Archive Logs after PostgreSQL PITR online-recovery

I'm using pgpool-II + PostgreSQL 8.4 on three servers: primary + standby1 + standby2. Replication mode is "on" Load balance mode is "on" (between primary and standby1) I followed the official ...
5
votes
1answer
776 views

How large should my pool size be? And should I use pgbouncer?

I have a Rails application with 4 Unicorn workers. How do I determine what postgresql database pool size I should use? And if I have 6 applications connecting to this postgres database, would that be ...
4
votes
1answer
590 views

Can you make SSL and SSL-only (hostssl) connections to PGPool?

The new version of PGPool (3.2) has an "SSL" section in the conf file, and directions on how to use it in the manual. However, pool_hba.conf specifically says that PGPool doesn't support SSL (i.e. ...
4
votes
2answers
4k views

PgPool 2 with HA Proxy

So, I'm looking to add high availability to a postgresql server. I've looked into some tutorials on the web but, haven't been able to find exactly what I'm looking for. E.g.: PostgreSQL ...
3
votes
1answer
913 views

timeline 2 of the primary does not match recovery target timeline 1

I want to create a configuration with postgresql and pgpool to get height availability (HA). I want to do this: .-----. .--------. | | W | DB | | APP |---...
3
votes
4answers
4k views

pgpool replication not allowing md5 authentication

I have installed both pgpool and postgresql via apt. In pgpool.conf, I have made the changes necessary to use replication mode, as well as my two postgresql databases (currently all running on the ...
3
votes
1answer
760 views

Pgpool-II: sequences advanced by 1 after PITR recovery

I have tested pgpool-II 3.0.1 and pgpool 3.0.4, PostgreSQL 8.4 In both cases I'm getting the same result: after online recovery on primary and target nodes all 'serial' values got "+1". Other nodes ...
3
votes
0answers
625 views

Poor performance in my pgpool cluster

I've configured a postgres cluster with pgpool2 using the following link. The replication seems to be ok, but I ran some benchmarks (pg_bench) and the performance is lower than a single node, for ...
3
votes
1answer
2k views

Pgpool, Postgresql and Apache tuning (1000 concurrent spatial queries) [closed]

I'm trying to configure a load balancing system. I've a python script, invoked through mod_wsgi on Apache, that generates a query and executes it on pgpool: request-> wsgi python -> pgpool -> ...
2
votes
1answer
2k views

How to configure pgpool for reasonable speed

I have a problem with pgpool II configured in master-slave mode with replication on slony. I have configured postgres databases on each server to run as fast as they can and this was verified by me ...
2
votes
1answer
260 views

What's the data flow between Pgpool, Postgresql and client

I'm new in Pgpool. I want to ask the question, what is the dataflow between Pgpool, Postgresql when client querying data 1/ Client query data to Pgpool, PgPool ask Postgresql Postgresql ...
2
votes
1answer
195 views

How not to distribute reads in pgpool

I want to use pgpool to replicate one database to another. I want to do my processing on my master database (reads/writes/inserts/deletes), replicate that database to another database as it is ...
2
votes
1answer
375 views

PGPool Frequent Queries

We recently setup a PostgreSQL Cluster with PGPool in front of it. This is our first go at such a thing. We setup our QA environment to use the new PGPool, and we cranked up the logging on the ...
2
votes
1answer
364 views

pgpool connect failed: No such file /tmp.s.PGSQL.0 replication mode = true

Setup: I have two instances of Postgres 9.0.3 and pg_pool 3.14 all running on the same Ibuntu (10.04) machine and am attempting to evaluate pgpool. I can attach to pgpool using psql -p <pgpool ...
2
votes
1answer
1k views

Does the pgpool-II extension allow for parallel execution of any query?

I read about pgpool-II here and it states that: Using the parallel query function, data can be divided among the multiple servers, so that a query can be executed on all the servers concurrently ...
2
votes
1answer
1k views

Pgpool II : unable to read message length between two network interfaces

Start log file: 2015-03-06 01:57:56: pid 2760: LOG: Setting up socket for 0.0.0.0:9999 2015-03-06 01:57:56: pid 2760: LOG: Setting up socket for :::9999 2015-03-06 01:57:56: pid 2760: LOG: pgpool-...
2
votes
1answer
62 views

Understanding pg-pool in details

I have following problem regarding the pg-pool (3.3.3) When master fails, automatic failover happens and standby is promoted to master. But this new master don't have any replicators. Other slave ...
1
vote
1answer
5k views

Pgpool install - libpq is not installed or libpq is old

Based on the documentation here, I want to create a pgpool II with PostgreSQL databases. When I try to install, I encounter this error: configure: error: libpq is not installed or libpq is old ...
1
vote
1answer
1k views

pgpool2 setup on master-slave replication using postgreql 9.1

I have already setup 2 ubuntu server 12.04 LTS on my local machine using virtual box and is using the master-slave replication (postgresql 9.1). 192.168.0.109 = master 192.168.0.110 = slave my ...
1
vote
1answer
193 views

Pgpool - semanage config files - which filetype should I choose?

Reffering to problem with pgpool installation : Problem with pgpoolAdmin installation I had a problem with non running pgpooladmin(installation files permission was wrong). I must change file label of ...
1
vote
0answers
22 views

Pgpool slave node limit

I've started a new database architecture using pgpool-II 3.4.5, I have 3 servers by now, 1 master and 2 slaves. They are configured to use Master/Slave conf and LoadBalancing. The problem is: When I ...
1
vote
0answers
115 views

Connecting Tableau and PgPool

I'm trying to connect Tableau to our database Postgresql via PgPool, for load Balance. I have Postgresql configured with Streaming Replication between one master and two slaves. And have another ...
1
vote
0answers
118 views

Master/Slave - streaming replication restrict function to master

How can I run a function a on master only? I don't want to connect directly to my master server, because the master server might change. Or can I change my function to work on this setup? Because ...
1
vote
0answers
154 views

Pgpool load-balancing vs. consistency

In what ways is consistency weakened when using pgpool-II load-balancing on Postgresql servers running streaming replication? Obviously with asynchronous replication you can insert a row on the ...
1
vote
1answer
827 views

pgpool-II doesn't execute my failover script

I have been installed pgpool-II 3.3.4 from source. I have two pgpool nodes and I also used the watchdog configuration to get a pgpool services with High Availability. When I stop one, the other wake ...
1
vote
0answers
161 views

how to get pgpool2 HA

I am using pgpool2 and PostgreSQL to get a HA of postgresql service. I have been working in this: .-----. .--------. | | W | DB | | PGP |-----+-----------...
1
vote
0answers
43 views

Does pg-pool-II support two phase commit?

When pg-pool II is used with sharding, what happens if I want to do a transaction which involves two nodes ? Does pgpool support two phase commit ?
1
vote
0answers
732 views

Pgpooladmin pcp commands does not work [closed]

After first installation of pgpoolAdmin I got an error e1002 with message "pcp_node_count command error occurred" Does anybody know why is this happen and how to fix this? Little update: just ...
1
vote
1answer
1k views

Problem with pgpoolAdmin installation

I got a problem with permissions during installation of pgpoolAdmin(newest version). The problem is when I get to window with main config that should be all okay to move to next installtion step. The ...
1
vote
0answers
359 views

pgpool stability issues

I am using pgpool-II 3.3.1 to load balance connections to my postgres 9.3. I am experiencing an ocassional stability issue where clients are not able to connect to pgpool (but they are able to connect ...
1
vote
1answer
1k views

pgpool-II configuring multiple master databases

I could not find a solution for this anywhere, not even in the pgpool manuals. How do I configure multiple - master postgresql databases with pgpool-II? Additional requirement is that each master ...
1
vote
0answers
1k views

PgPool is pushing Postgres to 100% cpu usage

I think I've followed the configuration for pgpool correctly, but he's pushing my postgres machines to 100% cpu usage unnecessarily. I have one pgpool machine that works just fine, no overload at all, ...
1
vote
0answers
342 views

Postgresql Streaming Replication - pgpool2 - failover

In my scenario I want pgpool to forward read only queries to slaves when the master goes down - I want my app to be in the "read only mode". How do I setup pgpool to accept read only queries when ...
0
votes
1answer
283 views

PostgreSQL synchronous replication time out?

I'm using PostgreSQL 9.3 with synchronous replication. I have 2 synchronous replicators and 1 async replicator. My problem is when 2 synchronous replicators are down, transaction will wait ...
0
votes
1answer
2k views

Postgres pgpool increase num_init_children

I am trying to tune postgre to allow many concurrent queries from clients as i am checking how many parallel connections with there queries it can handle. I read A good PgPool II configurataion , ...
0
votes
2answers
1k views

pgpool load balancing is sending all queries only to master

My two postgresql servers are configured for streaming replication, which is working fine. Pgpool is configured for Master Slave mode / Load Balance Mode. pgpool.conf: listen_addresses = '*' port = ...
0
votes
1answer
579 views

PGpool Promote to master and Slaves wont replicate on failure

Sorry for the copy paste from stackoverflow, but this is probably a better place to post this. Version pgpool-II-pg93-3.4.0-3pgdg.rhel6.x86_64.rpm I’ve seen some chat online about this from a ...
0
votes
1answer
192 views

Connect Jira to Postgresql with Pgpool-II

I gotta problem with connecting Jira 6 to Pgpool-II which is responsible for load balancing and replication in Postgresql bases(2 instances). Pgpool is started on port 9999, I just want to connect ...
0
votes
0answers
15 views

Pgpool2 connection pooling

I have installed both PGPOOL2 3.3 and Postgresql 9.3 db(master) on the same server and in the pgpool.conf file have given the connection parameters as: num_init_children = 100 max_pool = 2 Therefore ...
0
votes
0answers
57 views

Pgpool not load balancing

I am configuring Pgpool to load balance select queries among a master, and two slaves. However, all queries are still going to the master server, and none to the slaves. I have set load_balance_mode, ...
0
votes
0answers
38 views

pgpool: buffer overflow detected

My pgpool(use docker create) met this buffer overflow detected : And It generate many core file in server which is very big (about 6MB) Why would this happened? I try google it ,but there is seldom ...
0
votes
0answers
46 views

PostgreSQL (Sync Replication) and Pgpool Load Balancing

I am trying to configure pgpool as load balancer for synchronized replicated PostgreSQL servers. I configured PostgreSQL servers and they are running normally. But I want to send write queries to ...
0
votes
1answer
48 views

Pooler (pgbouncer) + MasterDB + Slaves

During a spike, my connections go from 30 to over 140, as you can see below: I'm willing to set-up a pooler like pgbouncer, but have some questions as my scenario is not that easy: 1 Load ...
0
votes
0answers
38 views

Pooling at the app layer or in an intermediate layer?

I need to use a connection pool with PostgreSQL. I do not need load balancing or replication, just pooling. What would be the best option? Pooling at the app layer (using a JDBC connection pool) or ...
0
votes
0answers
59 views

PGPool for Postgres load balancing, where to sit it

So I've been doing a stack of reading. I'm still not 100% clear of the best way to go about it. Let's take a simple setup. 3 nodes to server UWSGI apps (in random), 3 nodes for PGSQL, 1 nominal ...
0
votes
0answers
109 views

Which pgpool “mode” for high availability & failover on Postgresql 9.3

I'm in the process of designing a HA setup for a web API & application that uses Postgresql 9.3. To satisfy availability & resiliency, we require: failover to a secondary database instance ...
0
votes
0answers
85 views

PgPool with many database servers, many connections

I'm using python to generate a bunch of static output files. These files are written using a script that executes several queries against a postgresql database. I'd like to have many processes running ...
0
votes
0answers
376 views

pgpoolAdmin for pgpool-II 3.4 : superuser: unknown (Connection error)

I cannot start/stop/reload my nodes through pgpoolAdmin and it says "superuser: unknown" even though I'm logged with the postgres account. What could be the cause? pgpool.conf is identical to another ...