[COMMITTERS] pgsql: Fix various concurrency issues in logical replication workerlau - Mailing list pgsql-committers

From Peter Eisentraut
Subject [COMMITTERS] pgsql: Fix various concurrency issues in logical replication workerlau
Date
Msg-id E1d3OIL-00078r-72@gemulon.postgresql.org
Whole thread Raw
List pgsql-committers
Fix various concurrency issues in logical replication worker launching

The code was originally written with assumption that launcher is the
only process starting the worker.  However that hasn't been true since
commit 7c4f52409 which failed to modify the worker management code
adequately.

This patch adds an in_use field to the LogicalRepWorker struct to
indicate whether the worker slot is being used and uses proper locking
everywhere this flag is set or read.

However if the parent process dies while the new worker is starting and
the new worker fails to attach to shared memory, this flag would never
get cleared.  We solve this rare corner case by adding a sort of garbage
collector for in_use slots.  This uses another field in the
LogicalRepWorker struct named launch_time that contains the time when
the worker was started.  If any request to start a new worker does not
find free slot, we'll check for workers that were supposed to start but
took too long to actually do so, and reuse their slot.

In passing also fix possible race conditions when stopping a worker that
hasn't finished starting yet.

Author: Petr Jelinek <petr.jelinek@2ndquadrant.com>
Reported-by: Fujii Masao <masao.fujii@gmail.com>

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/de4389712206d2686e09ad8d6dd112dc4b6c6d42

Modified Files
--------------
src/backend/replication/logical/launcher.c | 181 +++++++++++++++++++++++------
src/include/replication/worker_internal.h  |   9 ++
2 files changed, 155 insertions(+), 35 deletions(-)


pgsql-committers by date:

Previous
From: Peter Eisentraut
Date:
Subject: Re: [COMMITTERS] pgsql: Workaround for RecoverPreparedTransactions()
Next
From: Fujii Masao
Date:
Subject: [COMMITTERS] pgsql: Fix typo in comment.