[Bucardo-general] Sync through temporary table

[Jon Jensen]

On Wed, 20 Jan 2021, юрий нуждин wrote:

> Sometimes happens that connection between databases is worse than poor and
> there are big changes to sync, so the data transfer significant amount of
> time (half an hour for example).
> In that case tables can lock, and lock for half an hour is the thing I want
> to avoid.
> Is it possible to set up bucardo to fetch data into temporary tables first,
> and then move them into production tables? Or maybe you know other
> approaches to the slow connection problem?

Hi, Yury. Slow connections can be a pain. I am not aware of anything in 
Bucardo that deals directly with that.

A few things you can consider:

If your slow connection is normally at a regular time of the day, you 
could e.g. a cron job stop Bucardo during that period and restart it again 
when it's safe.

You could monitor the replication lag and forcibly restart Bucardo when it 
falls too far behind.

You could organize your tables and Bucardo syncs so that important data 
that shouldn't lock is in its own sync, as long as there wouldn't be a 
problem with some changes appearing separately from others (perhaps unlike 
a transaction that first committed the data).

Sorry I don't know of any easy answers to that. Maybe others have 
suggestions too.

Jon


-- 
Jon Jensen
End Point Corporation
https://www.endpoint.com/