[Bucardo-general] Source DB error when adding the sync
Andreas Wahler
andreas.wahler at wamtek.net
Sat Apr 17 11:48:45 UTC 2021
-hi Lucas,
I faced these locks during adding a new sync to bucardo, too. During
this step it helps a lot if no / less traffic is on the database.
Best,
Andreas
Am 17.04.2021 um 13:08 schrieb Lucas Possamai:
> Anyone able to help with my previous email, please?
>
> I've just tried the process again, and I got into the same outcome.
> The steps I followed are below:
>
> ---
>
> 1. Created bucardo username on source and target dbs
> 2. because I've done this before, I've done some cleanup before
> repeating the process
> 1. bucardo remove sync test_sync
> 2. bucardo remove dbgroup test_db_group
> 3. bucardo remove relgroup test_db_group
> 4. bucardo remove all tables
> 5. bucardo remove all sequences
> 6. bucardo remove db source_db_ec2
> 7. bucardo remove target_db_rds
> 8. AS POSTGRES
> 1. drop schema bucardo cascade;
> 3.
>
> bucardo add db source_db_ec2 dbname=test_db
> host=pgsql-source.example.com <http://pgsql-source.example.com>
> user=bucardouser pass=password
>
> 4.
>
> bucardo add db target_db_rds dbname=test_db
> host=pgsql-target-rds.example.com
> <http://pgsql-target-rds.example.com> user=bucardo pass=password
>
> 5.
>
> bucardo add table public.* db=source_db_ec2 relgroup=test_db_group
>
> 6.
>
> bucardo add table junk.* db=source_db_ec2 relgroup=test_db_group
>
> 7.
>
> bucardo add sequence public.* db=source_db_ec2 relgroup=test_db_group
>
> 8.
>
> bucardo add sequence junk.* db=source_db_ec2 relgroup=test_db_group
>
> 9.
>
> bucardo add dbgroup test_db_group source_db_ec2:source
> target_db_rds:target
>
>10.
>
> bucardo add sync test_sync relgroup=test_db_group
> dbs=test_db_group autokick=1
>
>11.
>
> bucardo validate test_sync
>
>12.
>
> bucardo start
>
> When checking the status of the sync
>
> Last good: Apr 17, 2021 10:43:25 (time to run: 1s)
>
> Rows deleted/inserted: 0 / 0
>
> Sync name: test_sync
>
> Current state: Good
>
> Source relgroup/database : test_db_group / source_db_ec2
>
> Tables in sync : 209
>
> Status : Active
>
> Check time : None
>
> Overdue time : 00:00:00
>
> Expired time : 00:00:00
>
> Stayalive/Kidsalive: Yes / Yes
>
> Rebuild index: No
>
> Autokick : Yes
>
> Onetimecopy: No
>
> Post-copy analyze: Yes
>
> Last error::
>
> ======================================================================
>
>
> ... everything looks normal
>
> Bucardo logs:
> (371540) [Sat Apr 17 10:42:26 2021] MCP Active syncs: 1
> (371540) [Sat Apr 17 10:42:26 2021] MCP Entering main loop
> (371542) [Sat Apr 17 10:42:26 2021] VAC New VAC daemon. PID=371542
> (371542) [Sat Apr 17 10:42:26 2021] VAC Connected to database
> "source_db_ec2" with backend PID of 81591
> (371540) [Sat Apr 17 10:42:26 2021] MCP Created VAC 371542
> (371544) [Sat Apr 17 10:42:26 2021] CTL New controller for sync
> "test_sync". Relgroup is "test_db_group", dbs is "test_db_group".
> PID=371544
> (371544) [Sat Apr 17 10:42:26 2021] CTL stayalive: 1 checksecs: 0
> kicked: 1
> (371544) [Sat Apr 17 10:42:26 2021] CTL kidsalive: 1 onetimecopy: 0
> lifetimesecs: 0 (NULL) maxkicks: 0
> (371544) [Sat Apr 17 10:42:26 2021] CTL Database "source_db_ec2"
> backend PID: 81592
> (371544) [Sat Apr 17 10:42:26 2021] CTL Database "target_db_rds"
> backend PID: 15208
> (371540) [Sat Apr 17 10:42:26 2021] MCP Created controller 371544 for
> sync "test_sync". Kick is 1
> (371546) [Sat Apr 17 10:42:27 2021] KID (test_sync) New kid, sync
> "test_sync" alive=1 Parent=371544 PID=371546 kicked=1
>
> Then, my DB servers stop processing queries from the application. I
> couldn't find anything on the PG logs.
>
> Can someone please tell me if the above steps are correct?
>
> Cheers
> ---
>
>
> ---
> Kind regards,
> *
> *
> *Lucas Possamai*
> lpossamai.me <http://lpossamai.me>
>
>
> On Tue, 13 Apr 2021 at 10:31, Lucas Possamai <drum.lucas at gmail.com
> <mailto:drum.lucas at gmail.com>> wrote:
>
> Hi all,
>
> When executing the command below, my source db collapsed. Looked
> like lots of locks and waits were happening.
>
> bucardo add sync test_sync relgroup=test_db_group
> dbs=test_db_group autokick=0
>
>
> The steps I'm doing are:
>
> * PG DUMP the database from source
> * Create roles and apply database permissions to target
> * Import the Database dump to the target DB (RDS)
> * Enable session_replication_role on Target
> * Bucardo add source DB
> * Bucardo add target DB
> * bucardo add tables
> o bucardo add table public.* db=source_db relgroup=test_db_group
> * bucardo add sequences
> o bucardo add sequence public.* db=source_db
> relgroup=test_db_group
> * bucardo add dbgroup
> o bucardo add dbgroup test_db_group source_db:source
> target_db:target
> * bucardo add sync
> o bucardo add sync test_sync relgroup=test_db_group
> dbs=test_db_group autokick=0
>
>
> Are those locks expected when adding the sync on the source db?
> Any other recommendations?
>
> Source DB is PostgreSQL 9.2
> Target DB is PostgreSQL 12.4
> Bucardo version is: 5.6.0
>
> Cheers,
> ---
> Kind regards,
> *
> *
> *Lucas Possamai*
> lpossamai.me <http://lpossamai.me>
>
>
> _______________________________________________
> Bucardo-general mailing list
> Bucardo-general at bucardo.org
> https://bucardo.or
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://bucardo.org/pipermail/bucardo-general/attachments/20210417/115ef9d3/attachment-0001.htm>
More information about the Bucardo-general
mailing list