[Bucardo-general] Install Bucardo on Amazon RDS PostgreSQL
caleb ayodele
ulo23k at gmail.com
Mon Jan 15 20:15:43 UTC 2018
I tried something from this website:
http://saifulmuhajir.web.id/postgresql-amazon-rds-as-a-
master-how-to-replicate-from-aws/
which is to set quick_delta_check=1
after doing that, i started bucardo and it started with no errors but
replication was not working unless i do:
bucardo update sync <name> onetimecopy=1
and then start bucardo
but any DMLs after that will not work unless i restart bucardo
here is my bucardo DBs, relgroups and sync:
[cayodele at ip-1xx-x-x-xx bucardo-master]$ bucardo list dbs
Database: auth93 Status: active Conn: psql -p 5432 -U ticadmin -d auth -h
xx-xx.xxxxx.us-east-1.rds.amazonaws.com
Database: auth96 Status: active Conn: psql -p 5432 -U ticadmin -d auth -h
xx.xxxxx.us-east-1.rds.amazonaws.com
[cayodele at ip-1xx-x-x-xx bucardo-master]$ bucardo list relgroup
Relgroup: rel_auth93 DB: auth93 Members: public.actions,
public.actions_id_seq, public.activation_token,
public.activation_token_id_seq, public.customer_servers,
public.customer_servers_id_seq, public.permissions,
public.permissions_id_seq, public.resources, public.resources_id_seq,
public.role_permission, public.role_permission_id_seq, public.roles,
public.roles_id_seq, public.user_api_key, public.user_api_key_id_seq,
public.user_credentials, public.user_credentials_id_seq,
public.user_permission, public.user_permission_id_seq, public.user_role,
public.user_role_id_seq, public.users, public.users_id_seq
Used in syncs: auth_sync
[cayodele at ip-1xx-x-x-xx bucardo-master]$ bucardo list sync
Sync "auth_sync" Relgroup "rel_auth93" DB group "auth_sync" auth93:source
auth96:target [Active]
On Mon, Jan 15, 2018 at 3:06 PM, caleb ayodele <ulo23k at gmail.com> wrote:
> Bucardo Inernal log:
> --------------------------
>
> (17427) [Mon Jan 15 20:03:49 2018] KID (auth_sync) New kid, sync
> "auth_sync" alive=1 Parent=17424 PID=17427 kicked=1
> (17427) [Mon Jan 15 20:04:08 2018] KID (auth_sync) Kid has died, error is:
> DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is
> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text)
> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line
> 3407. Line: 5037 Main DB state: ? Error: none DB auth93 state: 22004 Error:
> 7 DB auth96 state: ? Error: none
> (17427) [Mon Jan 15 20:04:08 2018] KID (auth_sync) Kid 17427 exiting at
> cleanup_kid. Sync "auth_sync" public.activation_token_id_seq Reason:
> DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is
> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text)
> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line
> 3407. Line: 5037 Main DB state: ? Error: none DB auth93 state: 22004 Error:
> 7 DB auth96 state: ? Error: none
> (17419) [Mon Jan 15 20:04:09 2018] MCP Starting check_sync_health
>
>
> RDS log:
> --------------
> 2018-01-15 20:02:58 UTC::[unknown]@[unknown]:[28222]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:03:18 UTC::[unknown]@[unknown]:[28420]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:03:38 UTC::[unknown]@[unknown]:[28632]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:03:38 UTC::[unknown]@[unknown]:[28633]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:03:58 UTC::[unknown]@[unknown]:[28870]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:04:08 UTC:???(???):ticadmin at auth:[28870]:ERROR: query
> string argument of EXECUTE is null
> 2018-01-15 20:04:08 UTC:???(???):ticadmin at auth:[28870]:CONTEXT: PL/pgSQL
> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE
> statement
> 2018-01-15 20:04:08 UTC:???(???):ticadmin at auth:[28870]:STATEMENT: SELECT
> * FROM bucardo.bucardo_delta_check($1,$2)
> 2018-01-15 20:04:19 UTC::[unknown]@[unknown]:[29068]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:04:29 UTC:???(???):ticadmin at auth:[29068]:ERROR: query
> string argument of EXECUTE is null
> 2018-01-15 20:04:29 UTC:???(???):ticadmin at auth:[29068]:CONTEXT: PL/pgSQL
> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE
> statement
> 2018-01-15 20:04:29 UTC:???(???):ticadmin at auth:[29068]:STATEMENT: SELECT
> * FROM bucardo.bucardo_delta_check($1,$2)
> 2018-01-15 20:04:39 UTC::[unknown]@[unknown]:[29345]:WARNING:
> pg_getnameinfo_all() failed: Temporary failure in name resolution
> 2018-01-15 20:04:45 UTC::@:[3236]:LOG: checkpoint starting: time
> 2018-01-15 20:04:46 UTC::@:[3236]:LOG: checkpoint complete: wrote 4
> buffers (0.0%); 0 transaction log file(s) added, 0 removed, 1 recycled;
> write=0.305 s, sync=0.013 s, total=0.338 s; sync files=4, longest=0.013 s,
> average=0.003 s
> 2018-01-15 20:04:49 UTC:???(???):ticadmin at auth:[29345]:ERROR: query
> string argument of EXECUTE is null
> 2018-01-15 20:04:49 UTC:???(???):ticadmin at auth:[29345]:CONTEXT: PL/pgSQL
> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE
> statement
>
> On Mon, Jan 15, 2018 at 2:50 PM, David Christensen <david at endpoint.com>
> wrote:
>
>> So what were the first errors seen (both on RDS and Bucardo’s internal
>> logs)?
>>
>> Best,
>>
>> David
>>
>>
>> On Jan 15, 2018, at 1:29 PM, caleb ayodele <ulo23k at gmail.com> wrote:
>>
>> i also saw this is logs of the source RDS database instance:
>>
>> 2018-01-15 18:52:12 UTC:???(???):ticadmin at auth:[12826]:ERROR: query
>> string argument of EXECUTE is null
>> 2018-01-15 18:52:12 UTC:???(???):ticadmin at auth:[12826]:CONTEXT: PL/pgSQL
>> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE
>> statement
>> 2018-01-15 18:52:12 UTC:???(???):ticadmin at auth:[12826]:STATEMENT: SELECT
>> * FROM bucardo.bucardo_delta_check($1,$2)
>> 2018-01-15 18:52:23 UTC::[unknown]@[unknown]:[13046]:WARNING:
>> pg_getnameinfo_all() failed: Temporary failure in name resolution
>> 2018-01-15 18:52:33 UTC:???(???):ticadmin at auth:[13046]:ERROR: query
>> string argument of EXECUTE is null
>> 2018-01-15 18:52:33 UTC:???(???):ticadmin at auth:[13046]:CONTEXT: PL/pgSQL
>> function bucardo.bucardo_delta_check(text
>>
>> On Mon, Jan 15, 2018 at 12:17 PM, caleb ayodele <ulo23k at gmail.com> wrote:
>>
>>> i installed burcado on a separated EC2 instance with postgres9.6
>>>
>>> i created a bucardo database in the postgres instance
>>>
>>> the bucardo install created a bucardo user and created several tables
>>>
>>> i dumped the source database into the target
>>>
>>> i created the source/target database with bucardo and also create a herd
>>>
>>> i added all the tables and sequences to the herd
>>>
>>> i created a sync and started bucardo
>>>
>>>
>>> This is what i saw in the logs:
>>>
>>> 24176) [Sun Jan 14 21:37:38 2018] KID (auth_migrate) Kid has died, error
>>> is: DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is
>>> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text)
>>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line
>>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error:
>>> 7 DB auth96 state: ? Error: none
>>> (24176) [Sun Jan 14 21:37:38 2018] KID (auth_migrate) Kid 24176 exiting
>>> at cleanup_kid. Sync "auth_migrate" public.activation_token_id_seq Reason:
>>> DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is
>>> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text)
>>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line
>>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error:
>>> 7 DB auth96 state: ? Error: none
>>> (24150) [Sun Jan 14 21:37:38 2018] MCP Starting check_sync_health
>>> (24179) [Sun Jan 14 21:37:49 2018] KID (auth_migrate) New kid, sync
>>> "auth_migrate" alive=1 Parent=24154 PID=24179 kicked=1
>>> (24179) [Sun Jan 14 21:37:50 2018] KID (auth_migrate) Kid has died,
>>> error is: DBD::Pg::st execute failed: ERROR: query string argument of
>>> EXECUTE is null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text)
>>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line
>>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error:
>>> 7 DB auth96 state: ? Error: none
>>> (24179) [Sun Jan 14 21:37:50 2018] KID (auth_migrate) Kid 24179 exiting
>>> at cleanup_kid. Sync "auth_migrate" public.activation_token_id_seq Reason:
>>> DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is
>>> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text)
>>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line
>>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error:
>>> 7 DB auth96 state: ? Error: none
>>>
>>>
>>> I think it might have something to do with a fucntion called
>>> *bucardo_delta_check(text,text)* but i looked for the function in the
>>> database and couldn't find it.
>>>
>>> On Mon, Jan 15, 2018 at 11:32 AM, caleb ayodele <ulo23k at gmail.com>
>>> wrote:
>>>
>>>> Hi David,
>>>>
>>>>
>>>> I followed the instructions from the below websites.
>>>>
>>>> http://saifulmuhajir.web.id/postgresql-amazon-rds-as-a-maste
>>>> r-how-to-replicate-from-aws/
>>>>
>>>> https://www.endpoint.com/blog/2017/06/06/amazon-aws-upgrades
>>>> -to-postgres-with
>>>>
>>>> https://bucardo.org/Bucardo/Installation/
>>>>
>>>> On Mon, Jan 15, 2018 at 11:14 AM, David Christensen <david at endpoint.com
>>>> > wrote:
>>>>
>>>>> Hi Caleb,
>>>>>
>>>>> Can you provide the steps you used to setup/install?
>>>>>
>>>>> Best,
>>>>>
>>>>> David
>>>>>
>>>>>
>>>>> On Jan 14, 2018, at 2:28 PM, caleb ayodele <ulo23k at gmail.com> wrote:
>>>>>
>>>>> Thanks for the quick response. i was able to use your documentation on
>>>>> the installation and was able to start bucardo but i ran into some issues.
>>>>>
>>>>> *issue #1*
>>>>>
>>>>> i got this error:
>>>>> *Last error: : Failed : DBD::Pg::st execute failed:
>>>>> ERROR: query string argument of EXECUTE is null CONTEXT: PL/pgSQL
>>>>> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE
>>>>> statement at /usr/local/share/perl5/Bucardo.pm line 3400. Line: 5041 Main
>>>>> DB state: ? Error: none DB auth93 state: 22004 Error: 7 DB auth96 state: ?
>>>>> Error: none (KID 23032)*
>>>>>
>>>>> *issue #2*
>>>>>
>>>>> Bucardo is not replicating to the target
>>>>>
>>>>> On Sat, Jan 13, 2018 at 7:37 PM, Saiful Muhajir <
>>>>> saifulmuhajir at gmail.com> wrote:
>>>>>
>>>>>> The steps is quite straightforward as documented. The only difference
>>>>>> is that you need a standalone bucardo server where you would install
>>>>>> Postgres with ability to install bucardo, such as EC2 instances.
>>>>>>
>>>>>> Once bucardo server is ready, add the source and target RDS servers
>>>>>> and continue from there as the documents said.
>>>>>>
>>>>>> To summarized:
>>>>>> - prepare an EC2 instances to install bucardo
>>>>>> - add both source and target in bucardo server
>>>>>> - add tables, relgroups, syncs, and start
>>>>>>
>>>>>>
>>>>>> On 13 Jan 2018 7:00 pm, <bucardo-general-request at bucardo.org> wrote:
>>>>>>
>>>>>> Send Bucardo-general mailing list submissions to
>>>>>> bucardo-general at bucardo.org
>>>>>>
>>>>>> To subscribe or unsubscribe via the World Wide Web, visit
>>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general
>>>>>> or, via email, send a message with subject or body 'help' to
>>>>>> bucardo-general-request at bucardo.org
>>>>>>
>>>>>> You can reach the person managing the list at
>>>>>> bucardo-general-owner at bucardo.org
>>>>>>
>>>>>> When replying, please edit your Subject line so it is more specific
>>>>>> than "Re: Contents of Bucardo-general digest..."
>>>>>>
>>>>>>
>>>>>> Today's Topics:
>>>>>>
>>>>>> 1. Install Bucardo on Amazon RDS PostgreSQL (caleb ayodele)
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------
>>>>>> ----------
>>>>>>
>>>>>> Message: 1
>>>>>> Date: Sat, 13 Jan 2018 01:01:54 -0500
>>>>>> From: caleb ayodele <ulo23k at gmail.com>
>>>>>> To: bucardo-general at bucardo.org
>>>>>> Subject: [Bucardo-general] Install Bucardo on Amazon RDS PostgreSQL
>>>>>> Message-ID: <53D7880E-6415-4CE3-B6E0-88BDDCA5EC47 at gmail.com>
>>>>>> Content-Type: text/plain; charset=utf-8
>>>>>>
>>>>>> I want to do a migration from RDS Postgres 9.3 to 9.6 with little
>>>>>> down time and I was wondering if it is possible for Bucardo to work on RDS
>>>>>> Postgres. If so, please let me know how to install it because I can?t seem
>>>>>> to get around the plperlu extension part.
>>>>>>
>>>>>> ------------------------------
>>>>>>
>>>>>> _______________________________________________
>>>>>> Bucardo-general mailing list
>>>>>> Bucardo-general at bucardo.org
>>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general
>>>>>>
>>>>>>
>>>>>> End of Bucardo-general Digest, Vol 120, Issue 3
>>>>>> ***********************************************
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Bucardo-general mailing list
>>>>>> Bucardo-general at bucardo.org
>>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general
>>>>>>
>>>>>>
>>>>> _______________________________________________
>>>>> Bucardo-general mailing list
>>>>> Bucardo-general at bucardo.org
>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general
>>>>>
>>>>>
>>>>> --
>>>>> David Christensen
>>>>> End Point Corporation
>>>>> david at endpoint.com
>>>>> 785-727-1171 <(785)%20727-1171>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>> --
>> David Christensen
>> End Point Corporation
>> david at endpoint.com
>> 785-727-1171 <(785)%20727-1171>
>>
>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mail.endcrypt.com/pipermail/bucardo-general/attachments/20180115/023e5038/attachment-0001.html>
More information about the Bucardo-general
mailing list