On Monday 27 August 2007 16:14, Andrew Sullivan wrote:
> On Mon, Aug 27, 2007 at 04:00:50PM -0500, Dan Falconer wrote:
> > I'm really unclear as to what you mean by "snapshot size".  I've updated
> > the maximum SYNC group size from 6 to 25, and (some time ago, apparentl=
y)
> > the sync
>
> That's what I meant, yes.  Sorry for speaking imprecisely.
>
> > In fact, the most distressing part out of all of this, which could be d=
ue
> > to some lack of information, is that the master thinks it's out of date
> > with itself:::
>
> Hrm.  Are you sure SYNC messages are getting through everywhere?
> There is some point (5 days may well be approaching it) where you
> need to rebuild everything.
>
> At the very least, I would stop everything and VACUUM ANALYSE the
> slony tables, first, though.  My guess is that you're now hitting
> badly messed up log tables, and you're in the dead tuple death
> spiral.

Lol.  I think "dead tuple death spiral" may indeed be the problem, though I =

have no idea what causes it.  Going with the suggestions of David Rees, I =

stopped slons & ran some vacuums: on each server, I vacuumed every time I =

found within the "_pl_replication" schema.  At most, the vacuums took 30 =

seconds to run, and I saw nothing terrible in regards to the number of rows =

removed, rows that couldn't be removed, etc.

I believe that SYNCs are getting through, but some insight into the log fil=
es =

to clarify would be great.  I've attached log files for roughly the same =

period of time for both the master & slave.  Also, when I restarted the =

slons, I get notices printed to the console (instead of a log file) =

indicating that the switch from log_1 to log_2 failed... help?

>
> A

-- =

Best Regards,


Dan Falconer
"Head Geek", Avsupport, Inc. / Partslogistics.com
http://www.partslogistics.com
-------------- next part --------------
2007-08-27 16:23:14 CDT DEBUG2 localListenThread: Received event 2,159160 S=
YNC
2007-08-27 16:23:15 CDT DEBUG2 remoteListenThread_1: queue event 1,85580 SY=
NC
2007-08-27 16:23:15 CDT DEBUG2 remoteListenThread_1: UNLISTEN
2007-08-27 16:23:15 CDT DEBUG2 remoteWorkerThread_1: Received event 1,85580=
 SYNC
2007-08-27 16:23:15 CDT DEBUG2 remoteWorkerThread_1: SYNC 85580 processing
2007-08-27 16:23:15 CDT DEBUG2 remoteWorkerThread_1: no sets need syncing f=
or this event
2007-08-27 16:23:16 CDT DEBUG2 syncThread: new sl_action_seq 28123401 - SYN=
C 159161
2007-08-27 16:23:19 CDT DEBUG2 localListenThread: Received event 2,159161 S=
YNC
2007-08-27 16:23:20 CDT DEBUG2 remoteListenThread_1: LISTEN
2007-08-27 16:23:22 CDT DEBUG2 syncThread: new sl_action_seq 28123496 - SYN=
C 159162
2007-08-27 16:23:24 CDT DEBUG2 localListenThread: Received event 2,159162 S=
YNC
2007-08-27 16:23:25 CDT DEBUG2 remoteListenThread_1: queue event 1,85581 SY=
NC
2007-08-27 16:23:25 CDT DEBUG2 remoteListenThread_1: UNLISTEN
2007-08-27 16:23:25 CDT DEBUG2 remoteWorkerThread_1: Received event 1,85581=
 SYNC
2007-08-27 16:23:25 CDT DEBUG2 remoteWorkerThread_1: SYNC 85581 processing
2007-08-27 16:23:25 CDT DEBUG2 remoteWorkerThread_1: no sets need syncing f=
or this event
2007-08-27 16:23:27 CDT DEBUG2 syncThread: new sl_action_seq 28123538 - SYN=
C 159163
2007-08-27 16:23:29 CDT DEBUG2 localListenThread: Received event 2,159163 S=
YNC
2007-08-27 16:23:30 CDT DEBUG2 remoteListenThread_1: LISTEN
2007-08-27 16:23:32 CDT DEBUG2 syncThread: new sl_action_seq 28123561 - SYN=
C 159164
2007-08-27 16:23:34 CDT DEBUG2 localListenThread: Received event 2,159164 S=
YNC
2007-08-27 16:23:35 CDT DEBUG2 remoteListenThread_1: queue event 1,85582 SY=
NC
2007-08-27 16:23:35 CDT DEBUG2 remoteListenThread_1: UNLISTEN
2007-08-27 16:23:35 CDT DEBUG2 remoteWorkerThread_1: Received event 1,85582=
 SYNC
2007-08-27 16:23:35 CDT DEBUG2 remoteWorkerThread_1: SYNC 85582 processing
2007-08-27 16:23:35 CDT DEBUG2 remoteWorkerThread_1: no sets need syncing f=
or this event
2007-08-27 16:23:37 CDT DEBUG2 syncThread: new sl_action_seq 28123604 - SYN=
C 159165
2007-08-27 16:23:39 CDT DEBUG2 localListenThread: Received event 2,159165 S=
YNC
2007-08-27 16:23:40 CDT DEBUG2 remoteListenThread_1: LISTEN
2007-08-27 16:23:42 CDT DEBUG2 syncThread: new sl_action_seq 28123643 - SYN=
C 159166
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_1: forward confirm 2,7339=
8 received by 1
2007-08-27 16:23:44 CDT DEBUG2 localListenThread: Received event 2,159166 S=
YNC
2007-08-27 16:23:45 CDT DEBUG2 remoteListenThread_1: queue event 1,85583 SY=
NC
2007-08-27 16:23:45 CDT DEBUG2 remoteListenThread_1: UNLISTEN
2007-08-27 16:23:45 CDT DEBUG2 remoteWorkerThread_1: Received event 1,85583=
 SYNC
2007-08-27 16:23:45 CDT DEBUG2 remoteWorkerThread_1: SYNC 85583 processing
2007-08-27 16:23:45 CDT DEBUG2 remoteWorkerThread_1: no sets need syncing f=
or this event
2007-08-27 16:23:47 CDT DEBUG2 syncThread: new sl_action_seq 28123715 - SYN=
C 159167
2007-08-27 16:23:49 CDT DEBUG2 localListenThread: Received event 2,159167 S=
YNC
2007-08-27 16:23:50 CDT DEBUG2 remoteListenThread_1: LISTEN
2007-08-27 16:23:52 CDT DEBUG2 syncThread: new sl_action_seq 28123784 - SYN=
C 159168
2007-08-27 16:23:54 CDT DEBUG2 localListenThread: Received event 2,159168 S=
YNC
2007-08-27 16:23:55 CDT DEBUG2 remoteListenThread_1: queue event 1,85584 SY=
NC
2007-08-27 16:23:55 CDT DEBUG2 remoteListenThread_1: UNLISTEN
2007-08-27 16:23:55 CDT DEBUG2 remoteWorkerThread_1: Received event 1,85584=
 SYNC
2007-08-27 16:23:55 CDT DEBUG2 remoteWorkerThread_1: SYNC 85584 processing
2007-08-27 16:23:55 CDT DEBUG2 remoteWorkerThread_1: no sets need syncing f=
or this event
2007-08-27 16:23:57 CDT DEBUG2 syncThread: new sl_action_seq 28123824 - SYN=
C 159169
2007-08-27 16:23:59 CDT DEBUG2 localListenThread: Received event 2,159169 S=
YNC
2007-08-27 16:24:00 CDT DEBUG2 remoteListenThread_1: LISTEN
2007-08-27 16:24:02 CDT DEBUG2 syncThread: new sl_action_seq 28123870 - SYN=
C 159170
2007-08-27 16:24:04 CDT DEBUG2 localListenThread: Received event 2,159170 S=
YNC
2007-08-27 16:24:05 CDT DEBUG2 remoteListenThread_1: queue event 1,85585 SY=
NC
2007-08-27 16:24:05 CDT DEBUG2 remoteListenThread_1: UNLISTEN
2007-08-27 16:24:05 CDT DEBUG2 remoteWorkerThread_1: Received event 1,85585=
 SYNC
2007-08-27 16:24:05 CDT DEBUG2 remoteWorkerThread_1: SYNC 85585 processing
2007-08-27 16:24:05 CDT DEBUG2 remoteWorkerThread_1: no sets need syncing f=
or this event
-------------- next part --------------
2007-08-27 16:23:14 CDT DEBUG2 localListenThread: Received event 1,85579 SY=
NC
2007-08-27 16:23:15 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85580
2007-08-27 16:23:17 CDT DEBUG2 remoteListenThread_2: queue event 2,159161 S=
YNC
2007-08-27 16:23:19 CDT DEBUG2 localListenThread: Received event 1,85580 SY=
NC
2007-08-27 16:23:22 CDT DEBUG2 remoteListenThread_2: queue event 2,159162 S=
YNC
2007-08-27 16:23:25 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85581
2007-08-27 16:23:27 CDT DEBUG2 remoteListenThread_2: queue event 2,159163 S=
YNC
2007-08-27 16:23:32 CDT DEBUG2 remoteListenThread_2: queue event 2,159164 S=
YNC
2007-08-27 16:23:34 CDT DEBUG2 localListenThread: Received event 1,85581 SY=
NC
2007-08-27 16:23:35 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85582
2007-08-27 16:23:37 CDT DEBUG2 remoteListenThread_2: queue event 2,159165 S=
YNC
2007-08-27 16:23:39 CDT DEBUG2 localListenThread: Received event 1,85582 SY=
NC
2007-08-27 16:23:41 CDT DEBUG2 remoteHelperThread_2_2: 119.937 seconds dela=
y for first row
2007-08-27 16:23:41 CDT DEBUG2 remoteHelperThread_2_2: 119.939 seconds unti=
l close cursor
2007-08-27 16:23:41 CDT DEBUG2 remoteHelperThread_2_2: inserts=3D15 updates=
=3D8 deletes=3D0
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2: new sl_rowid_seq value=
: 2000000000000000
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2: SYNC 73398 done in 121=
.696 seconds
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2: Received event 2,73399=
 SYNC
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2: SYNC 73399 processing
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2: syncing set 1 with 129=
 table(s) from provider 2
2007-08-27 16:23:43 CDT DEBUG2  ssy_action_list length: 0
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2: current local log_stat=
us is 2
2007-08-27 16:23:43 CDT DEBUG2 remoteWorkerThread_2_2: current remote log_s=
tatus =3D 2
2007-08-27 16:23:43 CDT DEBUG2 remoteListenThread_2: queue event 2,159166 S=
YNC
2007-08-27 16:23:45 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85583
2007-08-27 16:23:48 CDT DEBUG2 remoteListenThread_2: queue event 2,159167 S=
YNC
2007-08-27 16:23:53 CDT DEBUG2 remoteListenThread_2: queue event 2,159168 S=
YNC
2007-08-27 16:23:54 CDT DEBUG2 localListenThread: Received event 1,85583 SY=
NC
2007-08-27 16:23:55 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85584
2007-08-27 16:23:59 CDT DEBUG2 remoteListenThread_2: queue event 2,159169 S=
YNC
2007-08-27 16:23:59 CDT DEBUG2 localListenThread: Received event 1,85584 SY=
NC
2007-08-27 16:24:04 CDT DEBUG2 remoteListenThread_2: queue event 2,159170 S=
YNC
2007-08-27 16:24:05 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85585
2007-08-27 16:24:09 CDT DEBUG2 remoteListenThread_2: queue event 2,159171 S=
YNC
2007-08-27 16:24:14 CDT DEBUG2 remoteListenThread_2: queue event 2,159172 S=
YNC
2007-08-27 16:24:14 CDT DEBUG2 localListenThread: Received event 1,85585 SY=
NC
2007-08-27 16:24:15 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85586
2007-08-27 16:24:19 CDT DEBUG2 remoteListenThread_2: queue event 2,159173 S=
YNC
2007-08-27 16:24:19 CDT DEBUG2 localListenThread: Received event 1,85586 SY=
NC
2007-08-27 16:24:24 CDT DEBUG2 remoteListenThread_2: queue event 2,159174 S=
YNC
2007-08-27 16:24:25 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85587
2007-08-27 16:24:29 CDT DEBUG2 remoteListenThread_2: queue event 2,159175 S=
YNC
2007-08-27 16:24:34 CDT DEBUG2 remoteListenThread_2: queue event 2,159176 S=
YNC
2007-08-27 16:24:34 CDT DEBUG2 localListenThread: Received event 1,85587 SY=
NC
2007-08-27 16:24:35 CDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 85588