Large analog_bridge.log


Komkit Listisard
 

Hello,

Bridging P25.  My analog_bridge.log got so big filling up 20GB in no time flat!!!

The analog_bridge.log filled up with:

I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: ^C

What did I do wrong?

73, Kit


Mike KB8JNM
 

Well,

The first thing I would try is...

systemctl restart analog_bridge

And if that does nothing look in your analog_bridge.ini for any fat finger entries and restart on corrections.

On 5/13/2021 9:40 PM, Komkit Listisard via groups.io wrote:
Hello,

Bridging P25.  My analog_bridge.log got so big filling up 20GB in no time flat!!!

The analog_bridge.log filled up with:

I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: ^C

What did I do wrong?

73, Kit


Komkit Listisard
 

Mike, thank you.  I will try it when we get back.  For now I stopped both of the AB instances, I will report back if I find anything.

73, Kit


Mike KB8JNM
 

Since you have 2 instances, you might look at ports as well. Make sure each instance is unique port numbers.

Both for your usrp interfaces and mmdvm instances.

Sorry I can't be anything specific. I don't know enough specifics to your issue.

Just some generic advice.

But you could tail the log file when you start/restart for some clues or look in the log.

tail /var/log/dvswitch/Analog_Bridge.log

On 5/13/2021 10:09 PM, Komkit Listisard via groups.io wrote:
Mike, thank you.  I will try it when we get back.  For now I stopped both of the AB instances, I will report back if I find anything.

73, Kit


Komkit Listisard
 

Mike, stepping out and will be back in a little while.  Basically I have an XLX up and here are the ports that are in use at the moment with all of the stuff that are running.

Struggling with adding P25, when it work it was intermittent.  My NXDN would acting.  Keying up from NXDN would do nothing.  However if I to key up from DMR or D* or YSF, NXDN would lit up and then I can talk on/from NXDN all day long, very strange.  I am sure there is/are conflict somewhere.

NXDN bridged directly to XLX (DMR), I was not going through BM.  P25 also the same way, not going through BM.  Might be some kind of conflict.  Un-bridged P25 for now until we get back and going at it some more.

73, Kit



oa4doa@...
 

I can confirm this issue and it only happens when using the P25 to DMR configuration, restarting one of the AB instances stops the problem momentarily but  when something happens in the DMR part of the bridge and it needs to reconnect to the master the logbook issue starts again, in my case the logbook filled all the remaining space in my SD card, it looks like once the logbook entry is generated it goes into a loop.

I was forgetting to say that the bridge works fine, the only issue is that logbook entry.

Regards,
Christian OA4DOA 


Mike KB8JNM
 

Sounds like a BUG issue for Steve and Mike.

Likely something not exiting after a log entry append.

On 5/14/2021 10:20 AM, oa4doa@... wrote:
I can confirm this issue and it only happens when using the P25 to DMR configuration, restarting one of the AB instances stops the problem momentarily but  when something happens in the DMR part of the bridge and it needs to reconnect to the master the logbook issue starts again, in my case the logbook filled all the remaining space in my SD card, it looks like once the logbook entry is generated it goes into a loop.

I was forgetting to say that the bridge works fine, the only issue is that logbook entry.

Regards,
Christian OA4DOA 


Steve N4IRS
 

Kit,
Can you show me the MMDVM_Bridge log from the same time frame?

Steve N4IRS

On 5/13/2021 9:40 PM, Komkit Listisard via groups.io wrote:
Hello,

Bridging P25.  My analog_bridge.log got so big filling up 20GB in no time flat!!!

The analog_bridge.log filled up with:

I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.605 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}
I: 2021-05-14 01:05:58.606 EVENT: ^C

What did I do wrong?

73, Kit


Komkit Listisard
 

Steve,

Here is the MB log, just happened few min ago as well. Been messing around a few hours now LOL

At first seem fine. Then after I restarted the MB service the AB log just grew in size within sec, not min.  I have to quickly stop MB service, the AB continuing to grow.  I have to stopped AB to stop the log from growing out of control.  Restart the whole process again,  MB first then AB1 and AB2 again log just getting out of control.  When this happens both AB1 and AB2 logs just kept on growing :(

73, Kit


Komkit Listisard
 

I could duplicate this every single time if I restarting MB service.

I: 2021-05-14 20:21:55.747 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}

From the time it happened to the time I stopped AB service it was not even 15 sec, both logs grew 44MB each AB1 and AB2.

I: 2021-05-14 20:22:08.944 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}



73, Kit


Steve N4IRS
 

For now, set your log level to 4

Sent by smoke signal (AT&T)


From: main@DVSwitch.groups.io <main@DVSwitch.groups.io> on behalf of Komkit Listisard via groups.io <w3kit@...>
Sent: Friday, May 14, 2021 4:02:20 PM
To: main@DVSwitch.groups.io <main@DVSwitch.groups.io>
Subject: Re: [DVSwitch] Large analog_bridge.log
 
Steve,

Here is the MB log, just happened few min ago as well. Been messing around a few hours now LOL

At first seem fine. Then after I restarted the MB service the AB log just grew in size within sec, not min.  I have to quickly stop MB service, the AB continuing to grow.  I have to stopped AB to stop the log from growing out of control.  Restart the whole process again,  MB first then AB1 and AB2 again log just getting out of control.  When this happens both AB1 and AB2 logs just kept on growing :(

73, Kit


Steve N4IRS
 

For now, set your AB logLevel to 4 and restart AB.

On 5/14/21 4:35 PM, Komkit Listisard via groups.io wrote:
I could duplicate this every single time if I restarting MB service.

I: 2021-05-14 20:21:55.747 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}

From the time it happened to the time I stopped AB service it was not even 15 sec, both logs grew 44MB each AB1 and AB2.

I: 2021-05-14 20:22:08.944 EVENT: {"topic":"dvswitch/MMDVM_Bridge/DMR","message":"login success"}



73, Kit


Komkit Listisard
 

Aye aye sir, will do.

73, Kit


Komkit Listisard
 

Steve,

Changed the level to 4, obviously AB logs does not gain any weight but I can see my CPU took a hit.

Since I changed the level few hours ago, my CPU never saw the floor, it hasn't come down since.







Steve N4IRS
 

Kit,
I do wnat to be clean, nothing we are doing is a fix. It's just a hack while we release an actual fix.
Not sure why that would happen since all we did was reduce what AB sent to the log. Let's try a different tact.
Put the logLevel back to 2 and edit the systemd unit file.
change:
Environment=AnalogBridgeLogDir=/var/log/dvswitch
to:
Environment=AnalogBridgeLogDir=/dev/null

restart the AB service.

Steve

On 5/14/21 8:34 PM, Komkit Listisard via groups.io wrote:
Steve,

Changed the level to 4, obviously AB logs does not gain any weight but I can see my CPU took a hit.

Since I changed the level few hours ago, my CPU never saw the floor, it hasn't come down since.








Steve N4IRS
 

What reflector are you using for P25? (IP and port)

On 5/14/21 8:34 PM, Komkit Listisard via groups.io wrote:
Steve,

Changed the level to 4, obviously AB logs does not gain any weight but I can see my CPU took a hit.

Since I changed the level few hours ago, my CPU never saw the floor, it hasn't come down since.








Komkit Listisard
 

Steve,

My P25 reflector is:   910  p25.freeddns.org   41000

It is an XLX on the cloud, currently P25 is still up and running but I blew up the bridge :D   So it is a standalone for the moment.

I will change the log level back to 2 and try what you suggest tomorrow.  About to go between the sheet, been a long day. Will go at it again tomorrow AM. 

Was this happened because I instead of going out to BM I went straight to XLX = option 4004?  I could try to go out to BM and come back, currently my NXDN bridged to XLX via BM though.

Thank you for you help.

73, Kit


Steve N4IRS
 

I believe this is a P25 issue. I'm going to "monitor" the reflector and see if I can catch the error. I'll keep you informed.

Steve

On 5/14/21 9:28 PM, Komkit Listisard via groups.io wrote:
Steve,

My P25 reflector is:   910  p25.freeddns.org   41000

It is an XLX on the cloud, currently P25 is still up and running but I blew up the bridge :D   So it is a standalone for the moment.

I will change the log level back to 2 and try what you suggest tomorrow.  About to go between the sheet, been a long day. Will go at it again tomorrow AM. 

Was this happened because I instead of going out to BM I went straight to XLX = option 4004?  I could try to go out to BM and come back, currently my NXDN bridged to XLX via BM though.

Thank you for you help.

73, Kit


David Young
 

Steve and All,

I have had this problem since the new DVSwitch server software was released and it does appear to be intermittent.  To keep this from occurring I turned off logging in the Analog_Bridge.ini files which stops these entries.
--
Dave WB6DTB


Steve N4IRS
 

What mode?

Sent by smoke signal (AT&T)


From: main@DVSwitch.groups.io <main@DVSwitch.groups.io> on behalf of David Young <dly2@...>
Sent: Saturday, May 15, 2021 2:41:59 AM
To: main@DVSwitch.groups.io <main@DVSwitch.groups.io>
Subject: Re: [DVSwitch] Large analog_bridge.log
 
Steve and All,

I have had this problem since the new DVSwitch server software was released and it does appear to be intermittent.  To keep this from occurring I turned off logging in the Analog_Bridge.ini files which stops these entries.
--
Dave WB6DTB