Satellite Internet forum
https://www.satsig.net/cgi-bin/yabb/YaBB.pl
VSAT technology and installation >> iDirect Forum: hubs and terminals >> remote out of network
https://www.satsig.net/cgi-bin/yabb/YaBB.pl?num=1233220018

Message started by id08 on Jan 29th, 2009 at 9:06am

Title: remote out of network
Post by id08 on Jan 29th, 2009 at 9:06am
Hi all,

i have iDirect version 6.0.9,
currently i'm facing a problem with one of our remote, it's always down (out of the network) for about 2 minutes and this happened every about 30 minutes, there's no scpc error detected

pls help

Title: Re: remote out of network
Post by TDMAMike on Jan 29th, 2009 at 12:13pm
Fact finding.  We will need more info, if possible.

1. When you say it goes down, how is this observed? iMonitor?  

2. Do you have visibility of that remotes SATCOM statistics when it goes down?  

3. What are downstream and upstream SNRs looking like at the time of outage? Does it abruptly fall out of the network or do the satcom statistics report a slow deterioration of the link?  

4. Does this happen in an sort of pattern or is it random?

5. Are there other remotes in that network?  Any visual indications reported in Imonitor on the remaining nodes (at the time you observe outage on the other).

Sounds to me like your problem is isolated to the node itself.  Possibly an IDU problem or failing remote RFT equipment/components.  

Title: Re: remote out of network
Post by id08 on Jan 30th, 2009 at 11:53am
the event like this:
Warning      UCP_LOST_CONTACT 5255041
Info      UCP!: SO(  +8), FO( -5148), PO( +0.0)
Error      UCP_OUT_OF_NETWORK 5255041
Info      ACQ_TX remote_id =5255041 cmd =SWEEP: fo= -2908, fr = 14999, fi = 727

about 3 or 4 minutes later it recovered, link up and this happened again after about 30 minutes. we found tdm lost increasing after remote back to up, this only happened to this site, other remotes is working normal

thanks for the help


Title: Re: remote out of network
Post by TDMAMike on Jan 30th, 2009 at 12:06pm
1. 3100 Series remote?

2. What is the physical location of the remote?  Indoor, or outdoor? (read: where is the IDU/ODU located?)

Due to your statement that other remotes are not reporting a problem, your issue is obviously isolated to this single node.  Reported TDM Loss could be a couple things, but my initial guess is that your LNB is starting to fail you.  That, or you have a problem somewhere in your receive (RF to IF) chain.  

However, I am curious of what type of remote it is (3100 with non ovenized oscillator?).  Which is why I asked about the remotes operating environment (temps).  3100s can become unstable with radical temp swings.  Especially when located outdoors.


Mike


Title: Re: remote out of network
Post by id08 on Jan 31st, 2009 at 2:25am
5100 series, this is a branch office and the modem is located indoor,

Time      Date      Down C/N [dB]
1:32:16      1/31/2009      8.11
1:32:31      1/31/2009      8.21
1:32:46      1/31/2009      8.02
1:36:46      1/31/2009      8.26
1:37:31      1/31/2009      8.02
1:37:46      1/31/2009      8.21
1:38:16      1/31/2009      8.21

Temp [°C]      TDM Lost
53.5      49
53.61      49
53.5      49
53.5      50
53.61      50
53.86      50
53.36      50

we had plan to send technician to visit the remote

thanks and regards,

Title: Re: remote out of network
Post by id08 on Jan 31st, 2009 at 12:50pm
Hi mike,

on satcom graph,
i found that tx power drop slowly (4 to 7 minutes or more) to the initial power level and in the same time tdm lost detected and up c/n drop to 6 dB in about 1 minutes or less. after that power level increase again till up c/n on 8 dB average. but then it happened again periodically.

is this came from rx ?

thks & regards,

Title: Re: remote out of network
Post by TDMAMike on Jan 31st, 2009 at 2:03pm
What you described with the tx power levels increasing and upstream SNR decreasing could be a couple of things.


My gut is telling me your system is poorly peaked on the spacecraft.  Poor peaking also points to why your C/N is where it is at (lingering at 8dB).  Being poorly pointed, will also cause your modem to work harder to close the link.  As the craft moves in its station box your bursts are arriving at various C/N at the hub line card.  That hub line card has a UCP (normally set to 9dB in most networks) that EVERY remote must meet.  Your remote is having difficulty achieving that 9dB (possibly due to poor peaking) and the NMS is PUSHING UP power (thru power offsets) in an effort to achieve the 9dB UPC network configuration.  When you cannot meet the UCP (Uplink CONTROL parameter), read: you are falling short of it (like you are) the NMS will give you power offsets (up to your 1dB comp point) to increase your power (in an effort to nominalize you).  

The same concept/process applies if your burst arrival were arriving too HIGH.  The NMS would back you down to meet the 9dB setting. Apologize for the dissertation, but just wanted to give you some background.

If the above is in fact happening, your remote is pushing up power until it either 1) reaches the max power setting that the hub set for you - read: your 1DB compression point and cannot increase anymore.  Or 2) You are saturating well before and your remote CANNOT push up power enough and your bursts continue to fall short on the UCP due to satruatiuon/spectral regrowth and the remotes carrier becomes unusable.

If the above is truly the case,  weather and cloud cover (at the hub and the remote operating location) will be a compounding factor.  Weather naturally attentuates the link.

I dont want to get wrapped around possible saturation or your inability to meet the UCP, you very well could have an issue with the rx or tx side of that system.  I would start with a good peak/pol/isolation check and see if it resolves your situation. Get a good 1DB compression check while you are at it.  

If possible can you provide me with the following information (like you did above):

* need you to copy/paste this info from just before the outage, thru the outage, and after the remote recovers.

1. Downstream C/N
2. Upstream C/N
3. Modem transmit power (actual)
4. Remote Rx power

In addition to the above I would like to solicit your intial tx power level (set by the hub) as well as your 1dB compression point (also set by the hub).  1-4 can be found in the UCP and the REMOTE STATUS tabs of iMonitor.  The intial and max power setting canb be obtained from the "General tab" on the control panel for the remote.

Also, if you are a Hub operator, can you porvide the RX POWER of the line cards at the observed time of outage.  You can query that info by right clicking on the line cards (that the remote is using) and select "Line card stats" and provide me the rx power for each line card.

Thanks, and good luck with it.

M

Title: Re: remote out of network
Post by id08 on Jan 31st, 2009 at 2:56pm
our working up c/n (ver 6 )is between 7 to 9 dB (green area) tx power initial is -5

Time      Date      Up C/N [dB]      Power Adjustment [dBm]
14:03:09      1/31/2009      8.51      0
14:03:24      1/31/2009      8.28      0
14:07:09      1/31/2009      8.23      0
14:07:39      1/31/2009      6.6      0.4
14:07:54      1/31/2009      6.68      0.4
14:08:09      1/31/2009      6.53      0.4
14:08:39      1/31/2009      6.65      0.4
14:08:54      1/31/2009      7.26      0
14:09:09      1/31/2009      7.52      0
14:09:24      1/31/2009      7.52      0
14:09:39      1/31/2009      7.74      0
14:09:54      1/31/2009      7.88      0
14:10:09      1/31/2009      8.05      0
14:10:24      1/31/2009      8.05      0


Time      Date      Down C/N [dB]      Tx Pwr [dBm]
14:03:09      1/31/2009      8.31      -3.4
14:03:24      1/31/2009      8.3      -3.4
14:07:09      1/31/2009      8.02      -5
14:07:39      1/31/2009      7.92      -4.59
14:07:54      1/31/2009      8.1      -4.19
14:08:09      1/31/2009      7.9      -3.79
14:08:39      1/31/2009      8.07      -3.4
14:08:54      1/31/2009      7.86      -3.4
14:09:09      1/31/2009      8.1      -3.4
14:09:24      1/31/2009      7.98      -3.4
14:09:39      1/31/2009      8.23      -3.4
14:09:54      1/31/2009      8.01      -3.4
14:10:09      1/31/2009      7.92      -3.4
14:10:24      1/31/2009      8.21      -3.4

Rx Pwr [dBm]      Temp [°C]      TDM Lost
-24.06      45.61      1
-24.06      46.75      1
-24.18      47.25      2
-24.06      47.36      2
-24.06      47.61      2
-24.18      47.11      2
-24.06      47.11      2
-24.06      47      2
-24.06      47.61      2
-24.06      47.75      2
-24.06      47.5      2
-24.18      47.86      2
-24.06      47.86      2
-24.06      48.61      2

HLC stat tx/rx
Time      Date      Acq CRC Errors      Traffic CRC Errors      Bursts      Rx Power [dBm]
14:03:07      1/31/2009      0      748      15331      -47.48
14:03:22      1/31/2009      0      805      15316      -47.21
14:03:37      1/31/2009      0      903      14873      -47.21
14:03:52      1/31/2009      0      788      13415      -46.68
14:04:07      1/31/2009      0      961      14962      -47.21
14:04:22      1/31/2009      0      1171      15350      -47.48
14:04:37      1/31/2009      0      984      15340      -47.48
14:04:52      1/31/2009      0      966      15330      -46.68
14:05:07      1/31/2009      0      1139      15345      -47.21
14:05:22      1/31/2009      0      1121      15328      -47.21
14:05:37      1/31/2009      0      982      15344      -47.48
14:05:52      1/31/2009      0      956      15337      -47.21
14:06:07      1/31/2009      1      1125      15341      -47.21
14:06:22      1/31/2009      4      945      15343      -47.21
14:06:37      1/31/2009      13      925      15346      -47.21
14:06:52      1/31/2009      10      1146      15345      -47.21
14:07:07      1/31/2009      22      1043      15342      -47.21
14:07:22      1/31/2009      0      977      15329      -46.68
14:07:37      1/31/2009      0      1413      15332      -47.48
14:07:52      1/31/2009      0      1709      15325      -47.21
14:08:07      1/31/2009      0      1652      15325      -47.21
14:08:22      1/31/2009      0      1050      15336      -47.21
14:08:37      1/31/2009      0      1222      15327      -47.21
14:08:52      1/31/2009      0      902      15337      -47.48
14:09:07      1/31/2009      0      965      15321      -47.21
14:09:22      1/31/2009      0      895      15341      -47.21
14:09:37      1/31/2009      0      827      15330      -47.21
14:09:52      1/31/2009      0      972      15310      -46.94
14:10:07      1/31/2009      0      848      15339      -47.21
14:10:22      1/31/2009      0      779      15319      -47.21

HLC stat rx only
Time      Date      Tx Attempts      Tx Bytes      Rx Power [dBm]
14:03:12      1/31/2009      478      35682      -55.27
14:03:27      1/31/2009      486      35148      -56.34
14:03:42      1/31/2009      471      34882      -56.34
14:03:57      1/31/2009      451      34198      -56.34
14:04:12      1/31/2009      436      33212      -56.34
14:04:27      1/31/2009      426      32104      -56.34
14:04:42      1/31/2009      439      33022      -56.61
14:04:57      1/31/2009      436      32958      -56.34
14:05:12      1/31/2009      463      34514      -56.34
14:05:27      1/31/2009      444      33280      -56.34
14:05:42      1/31/2009      458      33656      -55.54
14:05:57      1/31/2009      427      33082      -56.34
14:06:12      1/31/2009      436      33154      -56.34
14:06:27      1/31/2009      432      32408      -56.34
14:06:42      1/31/2009      448      33382      -56.34
14:06:57      1/31/2009      444      33258      -56.34
14:07:12      1/31/2009      468      35232      -56.34
14:07:27      1/31/2009      452      34308      -56.34
14:07:42      1/31/2009      466      34330      -56.34
14:07:57      1/31/2009      452      34210      -56.34
14:08:12      1/31/2009      453      34194      -55.54
14:08:27      1/31/2009      470      34281      -56.34
14:08:42      1/31/2009      471      35844      -56.07
14:08:57      1/31/2009      472      34663      -55.81
14:09:12      1/31/2009      492      35282      -56.34
14:09:27      1/31/2009      477      34458      -56.34
14:09:42      1/31/2009      467      34614      -56.34
14:09:57      1/31/2009      460      34298      -56.07
14:10:12      1/31/2009      463      34607      -56.34
14:10:27      1/31/2009      458      33770      -56.34

Title: Re: remote out of network
Post by TDMAMike on Feb 1st, 2009 at 2:14pm
1. You say your UCP GREEN (sweet spot) is config'ed to 7-9 dB for upstream.  Most use 9dB for the center, you are a dB lower at 8dB.  8dB is a bit low, but considering your circumstances with this customer I would not increase/adjust that ucp window to 8 - 10.  It will only make things worse for this customer...because he is having difficulty holding up 7DB.  So, hold what you have (7-9dB) for now.  Just realize that 9dB is the norm for the UCP (TDMA Nominal). A lot of folks will use 7-9 in an effort to allow customers with inferior BUCs into their network.  Setting the UCP to 7-9 (iDS 6.X) buys additional margin for customers who have BUCs that fall a bit short of their link budget/network requirements.  It lliterally allows them to shave off a dB of upstream SNR.  

2. According to your cut/paste statistical output, this customer's downstream C/N is considerably low.  I dont have situational awareness on your link budget, but most VSAT customers shoot for 10.5-11dB of downstream rx SNR (SLA driven!).  What are other customers under this same downstream carrier reporting for RX SNR?  Are they reporting approx 8dB like this customer?  Please advise.

3. You mentioned that initial tx power is -5.  What is high max tx value set to (aka the 1dB compression point)?  Also, when commissioning a node, do you compression test each of them?

14:07:39 1/31/2009 6.6 0.4
14:07:54 1/31/2009 6.68 0.4
14:08:09 1/31/2009 6.53 0.4
14:08:39 1/31/2009 6.65 0.4

I can see from the above that the remote is pushing up power (+.4) when it falls below the configured sweet spot for the UCP.  When it upstream SNR (as seen by the line cards) drops below 7 (as you can see above) the NMS recognizes the low arrival of your bursts and is asking the remote to push up power in an effort to get it back to the sweet spot (which is above 7dB).

14:06:07 1/31/2009 1 1125 15341 -47.21
14:06:22 1/31/2009 4 945 15343 -47.21
14:06:37 1/31/2009 13 925 15346 -47.21
14:06:52 1/31/2009 10 1146 15345 -47.21
14:07:07 1/31/2009 22 1043 15342 -47.21

You can also correlate the low upstream SNR (under 7dB burst arrival at the line card) with the errors observed on the HLC (I have cut and pasted the above)


4.  Your HLCs are concerning.  Are these HLCs supporting the same inroute group?  (read: are they identical in transmission rate, info rate, and symbol rate) and supporting the same group of remotes in either frequency hop or carrier grooming? Need to know if they are on the same RF downlink chain?  

Reason I ask is that rx power is too low.  One is reporting approx -47dB and the other is reporting -56dB (your remotes are working harder because of this!)

a. Need to know if they BOTH support the same inroute group and if they reside on the same RF/IF downlink chain? (it is alarming that there is a 10dB variance between the two, and if they BOTH support the same network inroute, then we may need to investigate further).

b. The observed values are too low (attenuated).  Do you have any attentuation pads in line on that downlink chain?  If the answer is no, you should consider putting in an L-Band amp on the receive chain to get that value closer to -36.  In doing so, it will buy you additional power margin on the remote side.  As configured, you are severely attenuated on one of the cards and the other is borderline (-48 should be considered the max-threshold for rx power).

Courses of Action:

1. I still recommend that the tech conduct a peak/pol/isolation check on this customer.  I think it will resolve most of your problems.  
2. Consider pulling any software or physical attenuation (if any exists) on this downlink chain.  If none exists, consider putting a small amp in place to get the HLC rx power values where they need to be (target = -36dB)
3. Even with the above recommendations, we should not rule out the possibility of this customer reaching BUC saturation.  Recommend you have the tech check what size BUC he is using, and ensure that it is conducive to the link budget for your network.  He very well may have an inferior BUC.  If you complete COA#2 above (remove atten/add amplification) your remotes should back out in power a few dB (1-2 dB).  This may buy you additional power margin for the return path.

Lastly, if all of your remotes are receiving that downstream carrier at approx 8dB, get ahold of controllers and ensure you radiating at contract power.  8dB doesnt offer you much weather margin/flexibility.

r/

Mike

Powered by YaBB 2.5.2!
YaBB Forum Software © 2000-. All Rights Reserved.