ASR 9010 Temperature Threshold

[hsien-ping tang]

Hi 

I would like to find the temperature threshold value of ASR9010.

admin show environment temperature, it shows only current temp value.

admin show environment table will only have critical value, no minor and major value.

Could anyone provide me this value?

Thanks,

Tom

[xthuijs · Accepted solution]

Hi Tom,

great question! And I think we could have documented this a bit better, so here we go!

The asr9000 hardware measures the temperature at 2 points, at the inlet (like the bottom of the card if vertical) and the "hotspot" which is close to the CPU which is top of the card.

The delta between inlet and hotspot effectively gives a measure of the total heat dissipation of that card and depending on how active it is/packets it forwards (no joke) it would be hotter or dissipating more heat.

The environmental logic of the shelf manager has 2 thresholds it would look at:

! #define RSP_STT 93  // RSP STT 

! #define LC_STT  90  // LC STT

These define the shutdown temperature thresholds when the hotspot exceeds these temperatures.

These values are not configurable and fixed in the SW.

Many people would like to have a yellow alarm to get an identification when the temperature reaches a certain (configurable?) threshold so that we can start looking into this. That is something in the works, but not there yet.

The STT (shutdown temperature thresholds) are RED and always be unconfigurable otherwise you will create a toaster oven out of your 9k :)

So what does inlet mean and what temperature should it be at? Another common question:

Ideally you want the temperature as low as possible, but that puts strain on your AC and env costs. If it is too high, but ensuring it is below the STT at the hotspot, the power consumption of the device goes up because more heat means more amps and also higher fan speeds, which also cost power.

So it is a trade off between AC cost and power draw of your device.

Also dirty filters or inconvenient airflow of the cabinets can affect the inlet temperature.

Then the airdensity matters also. If I have a medium inlet temp, but low air density, obviously I can't cool enough so my hotspot could be higher then a device on a location with a higher air density.

In short, there is no minimum or recommended inlet value as long as it can provide enough cooling to the card. The cooler the better, obviously, but trade of cost between AC and power draw and dependent on altitude/air density also.

How to go about it in the absence of the YELLOW alarm? You could poll the entity sensor mib for the hotspot temps and mark a 10% (or whatever range you prefer) and out of out mgmt station generate an alert when the hotspot temp is x% below the STT values provided.

Hopefully this gives some guidance.

regards

xander

~~~

Xander Thuijs CCIE #6775

Principal Engineer ASR9000/XR

[hsien-ping tang]

Hi Xander

thanks for your prompt reply

Tom

[ปลาวาฬทราย RMUTT CPE IX]

Does it have any recommendation since what is value I should put more air conditioner?

[smilstea]

Check table A-2

http://www.cisco.com/c/en/us/td/docs/routers/asr9000/hardware/installation/guide/asr9kHIGbk/asr9kIGapaspecs.html

We recommend staying between 5 and 40C, this can be checked with admin show environment temperature.

Thanks,

Sam

[Evan Roggenkamp]

Can you advise where to find the table? The document you posted seems to reference it, but I can not find a table A-2 anywhere...

Thanks

[xthuijs]

evan here you go:

Table A-2 Environmental Specifications

Description	Value
Operating Temperature (Nominal):	41° to 104°F (5° to 40°C)
Operating Temperature (Short term)2:	23° to 131° F (–5° to 55°C)
Humidity	Operating: 10 to 85 percent noncondensing Nonoperating: 5 to 95 percent noncondensing
Altitude	Operating: 0 to 13,000 ft (0 to 4,000 m) Nonoperating: 0 to 15,000 ft (0 to 4,570 m)
Power Dissipation	750 W maximum
Acoustic noise	70 dB at 80.6°F (27°C) maximum
Shock	Operating (halfsine): 21 in/sec (0.53 m/sec) Nonoperating (trapezoidal pulse): 20 G3, 52 in/sec (1.32 m/sec)
Vibration	Operating: 0.35 Grms4 from 3 to 500 Hz Nonoperating: 1.0 Grms from 3 to 500 Hz

^2.Short-term refers to a period of not more than 96 consecutive hours, and a total of no more than 15 days in a year. (This refers to a total of 360 hours in any given year, but no more than 15 occurrences during that 1-year period.).

^3.G is a value of acceleration, where 1G equals 32.17 ft/sec2 (9.81 m/sec2).

^4.Grms is the root mean square value of acceleration.

[Rojer-bkk]

Hi Xander and ASR9K Expert,

For RSP or RP, what sensor do we have to monitoring?

Is it fine to monitoring only for 'Inlet' sensor and set the threshold not over 40C

If the both sensors must to be montiored, how about the threshold of 'Hostspot' on RSP/RP ? or Can i use the config in SW (81 degreeC) as threshold?

Thanks in advance

[xthuijs]

hi rojer, it is the hotspot that is most important/critical.

if the hotspot goes over the set threshold, the card will eventually shutdown.

regards

xander

[Rojer-bkk]

Hi Xander,

Thanks for reply. So the hotspot sensor should also be monitored and set threshold < 80 degreeC correct?

[xthuijs]

yeah the inlet is merely to show you the intake temperature, it can be warm, if the devices are not hot at all or when the air is dense. the lower the temp is the more heat it can absorb obviously.

the hotspot is definitely more critical. would set a marker on 80 for yellow and 90 for red.

XR6 added a nice functionality to manually configure temperature thresholds for yellow and red via CSCun79821

cheers!

xander

[Rojer-bkk]

Thanks Xander

[hengkycung]

Hi Alexander,

We found this log on our ASR9k, not sure if the room temperature is not cool enough because we see on RSP its quite normal, we suspecting the linecard carrying lot of traffic.

LC/0/0/CPU0:2016 Apr 18 02:54:07.165 WIB: pfm_node_lc[299]: %PLATFORM-TEMPERATURE_ALARM-3-DIE_OVERTEMP_MAJOR : Set|envmon_lc[172120]|0x103c005|Alarm:Major Sensor:FIA5 Location:0/0/CPU0
LC/0/0/CPU0:2016 Apr 18 02:56:21.632 WIB: pfm_node_lc[299]: %PLATFORM-TEMPERATURE_ALARM-3-DIE_OVERTEMP_MAJOR : Clear|envmon_lc[172120]|0x103c005|Alarm:Major Sensor:FIA5 Location:0/0/CPU0
RP/0/RSP1/CPU0:2016 Apr 18 02:56:22.781 WIB: envmon[208]: %PLATFORM-ENVMON-4-DIE_OVERTEMP_MAJOR : Slot 0/0/CPU0 sensor FIA5 temperature 103.0C cleared threshold 108.0C

RP/0/RSP1/CPU0:PE01-NGN-JKT-MNCPDC#admin show environment temperatures
Mon Apr 18 11:02:05.634 WIB
R/S/I   Modules Sensor                  (deg C)
0/0/*
        host    die_NP0                 81.5
        host    die_NP1                 66.5
        host    die_NP2                 60.0
        host    die_NP3                 58.5
        host    die_NP4                 56.5
        host    die_NP5                 56.5
        host    die_FIA0                71.0
        host    die_FIA1                49.5
        host    die_FIA2                59.5
        host    die_FIA3                90.0
        host    die_FIA4                61.0
        host    die_FIA5                105.0
        host    die_FabSwitch           89.0
        host    db_np_0                 71.6
        host    db_np_1                 55.5
        host    db_skt_0                53.9
        host    db_inlet                33.1
        host    bb_inlet                32.8
        host    bb_hotspot_0            51.8
        host    bb_exhoust_0            59.9
        host    bb_exhoust_1            58.3
        host    bb_hotspot_1            67.7
        host    Inlet0                  32.5
        host    Hotspot0                50.6
                              



0/RSP0/*
        host    die_CPU                 32.0
        host    die_FabArbiter0         37.0
        host    die_FabArbiter1         39.0
        host    die_FIA                 41.0
        host    die_FabSwitch0          42.5
        host    die_FabSwitch1          42.5
        host    temp_u275               23.0
        host    temp_u276               32.7
        host    temp_u278               33.0
        host    temp_u277               28.6
        host    temp_u279               31.5
        host    temp_u280               42.1
        host    temp_u281               29.6
        host    temp_u282               44.5
        host    Inlet0                  23.2
        host    Hotspot0                32.5
                              
0/RSP1/*
        host    die_CPU                 32.0
        host    die_FabArbiter0         37.0
        host    die_FabArbiter1         39.0
        host    die_FIA                 44.0
        host    die_FabSwitch0          40.0
        host    die_FabSwitch1          40.0
        host    temp_u275               22.8
        host    temp_u276               32.5
        host    temp_u278               31.3
        host    temp_u277               27.5
        host    temp_u279               31.3
        host    temp_u280               41.3
        host    temp_u281               29.4
        host    temp_u282               43.8
        host    Inlet0                  23.0
        host    Hotspot0                32.2
                              



0/7/*
        ep0     Inlet0                  27.6
        ep0     Hotspot0                36.1
                              
        host    die_NP0                 50.0
        host    die_NP1                 54.0
        host    die_FIA0                52.0
        host    die_FIA1                57.0
        host    die_FabSwitch           52.0
        host    Inlet0                  26.1
        host    Hotspot0                42.1
                              
0/FT0/*
        host    Inlet0                  24.6
        host    Hotspot0                29.0
                              
0/FT1/*
        host    Inlet0                  22.8
        host    Hotspot0                26.4

Also from "admin show environment table", we see there is major and critical Hi value, In what condition that linecard will shutdown/reload ? Please clarify and give some comment.

Thanks.

[xthuijs]

sounds like you have a 36x10 in slot 0 in a 9010.

the FIA number 5 is running way hotter then all the other components. I see the inlet is rather high for this slot also compared to the other slots.

Can you check the fan speeds and see if there is adequate airflow? I think there will be considering the inlet vs hotspot/temps on the RP's.

I would check the airfilter to make sure they are able to provide the right airflow.

If there are any high powered optics inserted in the card, we may need to move the card to a more centered slot for it to have it benefit the max airflow, which is slightly higher in slots 3 and 4 around the RSP's.

xander

[oscarmtz]

Hi tomm

I have a similar problem but i don´t know which sensors

Nov 4 23:41:22 : envmon[212]: %PLATFORM-ENVMON-2-CHASSIS_OVERTEMP : Chassis ambient temperature 20.4C at or above rising T3 threshold -50.0C

#sh environment temperatures
Tue Nov 6 09:56:10.258 MXMX
R/S/I Modules Sensor (deg C)
0/1/*
ep0 Inlet0 21.5
ep0 Hotspot0 30.0

ep1 Inlet0 18.5
ep1 Hotspot0 26.4

host die_NP0 40.0
host die_NP1 49.0
host die_FIA0 49.0
host die_FIA1 46.5
host die_FabSwitch 49.0
host Inlet0 19.8
host Hotspot0 34.1

0/2/*
ep0 Inlet0 26.0
ep0 Hotspot0 34.1

ep1 Inlet0 20.5
ep1 Hotspot0 29.3

host die_NP0 52.0
host die_NP1 50.5
host die_NP2 46.5
host die_NP3 48.5
host die_FIA0 51.5
host die_FIA1 46.5
host die_FIA2 46.5
host die_FIA3 39.5
host die_FabSwitch 54.5
host Inlet0 20.4
host Hotspot0 41.3

0/3/*
host die_NP0 54.0
host die_NP1 49.0
host die_NP2 48.0
host die_NP3 44.5
host die_NP4 47.5
host die_NP5 46.0
host die_NP6 46.0
host die_NP7 46.5
host die_FIA0 37.0
host die_FIA1 32.0
host die_FIA2 41.0
host die_FIA3 47.5
host die_FabSwitch 53.0
host db_np_0 44.5
host db_np_1 38.5
host db_skt_0 34.1
host db_inlet 22.5
host bb_inlet 23.2
host bb_hotspot_0 36.9
host bb_exhoust_0 43.9
host bb_exhoust_1 40.6
host bb_hotspot_1 38.2
host Inlet0 23.1
host Hotspot0 36.9

0/RSP0/*
host die_CPU 23.0
host die_FabArbiter0 28.0
host die_FabArbiter1 31.0
host die_FIA 27.0
host die_FabSwitch0 41.0
host die_FabSwitch1 41.0
host temp_u275 15.9
host temp_u276 23.0
host temp_u278 24.3
host temp_u277 20.6
host temp_u279 22.0
host temp_u280 31.4
host temp_u281 20.7
host temp_u282 32.2
host Inlet0 15.9
host Hotspot0 23.1

0/RSP1/*
host die_CPU 21.0
host die_FabArbiter0 30.0
host die_FabArbiter1 31.5
host die_FIA 26.0
host die_FabSwitch0 40.0
host die_FabSwitch1 40.0
host temp_u275 15.5
host temp_u276 22.8
host temp_u278 25.1
host temp_u277 21.6
host temp_u279 22.3
host temp_u280 32.5
host temp_u281 21.0
host temp_u282 33.8
host Inlet0 15.6
host Hotspot0 22.9

0/7/*
host die_NP0 56.0
host die_NP1 52.0
host die_MAC0 45.6
host die_IMUX0 49.5
host die_FIA0 36.0
host die_FIA1 42.0
host die_EMUX0 41.5
host die_FabSwitch 48.0
host db_optics 20.1
host db_emux 22.6
host db_imux 20.2
host db_mac 31.1
host bb_inlet 20.7
host bb_hotspot_0 30.8
host bb_exhoust_0 31.9
host bb_exhoust_1 33.6
host bb_hotspot_1 30.9
host db_np2 23.6
host Inlet0 20.6
host Hotspot0 30.9

1/1/*
ep0 Inlet0 21.1
ep0 Hotspot0 30.0

ep1 Inlet0 18.3
ep1 Hotspot0 25.8

host die_NP0 41.0
host die_NP1 50.0
host die_FIA0 49.0
host die_FIA1 48.0
host die_FabSwitch 48.5
host Inlet0 19.2
host Hotspot0 34.1

1/2/*
ep0 Inlet0 26.1
ep0 Hotspot0 35.0

ep1 Inlet0 20.3
ep1 Hotspot0 29.2

host die_NP0 49.5
host die_NP1 51.0
host die_NP2 46.0
host die_NP3 45.5
host die_FIA0 53.5
host die_FIA1 45.5
host die_FIA2 42.0
host die_FIA3 41.5
host die_FabSwitch 55.0
host Inlet0 20.2
host Hotspot0 41.0

1/3/*
host die_NP0 52.0
host die_NP1 48.0
host die_NP2 47.5
host die_NP3 44.0
host die_NP4 52.0
host die_NP5 44.5
host die_NP6 43.0
host die_NP7 46.5
host die_FIA0 35.5
host die_FIA1 33.0
host die_FIA2 40.5
host die_FIA3 47.0
host die_FabSwitch 52.0
host db_np_0 44.0
host db_np_1 38.0
host db_skt_0 33.8
host db_inlet 22.0
host bb_inlet 23.2
host bb_hotspot_0 37.1
host bb_exhoust_0 44.3
host bb_exhoust_1 40.7
host bb_hotspot_1 38.1
host Inlet0 23.3
host Hotspot0 37.2

1/RSP0/*
host die_CPU 21.0
host die_FabArbiter0 28.0
host die_FabArbiter1 29.0
host die_FIA 25.0
host die_FabSwitch0 39.0
host die_FabSwitch1 39.0
host temp_u275 15.4
host temp_u276 22.5
host temp_u278 23.4
host temp_u277 19.7
host temp_u279 21.1
host temp_u280 29.6
host temp_u281 19.6
host temp_u282 31.3
host Inlet0 15.4
host Hotspot0 22.5

1/RSP1/*
host die_CPU 20.5
host die_FabArbiter0 28.5
host die_FabArbiter1 30.0
host die_FIA 30.0
host die_FabSwitch0 40.0
host die_FabSwitch1 40.0
host temp_u275 14.8
host temp_u276 22.1
host temp_u278 24.1
host temp_u277 20.9
host temp_u279 21.7
host temp_u280 31.5
host temp_u281 20.1
host temp_u282 32.7
host Inlet0 14.7
host Hotspot0 22.2

1/7/*
host die_NP0 53.0
host die_NP1 51.5
host die_MAC0 45.9
host die_IMUX0 49.3
host die_FIA0 34.0
host die_FIA1 42.0
host die_EMUX0 40.5
host die_FabSwitch 48.0
host db_optics 20.1
host db_emux 21.0
host db_imux 18.9
host db_mac 30.2
host bb_inlet 20.0
host bb_hotspot_0 29.3
host bb_exhoust_0 31.5
host bb_exhoust_1 32.6
host bb_hotspot_1 29.8
host db_np2 22.1
host Inlet0 19.8
host Hotspot0 29.3