Hi,
I have a SIPP based load test client setup and working over a SIP trunk to my test app server. It's a fairly basic SIPP scenario (INVITE, ACK, Play PCAP, BYE). I can run the load test client for a period of time generating 100 simultaneous calls. At around 400 calls I start receiving SIP 403s upon the INVITEs. The Reason SIP header value is: Q.850;cause=21.
I can keep sending calls and some of them process without issue, however after around 400 calls I end up getting 403s on approximately ten percent of the calls.
Below is a snippet of logging indicating the error.
12:57:58.936 |StationD: (0000796) SetRinger ringMode=1(RingOff).|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |StationD(796): StationCtiD - StationOutputSetRinger|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |deleteCi: Unable to find the device that owns the call with CI=28612389|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |LineControl(868) - Release call instance=2 for CI=28612389|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |LineControl::sendSNFNotifyIndForPresenceWithAlerting mPrecenceWithAlertingChangeNotifySubscribed=0, calllist#=25|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |LineControl (868) - DStopInd - Last one is still received|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |LineControl(868) - 25 calls, 0 CiReq, busyTrigger=10000, maxCall=10000|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |processCCMFeatureData: operationIeIdd=0|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |ConnectionManager - wait_AuDisconnectRequest ERROR:NO ENTRY FOUND IN TABLE,CI(28612388,28612389),dcType=1,IFCreated(0,0),PID(0-0,0-0),IFHandling(0,0),MCNode(0,0)|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |MatrixControl:updatePartyMediaCoordinatorNodeId: party1 videoCapable=0, party 2 videocapable=0|1,200,17,1.444887^10.20.17.30^2000
12:57:58.936 |Cdcc - (0065765) - resetMediaSecurity|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/SIPD(1,67,10)/ccbId=0/scbId=0/getKeyBasedOnCiAndBranch: AddressingElement branch is 0 and ci is 28612388 mapKey is 28612388|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/SIPD(1,67,10)/ccbId=0/scbId=0/getCdpcPid: found Cdpc Pid (1,100,68,34273) for mapKey 28612388|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0x0/sipConstructContainerContext #### Created container=0xb1eedd70|1,100,65,1.1^*^*
12:57:58.937 |//SIP/SIPCdpc(1,68,34273)/ci=28612388/ccbId=530215/scbId=0/appendReasonHdr: appendReasonHdr - Invalid Disconnect Cause(cause=21), No Reason Header Appended|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/SIPCdpc(1,68,34273)/ci=28612388/ccbId=530215/scbId=0/addTransparencyInfo: Transparency info is NULL. Not attaching anything.|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0x0/ccsip_spi_get_msg_type returned: 3 for event 8|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0xaa2e8708/Performing disconnect|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/SIPHandler/ccbId=0/scbId=0/sip_stop_timer: type=SIP_TIMER_EXPIRES value=1800000 retries=0|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0xaa2e8708/****Adding to UAS Response table.|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0xaa2e8708/Added to table. ccb=0xaa2e8708 key=236-23780@10.20.17.64530215~37C71E3A-0C2F-4A3E-AC5C-9390087ABFE3-28612388|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0xaa2e8708/Associated container=0xb1eedd70 to Invite Response 403|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Transport/0xaa2e8708/msg=0xa9e481e8, addr=10.20.17.64, port=56298, sentBy_port=56298, is_req=0, transport=1, switch=0, callBack=|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Transport/0xaa2e8708/Proceedable for sending msg immediately|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Transport/0xaa2e8708/switch transport is 0|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Transport/0x0/Posting send for msg=0xa9e481e8, addr=10.20.17.64, port=56298, connId=0 for UDP|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/Info/0xaa2e8708/Sent an 3456XX Error Response|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/Stack/States/0xaa2e8708/0xaa2e8708 : State change from (STATE_RECD_INVITE, SUBSTATE_NONE) to (STATE_DISCONNECTING, SUBSTATE_NONE)|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/SIPHandler/ccbId=0/scbId=0/sip_stop_timer: type=SIP_TIMER_CONNECT value=500 retries=6|1,200,17,1.444887^10.20.17.30^2000
12:57:58.937 |//SIP/SIPHandler/ccbId=0/scbId=0/sip_start_timer: type=SIP_TIMER_CONNECT value=500 retries=6|1,200,17,1.444887^10.20.17.30^2000
12:57:58.939 |//SIP/SIPUdp/wait_SdlSPISignal: Outgoing SIP UDP message to 10.20.17.64:[56298]:
[7046533,NET]
SIP/2.0 403 Forbidden
Via: SIP/2.0/UDP 10.20.17.64:56298;branch=z9hG4bK-23780-236-0
From: "1035" <sip:1035@10.20.17.64:56298>;tag=236
To: <sip:2000@10.20.17.40:5060>;tag=530215~37c71e3a-0c2f-4a3e-ac5c-9390087abfe3-28612388
Date: Tue, 29 Jan 2013 17:57:56 GMT
Call-ID: 236-23780@10.20.17.64
CSeq: 1 INVITE
Allow-Events: presence
Reason: Q.850;cause=21
Content-Length: 0
Any thoughts on what would cause a relatively limited number of calls to run through successfully and suddenly start getting 403s?
