01-07-2020 12:04 PM
Running 2.8.1.6
I set the collector up back in November after Cisco recommended re-installing due to upgrade issue that they couldn't even figure out. There was no issue with uploads until December. It now reports upload fails due to "Internal Server Error." I have read through the forums and follow instructions on replacing the certificate and have had no luck. Any other advice would be greatly appreciated!
01-07-2020 12:44 PM - edited 01-07-2020 12:46 PM
"INTERNAL SERVER ERROR IS A GENERIC ERROR WE NEED TO BE more specific and get the details from logs:
In deploying the image you would have created the cli admin password? (java based shell authentication is not the same as the GUI)
If so have you also created/activated the users collectorlogin and root ? (real linux shell)
If not do the following for the cli admin shell
admin# pwdreset root 90
And
admin# pwdreset collectorlogin 90
it will activate those accounts and generate their passwords ( keep them where you can refer to them in the future)
after that
Via SSH Login to collector as user collectorlogin and then use command below to connect as root (cannot connect directly)
# su root
and then the following commands and send me the output in private:
# tail -100 /opt/ConcsoTgw/tail-end-gateway-decoupled/bin/CONN_TEG_LOGS/tail-end-gateway.log
# openssl s_client -showcerts -connect concsoweb-prd.cisco.com:443
# tail -100 /opt/ConcsoTgw/tail-end-gateway-decoupled/bin/nohup.out
# wget https://72.163.7.113/HeadEndWebAppServlet/ --no-check-certificate
01-08-2020 05:35 AM - edited 01-08-2020 05:36 AM
Thank you for the quick reply, adias!
I understand that "internal server error" is a generic error but that is all that the collector shows as it is trying to upload to SNTC. I already had the three logins set up during installation back in November. I sent you a PM with the requested outputs.
When reviewing the Uploads Processing on SNTC, my last successful upload was 11/24/19. Is there any other reports/data you may need?
01-08-2020 08:21 AM
I am sorry when you sent me the PM with the output, I have not got the details of the PM
01-08-2020 10:46 AM
Not sure what went wrong.. I resent it.
01-08-2020 12:17 PM - edited 01-08-2020 12:21 PM
I have now received thank you.Here is the specific error showing on this logs :
89: 0.0.0.0: Jan 07 2020 14:46:19.037 -0500: %CONN_TEG-6-CONN_STR_INFO: %[ch=connectivityteg][mid=10003][requestTranId=99999999][applianceId=CSP00090XXXXXX][customerId=270465469][source=Connectivity][component=CONN_TEG][threadName=qtp1965075519-26][className=com.cisco.ca.csp.conn.gateway.tailend.core.command.SendFileCommandHTTPS][methodName=uploadFileILB][lineNumber=625][isRemote=false]: message: Send File failed,http status code:404
90: 0.0.0.0: Jan 07 2020 14:46:19.038 -0500: %CONN_TEG-6-CONN_STR_INFO: %[ch=connectivityteg][mid=10003][requestTranId=99999999][applianceId=CSP00090XXXXXX][customerId=270465469][source=Connectivity][component=CONN_TEG][threadName=qtp1965075519-26][className=com.cisco.ca.csp.conn.gateway.tailend.core.command.SendFileCommandHTTPS][methodName=uploadFileILB][lineNumber=628][isRemote=false]: message: Send File failed,http status:Not Found
PLEASE CONNECT do the following :
Via SSH Login to collector as user collectorlogin and then use command below to connect as root (cannot connect directly)
# su root
and then the following commands :
# sed -i ':a;N;$!ba;s/file/#file/1' /opt/ConcsoTgw/tail-end-gateway-decoupled/bin/run.sh
# sed -i 's/nettools-upload.cisco.com/72.163.7.113/g' /opt/ConcsoTgw/tail-end-gateway-decoupled/conf/csof_config.xml
# service concsotgw restart
# service cspc restart
Once they are done try the collection profile/upload again and let me know
REF: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvo43779
It is does not work or present a different error please send me the following again in Private message as it may be an additional problem now.
# tail -100 /opt/ConcsoTgw/tail-end-gateway-decoupled/bin/CONN_TEG_LOGS/tail-end-gateway.log
# openssl s_client -showcerts -connect concsoweb-prd.cisco.com:443
# tail -100 /opt/ConcsoTgw/tail-end-gateway-decoupled/bin/nohup.out
# wget https://72.163.7.113/HeadEndWebAppServlet/ --no-check-certificate
01-08-2020 02:10 PM
I was having this issue also. The suggested fix resolved my upload issue. Thanks!
01-08-2020 02:48 PM
Excellent good it worked this time, in the future if it is the generic "Internal Server Error" please either verify the logs for the specific error apply the fix and/or open a new post if the error is not the same as above.
01-09-2020 05:49 AM
01-09-2020 07:23 AM - edited 01-09-2020 07:30 AM
1) Is your company name allowing only the name concsoweb-prd.cisco.com or it is also allowing the IP of the Cisco server ( 72.163.7.113 ) ?
I will need those logs to verify problem open a new PM and send me the data but in addition send me the following:
Because I got this output
wget https://72.163.7.113/HeadEndWebAppServlet/ --no-check-certificate
HTTP/1.1 408 Request Timeout
Date: Tue, 07 Jan 2020 20:51:09 GMT
Server: Apache
Content-Length: 221
Connection: close
Content-Type: text/html; charset=iso-8859-1
DO THE FOLLOWING INSTEAD and send me its output
# wget https://concsoweb-prd.cisco.com/HeadEndWebAppServlet/ --no-check-certificate
2 - ALSO WHAT IS THE CERTIFICATE YOU SEE AT THE SCREEN BELOW ON YOUR COLLECTOR
01-16-2020 10:12 AM
#2 was my issue. It had the wrong certificate under application settings. Thanks Adias!
btw... you PM still doesn't work.
01-16-2020 11:53 AM
no worries good it worked, PM is working on other posts so unfortunately not sure what our communication via PM is not working thank you for your patience. Please mark the post as resolved if possible
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: