cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
8033
Views
40
Helpful
34
Replies

Unable to upgrade C-series from TC6.0 to TC6.x through TMS

Jens Didriksen
Level 9
Level 9

I first noticed this issue when scheduling end-points in TMS to be upgraded from TC6.0 to TC6.01 as I mentioned in the thread below:

https://supportforums.cisco.com/message/3897394#3897394

However, thought it was more appropriate to create a separate thread for this.

TMS version 14.1.1

Upgrade C-series from TC5.x to TC6.x through TMS works just fine.

Upgrade C-series from TC6.0 to either TC6.01 or TC6.1, or from TC6.01 to TC6.1 fails.

TMS upgrade status shows, in most cases, upgrade stuck at 60%, and in some cases 5%.

Upgrading endpoint directly through web gui from TMS itself server works fine, as does upgrading direct from my workstation and/or laptop.

End-points include C20, C40, C60 and C90 - haven't dared to try the EX90s as yet as these executive systems.

Will open a TAC case when back at work in the morning.

/jens

Please rate replies and mark question(s) as "answered" if applicable.
34 Replies 34

Hey Jens,

FWIW, here is an extract from the EventLogAll of a C40 CODEC:

Jun 12 13:04:51 ppc appl: 2451.95 TMS I: provision(): http request url/https://IP_Address_Of_TMS/tms/public/external/management/systemmanagementservice.asmx/796 bytes
Jun 12 13:04:51 ppc appl: 2452.04 TMS I: provision(): tms query succeeded, length 1404
Jun 12 13:04:51 ppc appl: 2452.05 TMS I: executor(): Found heartbeat rate 0
Jun 12 13:04:51 ppc appl: 2452.08 TMS I: executor(): cuil-processed buffer of 607 bytes
Jun 12 13:04:51 ppc appl: 2452.08 TMS I: provision(): ok ! heartbeat 0 ! upgrade yes ! 0 files ! 0 docs
Jun 12 13:04:51 ppc appl: 2452.08 PROV I: provision(): software upgrade url='http://IP_Address_Of_TMS/' release-key='1TC006-1-*******'
Jun 12 13:04:51 ppc appl: 2452.15 HTTPFB I: Queue::removeAllByCollectionId: 3
Jun 12 13:04:52 ppc appl: 2452.38 PROV I: HttpDownloader notifyFailure [s:3] [url:http://IP_Address_Of_TMS/] [c:403]
Jun 12 13:04:52 ppc appl: 2452.39 PROV ERROR: HttpDownloader(this=0x22a88988)[c:403]: failed with [5](No error)
Jun 12 13:04:52 ppc appl: 2452.39 PROV ERROR: HttpDownloader(this=0x22a88988)[url:http://IP_Address_Of_TMS/]
Jun 12 13:04:52 ppc main: SWUpgrade: Failed [c:403] 'http://IP_Address_Of_TMS

It seems to me that TMS is provisioning the wrong information to the CODEC by telling it to download software from the ROOT of TMS. Of course, the CODEC not going to find any software there and this also has authentication and SSL applied. The only section in TMS that I can find that seems like it should be the information provided to the CODEC is in "Administrative Tools --> Configuration --> Network Settings --> URL Where Software Packages Can Be Downloaded" - the location of which on our install points to "http://FQDN_Of_TMS/tms/public/Data/SystemSoftware" - which I have enabled Anonymous Authentication (disabling others) and removed SSL.

In addition, TMS cannot (at this present time) provision the C series CODECs in the same way that it does for Jabber Video and the E series endpoints, and we don't utilise CUCM. I can't find any "software" URL or Upgrade options in the TMS Configuration Template under 'Cisco TelePresence Group Series' options. If I browse to the "Configuration --> System Status --> Provisioning" section of the CODEC, I can see the "Upgrade Status URL" - which points to the root of TMS server - but I see no option to set this anywhere.

Just as a test, I added a virtual folder in IIS that linked "http://FQDN_Of_TMS/tms/public/Data/Software"

with the location of the FTP folder as specified in TMS at "Administrative Tools --> Configuration --> General Settings --> FTP Software directory", but this didn't work either.

I have noted that TC6.1.2 has just been release, but this is only a maintenance release and does not seem to contain any fixes with regard to this issue. I think I shall also open a TAC case.

Chris

Message was edited by: Chris Swinney Added paragraph re-provisioning and templates

Hmmm.... TMS isn't using the URL Where Software Packages Can Be Downloaded folder when telling TC software >= 6.0 endpoints where to go for upgrades, TMS builds the full URL itself ( if I remember correctly). This seems to have failed somehow in your case, which very well could be a TMS bug.

Please go ahead and open a TAC case.

-Kjetil

Thanks for comprehensive info Chris, I'll download TC6.1.2 so I'll have something to upgrade to in order to get the logs for TAC as I can safely open a new case now that the SUS issue has been resolved.

Edit: SR #626297987 created.

/jens

Please rate replies and mark question(s) as "answered" if applicable.

@Jens:

Can you check whether the "Software FTP directory" is a location that can be reached by IIS? Unless you do some IIS magic of your own, it must be a subfolder of C:\Program Files (x86)\TANDBERG\TMS\wwwTMS\. If it isn't, I see the same symptoms as Chris sees when I try to upgrade from TC 6.1.1 to 6.1.2.

@Chris:

When you created the virtual folder, are you sure you gave the user IIS uses the necessary read permissions? There are a lot of things that can go wrong when you do this yourself. What happens if you move the Software FTP Directory back to a subfolder of IIS, e.g. the default value of C:\Program Files (x86)\TANDBERG\TMS\wwwTMS\Public\data\SOFTWARE?

Regards,

Kjetil

Hey Kjetil,

Kjetil Ree wrote:

@Chris:

When you created the virtual folder, are you sure you gave the user IIS uses the necessary read permissions?

Yes. In fact I have the folder the security permission for the relevant ApplictionPool (TMSNet40AppPool) which is inherited from the "Public" application. You can anonymously link to a file in this virtual folder and download it without issue (i.e. "http://FQDN_Of_TMS/tms/public/data/software/s52000tc6_1_1.pkg")

This virtual folder pointed to the FTP folder location (see below) but I used the URL to update the to host the System Software updates URL:

There are a lot of things that can go wrong when you do this yourself. What happens if you move the Software FTP Directory back to a subfolder of IIS, e.g. the default value of C:\Program Files (x86)\TANDBERG\TMS\wwwTMS\Public\data\SOFTWARE?


Regards,

Kjetil

I didn't actually move the FTP folder location (I can't see how as this is hardcoded into TMS).  Our default location is set to:

Our biggest issue, however, is that at this moment in time we cannot raise a TAC request due to the maintenance lapsing on our TMS. As we are a not-for-profit organisation, we simply cannot afford the cost. We have a huge VCS and endpoint deployment, but whilst TMS is incredibly usfull, it has been regarding as non-essential. We use it for monitoring, software upgrades, and provisioning (although the later hasn't kicked into gear as yet), but not scheduling. I have passed this back up the management chain, but I'm not sure what will be done.

swinster70 wrote:


Yes. In fact I have the folder the security permission for the relevant ApplictionPool (TMSNet40AppPool) which is inherited from the "Public" application. You can anonymously link to a file in this virtual folder and download it without issue (i.e. "http://FQDN_Of_TMS/tms/public/data/software/s52000tc6_1_1.pkg")


It is strange that there was no SOFTWARE folder there already, the installer should have created that automatically.

On my lab TMS 14.x servers, it looks like (out of the box):

What happens if you (for temporary troubleshooting purposes) give "everyone" full control over

C:\Program Files (x86)\TANDBERG\TMS\wwwtms\public\data\SOFTWARE? That way we can rule out permission issues. Also note that it is TMS's Scheduler Service that kicks off software upgrades, so it is important that this service also can access the folder (I forgot to mention that in my earlier posts, sorry).

BTW: Your Software FTP directory path shows "Program Files", could it be that you are on a 64 bit Windows so that it should be "Program Files (x86)"? You can change it using the TMS Tools application.

Other than that, I don't really know what you should do. Reinstalling TMS — something I rarely recommend — could be a possibility, so that you let the TMS installer take care of the IIS config for you.

I'll also make sure that we make a couple of software changes to TMS. I want TMS a) to abort the upgrade process earlier if it sees that it cannot build a full URL to send to the endpoint, and b) actually log something useful when it fails ( in log-web-public.txt, and in the web UI). Tracking the issue as CSCuh50070.

-Kjetil

Looks correct here:

so maybe it is a permission issue.

/jens

Please rate replies and mark question(s) as "answered" if applicable.

Wohoo - sorted. I'm actually at home at the mo but it seems as though the upgrade has now been downloaded to the CODEC and the CODEC is requesting info from the correct location.

Kjetil - indeed we have had TMS for many years, continuously upgrading the DB from version to version. We originally ran TMS on Windows 2003 32 bit, but have recently upgraded to Windows 2008 R2 which is of course, 64 bit.

The ONLY thing in the "C:\Program Files\TANDBERG\.." is the Software tolder, which is indeed the location where TMS Tools pointed to. I removed the virtual folder in IIS that pointed to this folder and instead created a "Software" folder under "C:\Program Files (x86)\TANDBERG\TMS\wwwTMS\Public\Data\". I relied on the inherited permissions for the folder creation. Update the location in TMS Tools, restart all services..... and all looks OK.

In fact, as I am finishing this post I have just checked the test C40 CODEC, and it has updated successfully.

Many thanks for the pointers along the way. Jens - I hope this goes someway to resolving your issue.    

Chris

And sorted for me too

In the end, my problem was similar to yours Chris, however, despite TMS installing the correct FTP Software folder, it did not create the path to point to this folder, so TMS was unable to build the download URL. So the endpoint was trying to download from TMS_FQDN address with no path appended to it. Pretty obvious in hindsight as it was right there in the eventlog...

So changed the path using TMS Tools, restarted IIS and Scheduler service and TMS successfully upgraded a C40 from TC6.1.0 to TC6.1.2 - happy daze.

TAC advised this problem is consistent with bug CSCuh50070

TMS Software Manager now also points to the new location, which means all software currently residing in the original Software folder must be moved to the other one.

Thanks Kjetil and Chris for all your inputs

/jens

Please rate replies and mark question(s) as "answered" if applicable.

Hey Jens, yes I did mean to say about moveing the contents of the "Software" folder. I did this but forgot to post as I then went to have a beer or three.... nuff said

Anyhow, glad you sorted it to.

Kjetil Ree wrote:

@Jens:

Can you check whether the "Software FTP directory" is a location that can be reached by IIS? Unless you do some IIS magic of your own, it must be a subfolder of C:\Program Files (x86)\TANDBERG\TMS\wwwTMS\. If it isn't, I see the same symptoms as Chris sees when I try to upgrade from TC 6.1.1 to 6.1.2.

It's there, it's empty though - I put a copy of the software package there and tried to upgrade again, but no go, same error:

TMS I: provision(): tms query succeeded, length 1439

Jun 14 11:33:08 ppc appl: 2725443.93 TMS I: executor(): Found heartbeat rate 0

Jun 14 11:33:08 ppc appl: 2725443.95 TMS I: executor(): cuil-processed buffer of 618 bytes

Jun 14 11:33:08 ppc appl: 2725443.95 TMS I: provision(): ok ! heartbeat 0 ! upgrade yes ! 0 files ! 0 docs

Jun 14 11:33:08 ppc appl: 2725443.95 PROV I: provision(): software upgrade url='http://TMS FQDN/' release-key='1TC006-1-CB0BBB80'

Jun 14 11:33:08 ppc appl: 2725444.00 HTTPFB I: Queue::removeAllByCollectionId: 3

Jun 14 11:33:08 ppc appl: 2725444.04 PROV I: HttpDownloader(this=0x2272cb60): done downloading 689B (from http://TMS FQDN/ to //upgrade/pkg.tmp)

Jun 14 11:33:08 ppc appl: 2725444.04 PROV ERROR: HttpDownloader(this=0x2272cb60): download failed upgrad aborted [size:689B]

Also noticed that the TMS Software Manager does not look in that folder at all, only lists the packages sitting in

C:\Program Files\TANDBERG\TMS\wwwtms\public\data\SOFTWARE - so this could be a bit confusing.

/jens

Please rate replies and mark question(s) as "answered" if applicable.

TMS isn't using the URL Where Software Packages Can Be Downloaded folder when telling TC software >= 6.0 endpoints where to go for upgrades, TMS builds the full URL itself ( if I remember correctly).

Right, I got this confirmed. The TMS 14.3 web help has been updated to say:

"Note: This field is not used for endpoints running software version TC 6.x and later; instead the address set for Cisco TMS in the Advanced Network Settings for Systems on Internal LAN section below is used, with the correct path automatically appended."

I'll do some upgrade tests on my own either today or tomorrow to see what that possibly could have gone wrong.

-Kjetil

Kjetil Ree wrote:

TMS isn't using the URL Where Software Packages Can Be Downloaded folder when telling TC software >= 6.0 endpoints where to go for upgrades, TMS builds the full URL itself ( if I remember correctly).

Right, I got this confirmed. The TMS 14.3 web help has been updated to say:

"Note: This field is not used for endpoints running software version TC 6.x and later; instead the address set for Cisco TMS in the Advanced Network Settings for Systems on Internal LAN section below is used, with the correct path automatically appended."

I'll do some upgrade tests on my own either today or tomorrow to see what that possibly could have gone wrong.

-Kjetil

Does this mean that ONLY internal endpoints will be able to download software updates?

Maybe we have an issue as TMS DB has been updated through version over the years? Does the DB contain folder location information or is this hard coded? The current TMS Install is relatively fresh however - I think I installed 13.2, then upgraded to 14.

One other point to note on this - I'm not sure if TMS reports correctly that the software upgrade as completed successfully.

Whilst I can now set TMS to schedule the upgrade, which simply tells the CODEC that the software is ready for download, and the CODEC now successfully downloads and installs the software, the TMS software upgrade activity simply just stills there and thinks that the upgrade has not taken place.Eventually (in may case 5 day after the activity was scheduled), TMS reports the the software upgrade was NOT successful - however, it was.

Chris

Hi Chris,

TMS reported correct upgrade status for me for the few I upgraded to TC61.2 after fixing the original issue.

TC6.2 is now due out mid July so guess I'll know for sure then as I'll be scheduling TMS to do all the systems overnight.

/jens.

Please rate replies and mark question(s) as "answered" if applicable.