Howdy out there in automation land! Well look here... a quick blog turnaround. I am happy to post more often... I just like to wait until I find things of true value. This week I did! In an effort to just see "is it possible"... I was able to hook in a Hadoop cluster database into CPO via JDBC adapter and JDBC driver. This gave me a great opportunity to talk to how you can use the JDBC adapter to plug into *ANY* database that has a JDBC driver.... the expansion opportunities are near endless!! So what should our movie poster of the blog be... Reloaded... hmmm
DVD? Does anyone out there still use that? :)
Eitherway, let's talk JDBC driver and CPO and more specifically Hadoop/Hive setup. Here are some steps to follow (with links) and of course, I have a video below...
Copy the above into your NEW or already existing classpath.
If you had to change your CLASSPATH (for any JDBC) you will need to restart your server (each node). If you only had to add the .JAR files to the directory then you just need to bounce the CPO service, again on each node.
Now you will go into the JDBC adapter, by going to Administration workspace in CPO, then Adapters. Right click -> properties on your JDBC adapter. Select the JDBC driver tab
Click New and create a new JDBC driver
On the JDBC driver tab you will fill out the following information:
Jar File - click the "..." and select the main JAR file. In the hadoop case that would be "HiveJDBC4.jar"
Driver Class Full Name - Type in the full class name. Most of the time you can find this in the documentation. In my case I used hive2 so I used "com.cloudera.hive.jdbc4.HS2Driver" for hadoop
Provider Name - give it a provider name, who wrote the JDBC driver
Default port - what is the default port for the DB connections
Connection URL - This will be the default URL to connect with. You can use CPO variables to help you construct it
Now you can click OK and save it.
Next you can go to your Targets area and create your JDBC database connection!
In targets you can right click->New and select JDBC database and begin to fill out the information
You will select your JDBC driver you created above and then fill out the connection information
If you need to use a more "custom" connection string, you can override it there
In my case for Hadoop it looks like this:
Pretty neat huh? Now you can make select/insert/update/delete calls to your JDBC based databases! Reload them and use them!
As always I have a good VOD for you to review... so
Thanks as always to all my wonderful readers and those who continue to stick with and use CPO. Big things are on the horizon and I hope that you will continue to use CPO and find great uses for it! If you have a really exciting automation story, please email me it! (see below) I would love to compile some stories and feature customers or individual stories in an upcoming blog!!!
AUTOMATION BLOG DISCLAIMER: As always, this is a blog and my (Shaun Roberts) thoughts on CPO and automation, my thoughts on best practices, and my experiences with the product and customers. The above views are in no way representative of Cisco or any of it's partners, etc. None of these views, etc are supported and this is not a place to find standard product support. If you need standard product support please do so via the current call in numbers on Cisco.com or email email@example.com