Wednesday, May 18, 2016

MicroStrategy Connection to Secured Hadoop Cluster

Connecting MicroStrategy Server to Kerberized involved below Steps:

1. Downloading and Installing the Hive Driver
2. Created DSN in MicroStrategy in odbc.ini
3. Accessing the DSN connection from MicroStrategy Gui
4. Kerborizing the user at MircroStrategy Server

Let's see how to do each of these one by one:

PreRequisites:

 Hive Details
       1. Hive Host Details- fully qualified name
       Default Hive Port

2.                Kerberos Details
        krb5.conf file
        Kerberos principal
        Keytab file of user which will invoke MicroStrategy let’s say bdauser.keytab

3.                   MicroStrategy Details

       Server and Root access where MicroStrategy Intelligent Server is installed.
       Non-root user to be created in MicroStrategy which will connect to Hadoop.

4.                   Hive odbc driver


This document is created for Hortonworks, however process is same for any vendors driver.

Hive Driver Installation:


In Server hosting MircroStrategy get the hortonworks hive odbc driver from Net/ or from below location
Location /root/hive-odbc-native-2.1.2.1002-1.el6.x86_64.rpm
User root

Command rpm –Uhv hive-odbc-native-2.1.2.1002-1.el6.x86_64.rpm

Make sure it is successful.

DSN Definition in MicroStrategy

In odbc.ini do the changes as below
 [ODBC Data Sources]
          =Hortonworks Hive ODBC Driver


[<DSN_NAME>] – Name of the DSN
Description=Hortonworks Hive ODBC Driver   – Driver Details
Driver=/usr/lib/hive/lib/native/Linux-amd64-64/libhortonworkshiveodbc64.so– Hive driver Path host Name
DriverUnicodeEncoding=2
HOST=  – Hive host Name
PORT=10000
Database='' – Schema name
FastSQLPrepare=0
UseNativeQuery=0
RowsFetchedPerBlock=10000– Rows to be  name
HiveServerType=2
HS2AuthMech=1 – 1 for Kerberos
HS2HostFQDN= – Hive host Name
HS2KrbServiceName=hive
UserName=root – Not Required
Trace=Yes– Not Required
TraceFile=/tmp/odbc.log– Not Required



#### Note: Make sure DSN_NAME is same at both places.

Kerberos Changes in MicroStrategy Server

   1. Backup existing /etc/krb5.conf in microstrategy server
   2. Bring /etc/krb5.conf from hadoop secured cluster
   3. Bring the user.keytab file from hadoop cluster to mico
   4. Execute below commands:
          a. kinit -kt
    5. Generate Kerberos ticket
          a. kinit -Vkt


ODBC.inst changes


Above file should have an entry for Driver as
[Hortonworks Hive ODBC Driver 64-bit]

Driver=/usr/lib/hive/lib/native/Linux-amd64-64/libhortonworkshiveodbc64.so Description=Hortonworks Hive ODBC Driver (64-bit)



Verification :

cd $MICROSTRATEGY_HOME/bin

[18-May-16 3:48 PM] Saurabh Pandey:
./mstrtodbcx
MicroStrategy ODBC Test Tool
  Version 10.1.0008.0027
Type .help (including the period) for help.
- > .connect -d

 ## You are in hive prompt now if there are no errors
type  "show tables; " and press enter to get tables in hive.


Follow Regular Process of Creating DSN in MicroStrategy  Database Connection wizard. You should be able to see DSN created above there.






No comments:

Post a Comment