I feel like I barely made it alive this week. My crazy life started out on Sunday evening as I delivered a webinar for the New Zealand and Australia Oracle User Group on Backing Up Your Oracle Databases to the Cloud. Because the target audience was in Australia and New Zealand, my webinar was scheduled for 7PM on Sunday. Immediately next day afternoon, I delivered another presentation for Database Trends and Applications on Database Replication for Zero downtime Migrations, High Availability and Disaster Recovery presentation leveraging SharePlex. I haven’t delivered a speech on SharePlex and Data Replication since 2000 at IOUG in Orlando. The turnout for this event was great!

Next day, I flew to San Francisco to deliver the full-day Hands-On-Lab workshop on Oracle Cloud on Wednesday. This is our featured workshop that we deliver for the Oracle Cloud SIG on behalf of the IOUG – Independent Oracle Users Group sponsored by the Northern California Oracle User Group. There was lot of content that had to be updated and lot of new content on Oracle Ravello Cloud and Bare Metal Cloud Services that had to be added.

On Thursday, I delivered the keynote at the Northern California Oracle Users Group (NoCOUG) on Why You Need to Consider Upgrading to Oracle Database 12c Release 2 (Oracle 12.2) to Securely and Easily Migrate to Oracle Cloud. This was my first time presenting for NoCOUG and the turnout was great. After my keynote, I also sat on the Expert Panel on Oracle Cloud fielding questions from the audience.

I do not think I want to repeat a week like this again. On a positive note, I did get to meet a lot of experts from our industry. If you would like to download a copy of any or all of the presentations, please feel free to visit our Viscosity North America website. I feel like this crazy presentation life style is becoming more and more of a norm for me these days. I do enjoy doing the research and geeking out with fellow Oracle technologists.

Posted by Charles Kim, Oracle ACE Director


The Oracle Cloud Experience Technology Hands-on-lab Workshop is sponsored by the Cloud Computing SIG of IOUG. Here’s what the high level agenda will look like for the Great Lakes Oracle Conference which will be held on May 17 and 18 at Cleveland, Ohio. Every attendee will be given a Kindle version of the Oracle Cloud Pocket Solutions Guide:

NewImage

The Cloud Experience Technology Hands-on-lab Workshop will start with creating a database in Oracle Cloud. We will also focus on backing up an on-premise database to the cloud and various solutions that’s available from Oracle to backup both Oracle databases and non-Oracle databases. We will discuss complete solution options that you can implement as you make your journey to Oracle Cloud.

We will also discuss real-life solutions addressing security concerns, opening ports, creating database links/communicating with databases in Oracle Cloud, and innovations that Oracle has made to Oracle Cloud in the past 2 years.

Here’s a high level agenda of the Oracle Cloud Experience HOL Workshop for the Great Lakes Oracle Conference on May 17 and 18:

01:00 – 01:30 – Introduction to Oracle Cloud and Security
01:30 – 01:45 – Login to on-premise accounts and cloud accounts

01:45 – 02:15 – Database Cloud Lecture
02:15 – 03:00 – Hands on Workshop

03:00 – 03:30 – Oracle Storage Cloud and Database Backup Cloud Lecture
03:30 – 04:00 – Hands on Lab Workshop

Normally, this is an all day lecture and hands-on-lab workshop. We have created a special condensed version for the Great Lakes Oracle Conference.

The Oracle Cloud Solution Guide addresses Oracle Cloud fundamentals, Storage Cloud, Database Cloud, and Oracle Database Backup Cloud, as a quick go-to reference guide, as seen by industry experts. Here’s the outline of the book:
Introduction to Oracle Cloud
Review Oracle Cloud Fundamentals
– Logging into the OPC (for the first time)
– Discuss how to sign up for a free trial account

Storage Cloud
Oracle Storage Cloud Service Fundamentals
Object Storage
Archive Storage
What is a Container
Defining the Replication Policy
Setting the Replication Policy

Demonstrate Cloud SIG’s curl API in action
What is curl
Obtaining the Authorization token
Creating a Container with curl
Creating an Archive Container with Curl
Uploading a file with curl
Listing the Contents of a Container
Deleting a File in a Container
How much space have I consumed so far?
Upload CLI Jar
Uploading a File Using the uploadcli.jar File

Oracle Database Cloud
Provisioning a Database
* Generating SSH Keys
SSH’ing to the Database Server as oracle
SSH’ing to the Database Server as ops and root
Opening/enabling Port 1521
Creating a Database Link Between Private Database and Public Database Cloud
Creating a Secure Tunnel with ssh
Adding Database Storage to DBaaS

Oracle Database Backup Cloud
Show students how and where to download the Database Cloud Backup Module
Installing the Database Cloud Backup Module
Configuring RMAN for Backups
Backing up the Database to OPC
Discuss how and what is needed to perform backups for Oracle Standard Edition databases
Best Practices for Backing Up to OPC
Demonstrate how to restore and recover a database from the RMAN Database Cloud Backup

Review of Oracle Storage Cloud Software Appliance
Logging into the OSCSA
Best Practices with OSCSA
Where to find additional documentation
Quick Demo of Oracle Storage Cloud Software Appliance

Posted by: Charles Kim, Oracle ACE Director


The Oracle Public Cloud Experience Technology Hand-on-lab Workshop is sponsored by the Cloud Computing SIG of IOUG. Here’s what the high level agenda will look like for the Dallas Cloud Experience Technology Day Workshop being held on December 9th, 2016 at the Oracle Las Colinas office:

09:30 – 10:00 – Check-in
10:00 – 10:30 – Registration and cloud account setup for each student
10:30 – 11:00 – Introduction to Oracle Cloud and SSH Security
11:00 – 11:30 – Hands on Lab Workshop

11:30 – 12:00 – Oracle Storage Cloud and Database Backup Cloud Lecture
12:00 – 12:30 – Hands on Workshop
12:30 – 13:30 – Provided lunch and work through lunch as needed

13:30 – 14:00 – Oracle Cloud Customer Case Study
14:00 – 14:30 – Database Cloud Lecture
14:30 – 15:30 – Hands on Lab Workshop
15:30 – 16:00 – Oracle Storage Cloud Storage Appliance Lecture and Demo
16:00 – 16:15 – Final Questions and Answers

The outline for the Cloud Experience Technology Workshop will include the following content:
Introduction to Oracle Cloud
Review Oracle Cloud Fundamentals
– Logging into the OPC (for the first time)
– Discuss how to sign up for a free trial account

Storage Cloud
Oracle Storage Cloud Service Fundamentals
Object Storage
Archive Storage
What is a Container
Defining the Replication Policy
Setting the Replication Policy

Demonstrate Cloud SIG’s curl API in action
What is curl
Obtaining the Authorization token
Creating a Container with curl
Creating an Archive Container with Curl
Uploading a file with curl
Listing the Contents of a Container
Deleting a File in a Container
How much space have I consumed so far?
Upload CLI Jar
Uploading a File Using the uploadcli.jar File

Oracle Database Cloud
Provisioning a Database
* Generating SSH Keys
SSH’ing to the Database Server as oracle
SSH’ing to the Database Server as ops and root
Opening/enabling Port 1521
Creating a Database Link Between Private Database and Public Database Cloud
Creating a Secure Tunnel with ssh
Adding Database Storage to DBaaS

Oracle Database Backup Cloud
Show students how and where to download the Database Cloud Backup Module
Installing the Database Cloud Backup Module
Configuring RMAN for Backups
Backing up the Database to OPC
Discuss how and what is needed to perform backups for Oracle Standard Edition databases
Best Practices for Backing Up to OPC
Demonstrate how to restore and recover a database from the RMAN Database Cloud Backup

Review of Oracle Storage Cloud Software Appliance
Logging into the OSCSA
Best Practices with OSCSA
Where to find additional documentation
Quick Demo of Oracle Storage Cloud Software Appliance


Oracle Storage Cloud Service is an Infrastructure as a Service (IaaS) offering, which provides an enterprise scale object storage solution for all size files and unstructured data. You can leverage Oracle Storage Cloud Service to backup content and even Oracle Database(s) to an offsite location. We can programmatically store and retrieve content, and share content with others.

Oracle Storage Cloud Service stores data as objects within a flat hierarchy of containers. An object is most commonly created by uploading a file. It can also be created from ephemeral unstructured data. Objects are created within a container. A single object can hold up to 5 GB of data, but multiple objects can be linked together to hold more than 5 GB of contiguous data.

A container is a user-created resource, which can hold an unlimited number of objects, unless you specify a quota for the container. At a super high-level, you can think of containers like a directory in a file system except it cannot be nested.

Object storage provides an optimal blend of performance, scalability, and manageability when storing large amounts of unstructured data. Multiple storage nodes form a single, shared, horizontally scalable pool in which data is stored as objects (blobs of data) in a flat hierarchy of containers. Each object stores data, the associated metadata, and a unique ID. You can assign custom metadata to containers and objects, making it easier to find, analyze, and manage data. Applications use the unique object IDs to access data directly via REST API calls. Object storage is simple to use, performs well, and scales to a virtually unlimited capacity.

Oracle Storage Cloud Service provides a low cost, reliable, secure, and scalable object-storage solution for storing unstructured data and accessing it anytime from anywhere. It is ideal for data backup, archival, file sharing, and for storing large amounts of unstructured data like logs, sensor-generated data, and VM images.

In this post, I am providing a comprehensive shell script called curl.ksh script that can be used with Oracle Storage Cloud Service to early upload, download, maintain and query the contents of the storage cloud service.

In a nutshell, the korn shell script accepts for the first argument the command to:
1. ls (to list out the directory)
2. get (to download a file)
3. mkdir (to create a container directory)
4. put (to upload a file with the curl command)
5. jput (to upload a file with the java uploadcli Jar file)
6. pjput (to upload a file in parallel and in segments for large files over 5GB leveraging the java uploadcli Jar file)
7. del ( to delete a file )

The second argument will be the container name (or name of the directory. The last argument is the name of the file that we are uploading, downloading, listing or deleting.

The script executed without any arguments will display the authentication token to be used.

$ ./curl.ksh
*   Trying 129.152.172.1...
* Connected to viscosityxxxx.storage.oraclecloud.com (129.152.172.1) port 443 (#0)
* TLS 1.2 connection using TLS_RSA_WITH_AES_128_CBC_SHA
* Server certificate: *.storage.oraclecloud.com
* Server certificate: VeriSign Class 3 Secure Server CA - G3
* Server certificate: VeriSign Class 3 Public Primary Certification Authority - G5
> GET /auth/v1.0 HTTP/1.1
> Host: viscosityxxxx.storage.oraclecloud.com
> User-Agent: curl/7.43.0
> Accept: */*
> X-Storage-User: Storage-viscosityxx:charles.kim@v.com
> X-Storage-Pass: xxxxxyyxxzzzz
> 
< HTTP/1.1 200 OK
< date: 1461554947509
< X-Auth-Token: AUTH_tk41223c8f481b0e5e42c47f1617560f54
< X-Storage-Token: AUTH_tk41223c8f481b0e5e42c47f1617560f54
< X-Storage-Url: https://storage.us2.oraclecloud.com/v1/Storage-viscosityxxxx
< Content-Length: 0
< Server: Oracle-Storage-Cloud-Service
< 
* Connection #0 to host viscosityxx.storage.oraclecloud.com left intact

Behind the scene, curl is logging in with the userid and password that is stored in the curl.conf configuration file. Because we provided the userid and password, Oracle Storage Cloud Service provides a temporary authentication token. Future request to the service must be leveraged through the supplied authentication token. The line that has the key words "X-Auth-Token" and "X-Storage-Token" has the authentication token that we need. This authentication token expires after 30 minutes.

curl.conf configuration file has three parameters:

DOMAIN=viscosityxxxx
USER=charles.kim@v.com
PW=xxxxxyyxxzzzz

The DOMAIN parameter is the identity domain. Account creation results in creation of an identity domain (IDM slice) for that customer that is leveraged across all Oracle Public Cloud Services (and across all data centers). During the Oracle Public Cloud Services account setup process, the customer needs to create an account and specify an account name. Using the specified account name, that the identity domain will be implicitly created.

There is one manual step that is required. The parameter named AUTH must be manually specified from the OS. Consideration was made to place the AUTH parameter in the curl.conf configuration file but because the authentication token expires in 30 minutes, I made the choice to make it a manaul process to manually set the AUTH parameter from the OS. Earlier I mentioned that by executing ./curl.ksh without any arguments will display the "X-Auth-Token" and "X-Storage-Token" value. We need to manually export the AUTH parameter to the authentication token as shown below:

export AUTH=AUTH_tk41223c8f481b0e5e42c47f1617560f54

The curl.ksh script leverages the AUTH environment variable for all curl invocation. For calls that are made with java, the userid and password will be required. You will be prompted for the password to your account when invoking the java to load files with the uploadcli.jar. Here's what the curl.ksh script looks like:

 cat curl.ksh
export INMETHOD=$1
export NEWCONTAINER=$2
export FILE=$3

. curl.conf

export METHOD=$(echo $INMETHOD |tr '[a-z]' '[A-Z]')

if [ "$METHOD" = "" ]; then
  echo "Executing: curl -v -s -X GET -H "X-Storage-User: Storage-${DOMAIN}:$USER" -H "X-Storage-Pass: $PW" https://${DOMAIN}.storage.oraclecloud.com/auth/v1.0 "
  curl -v -s -X GET -H "X-Storage-User: Storage-${DOMAIN}:$USER" -H "X-Storage-Pass: $PW" https://${DOMAIN}.storage.oraclecloud.com/auth/v1.0 
elif [ "$METHOD" = "LS" ]; then
  echo "Executing:  curl -s -X GET -H "X-Auth-Token: $AUTH" https://storage.us2.oraclecloud.com/v1/Storage-${DOMAIN}/$NEWCONTAINER?limit64"
  curl -s -X GET -H "X-Auth-Token: $AUTH" https://storage.us2.oraclecloud.com/v1/Storage-${DOMAIN}/$NEWCONTAINER?limit64
elif [ "$METHOD" = "GET" ]; then
  echo "curl -v -s -X GET -H "X-Auth-Token: $AUTH" -o $FILE https://storage.us2.oraclecloud.com/v1/Storage-${DOMAIN}/$NEWCONTAINER/$FILE"
  curl -v -s -X GET -H "X-Auth-Token: $AUTH" -o $FILE https://storage.us2.oraclecloud.com/v1/Storage-${DOMAIN}/$NEWCONTAINER/$FILE
elif [ "$METHOD" = "MKDIR" ]; then
  [ "$NEWCONTAINER" = "" ] && ( echo "Directory Name must be provided:  $NEWCONTAINER"; exit; )
  curl -v -s -X PUT -H "X-Auth-Token: $AUTH" https://storage.us2.oraclecloud.com/v1/Storage-$DOMAIN/$NEWCONTAINER
elif [ "$METHOD" = "DEL" ]; then
  [ "$NEWCONTAINER" = "" ] && ( echo "Directory Name must be provided:  $NEWCONTAINER"; exit; )
  echo "curl -v -s -X DELETE -H "X-Auth-Token: $AUTH" https://storage.us2.oraclecloud.com/v1/Storage-$DOMAIN/$NEWCONTAINER/$FILE"
  curl -v -s -X DELETE -H "X-Auth-Token: $AUTH" https://storage.us2.oraclecloud.com/v1/Storage-$DOMAIN/$NEWCONTAINER/$FILE
elif [ "$METHOD" = "PUT" ]; then
  [ "$NEWCONTAINER" = "" ] && ( echo "Directory Name must be provided:  $NEWCONTAINER"; exit; )
  [ "$FILE" = "" ] && ( echo "File Name must be provided:  $FILE"; exit; )
  curl -v -X DELETE -H "X-Auth-Token: $AUTH"  https://storage.us2.oraclecloud.com/v1/Storage-$DOMAIN/$NEWCONTAINER/$FILE
elif [ "$METHOD" = "JAVAPUT" -o "$METHOD" = "JPUT" ]; then
  [ "$NEWCONTAINER" = "" ] && ( echo "Directory Name must be provided:  $NEWCONTAINER"; exit; )
  [ "$FILE" = "" ] && ( echo "File Name must be provided:  $FILE"; exit; )
  java -jar uploadcli.jar -url https://storage.us2.oraclecloud.com/v1/Storage-${DOMAIN} -user $USER -container $NEWCONTAINER $FILE
elif [ "$METHOD" = "PJAVAPUT" -o "$METHOD" = "PJPUT" ]; then
  [ "$NEWCONTAINER" = "" ] && ( echo "Directory Name must be provided:  $NEWCONTAINER"; exit; )
  [ "$FILE" = "" ] && ( echo "File Name must be provided:  $FILE"; exit; )
  java -jar uploadcli.jar -url https://storage.us2.oraclecloud.com/v1/Storage-${DOMAIN} -user $USER -container $NEWCONTAINER -segment-size 1000 -max-threads 16 $FILE
fi


The Upload CLI is a Java-based CLI tool that simplifies uploading to Oracle Storage Cloud Service. To download the java uploadcli.jar file, visit the http://www.oracle.com/technetwork/topics/cloud/downloads/index.html page. Look for the Oracle Storage Cloud Service Upload CLI section, and download the tool. Here's some of the key features provided by the uploadcli.jar file:

  • Optimized uploads through segmentation and parallelization to maximize network efficiency and reduce overall upload time
  • Support for both object storage and archive storage
  • Automatic checksum verification on upload
  • Upload individual files, groups of files, and entire directories
  • Automatic retry on failures
  • Resume interrupted uploads of large files

To leverage the uploadcli.jar file, the minimum requirements are that you must be at JRE 7 or later.

Please note that this script is evolving and will be updated periodically. The main idea of this script was to make the userid, password, domain, container, and file input to be parameterized leveraging a configuration file and parameters so that we can make the process relatively painless.

In Part 2 of this series, we will go through each of the examples to upload files, delete files, and download files from Oracle Storage Cloud Service. We will fully exploit the curl.ksh shell script and provide screen shot example output of each of the scenarios.

In Part 3 of this series, we will go through step-by-step process of downloading, installing and configuring the OPC Install Jar File. We will configure RMAN for backups to Oracle Public Cloud (OPC) and run through each of the scenarios for backup to OPC and restore/recovery from OPC.


Oracle Database Backup Service is a secure, scalable, on-demand storage solution for backing up your Oracle databases to Oracle’s Cloud. In a nutshell, Oracle databases are backed up to Oracle Cloud using the Oracle Database Cloud Backup Module. The Oracle Database Cloud Backup Module Can be downloaded from Oracle Technology Network (OTN) and is tightly integrated with Recovery Manager (RMAN). Because of the tight integration with RMAN, DBAs and architects can continue to use their familiar RMAN commands for backup and restore operations. DBAs can specify retention policies, perform cross-check operations, and even delete backups using their familiar RMAN commands.

To leverage Oracle Database Backup Service, you must be running at at least Oracle Database 10g Release 2 (10.2) to leverage Oracle Database Backup Service. You must first download the Oracle Database Cloud Backup Module from OTN and install it on the local target server:
http://www.oracle.com/technetwork/database/availability/oracle-cloud-backup-2162729.html

Oracle Database Cloud Backup Module is supported only for 64-bit architectures and for the following Linux, Solaris, SPARC, HP-UX, AIX, zLinux, and Windows operating systems.

Oracle ensures that data stored in Oracle Database Backup Service Cloud is redundant. Within Oracle Database Backup Service Cloud, data is automatically replicated to three separate physical machines. Oracle leverages this triple mirroring technique to prevent data loss in the event of hardware catastrophe.

All backups made to Oracle Cloud must be encrypted. You can leverage RMAN to encrypt your backup before it’s sent over the internet to Oracle Cloud. Oracle will only accept secure backups and reject a RMAN backup if it not secured.

Oracle Wallet Keys are stored locally on-premise at your data center. One thing to note is that keys are not in the cloud.


Abstract

Learn the secrets of the trade to rapidly provisioning Oracle DB Infrastructure-As-A-Service. This extreme session will cover topics of delivering Linux-As-S-Service, RAC-As-A-Service, ASM-As-A-Service, Database-As-A-Service, Backup-As-A-Service, and even Data-Guard-As-A-Service . Advanced techniques to deploy enterprise RAC and non-RAC database deployments in an automated fashion will be shared . Save days and even weeks of deploy time by attending this session. There is no reason why you as a DBA or Architect, should not be able to deploy a fully patched RAC environment from bare metal Linux and create a RAC database in less than one hour. Anyone deploying RAC or even non-RAC will learn the secret sauce and knowledge of how to properly deploy mission critical systems that is repeatable and consistent. Learn to deploy a fully patched (11.2.0.3 or 11.2.0.4 with PSU x or 12.1 with PSU x) two node RAC in less than one hour.

Learn how to automate database builds and to leverage golden image database templates.

We can’t forget about multi-tenant deployment of Oracle 12c Pluggable Databases. Learn how to deploy pluggable databases (PDB) and to migrate PDBs and significantly increase your database consolidation density.

The details of adding nodes to an existing clusters and removing nodes from the cluster will also be disseminated.

Collaborate 2014 – Extreme Oracle DB Infrastructure As A Service.pdf



Oracle Multitenant: The Beating Heart of #DBaaS

Start: Dec 09, 2014 01:00 PM America/Eastern
End: Dec 09, 2014 02:00 PM America/Eastern
Registration Link: https://www1.gotomeeting.com/register/911549736

The tripod of Oracle database as a service (DBaaS) rests on the strong legs of Oracle Multitenant as the enabling database architecture; Oracle Enterprise Manager for orchestration; and Oracle’s engineered systems, such as Oracle Exadata and Oracle SuperCluster, as the consolidation platforms. This total solution from a single vendor is unmatched. This session explores in detail various key capabilities of the multitenant architecture that deliver on the promise of DBaaS today.

Please signup for this webinar on DBaaS and join the IOUG Cloud Computing and Virtualization SIG for future webinars and educational series.

Best Wishes,
Charles Kim
President of the Cloud Computing and Virtualization SIG
Oracle ACE Director