Here is the upload script I am using to upload and import CSV files. I have changed the philosophy behind the way I'm writing these Infoblox scripts. For processes like uploading and download a CSV file I am writing one script that takes command line input and performs that one upload or download. If I want to batch upload or batch download a lot of CSV files I am wrapping that "single use" script in another BASH shell script and iterating through a list of CSV files. The advantage to doing this is that I only have to maintain one script to upload and one script to download CSV files. As I find bugs or imporvements, I only have to make changes in one place.
Disclaimer - I am happy to share my scripts with others. However, I have not tested these scripts in every possible scenario. My scripts could possibly contain bugs that I have not found because my use case is different from yours. It is possible that some undiscovered bug in my script could damage your production system. If you use any of my scripts please make sure you understand what they are doing before you use them. If you don't understand BASH shell scripting, don't use my scripts. Since this particular script accepts command line arguments, and one of those arguments is a password, this could be a potential security issue for your company because the command may be written to your BASH history file. Use at your own risk.
All my scripts were written on Ununtu 14 and tested against NIOS 7.3.8 in a development environment. I have not done extensive error checking and data validation for the input. These are quick and dirty scripts meant to be run agains a development system.
At some point this summer I will clean these scripts up with better comments and better error checking.
#!/bin/bash
# This script is for development use only and not
# intended to be used on a production system.
# Do not use this script unless you are familiar with BASH
# shell programming. Use at your own risk.
#
# This script will upload and import a csv file.
#
# The error checking that is done is only to determine
# if the curl command was successful. No error checking is
# done on the Infoblox side to see if the csv file was
# imported correctly.
#
# This is a reusable BASH function to check
# for errors after each curl command is run
check_for_errors()
{
ERROR_COUNT=`grep -c "Error" $OUTFILE`
AUTH_ERROR=`grep -c "401 Authorization Required" $OUTFILE`
TOTAL_ERRORS=`expr "$ERROR_COUNT" + "$AUTH_ERROR" + "$EXIT_CODE"`
echo
echo "Total errors: $TOTAL_ERRORS"
echo
if [ $TOTAL_ERRORS -gt 0 ]; then
echo
echo "Errors detected . . . exiting"
echo "Errors found in returned document: $ERROR_COUNT"
echo "Authentication errors: $AUTH_ERROR"
echo "Curl exit code was: $EXIT_CODE"
echo
cat $OUTFILE
exit
fi
}
print_usage()
{
echo
echo
echo
echo "Usage: $0 -h hostname -u username -p password -f filename"
echo
echo "NOTE: Passwords containing special character may need to be wrapped in single quotes."
echo
echo
echo
exit
}
# End of functions
########################
########################
## SET VARIABLES HERE ##
########################
########################
# Output file that will contain the results of the curl command
# If this file does not exist, it will be created automatically
OUTFILE="result.txt"
# Full path to the curl command - add any options here
# The -s option makes curl silent
CURL="/usr/bin/curl -v"
# Location of curl's cookie file - use full path to be safe
# If this file does not exist, it will be created automatically
COOKIEFILE="cookies.txt"
# Infoblox RESTful API version
# Make sure to include the letter "v" eg. "v2.3"
VERSION="v2.3"
##########################
##########################
## END OF SET VARIABLES ##
##########################
##########################
# Make sure exactly eight arguments were passed to the script
# Four switches and four values equals eight
if [[ $# -ne 8 ]]; then
echo "Number of arguments = $#"
print_usage
fi
# Get the command line arguments
while [[ $# -gt 1 ]]
do
key="$1"
case $key in
-h)
HOST="$2"
shift # past argument
;;
-u)
USERNAME="$2"
shift # past argument
;;
-p)
PASSWORD="$2"
shift # past argument
;;
-f)
CSVFILE="$2"
shift # past argument
;;
*)
# unknown option
print_usage
;;
esac
shift # past argument or value
done
# Comment the following echo commands if you don't want to do any debugging
# This will display the password to the screen which might be handy
# since some special characters int he password could break the script
echo
echo "Host: $HOST"
echo "Username: $USERNAME"
echo "Password: $PASSWORD"
echo "CSV file: $CSVFILE"
# See if the specified CSV file exists
if [ ! -e "$CSVFILE" ]; then
echo "File does not exist: $CSVFILE"
echo
exit
fi
# See if file is empty
if [ ! -s "$CSVFILE" ]; then
echo "File $CSVFILE is empty"
echo
exit
fi
echo
echo "#######################"
echo "# Processing csv file # $CSVFILE"
echo "#######################"
echo
# Get the csv file name without the path
BASE_CSVFILE=`basename $CSVFILE`
# Iniatiate a CSV file upload - get upload URL and token from server
# It will be in $OUTFILE
echo "Initializing CSV upload"
$CURL \
--dump-header $COOKIEFILE \
--insecure \
-u "$USERNAME:$PASSWORD" \
-H "Content-Type: application/json" \
-X POST https://$HOST/wapi/$VERSION/fileop?_function=uploadinit \
-d "{ \"filename\":\"$BASE_CSVFILE\" }" > $OUTFILE
EXIT_CODE=$?
check_for_errors
# Get the "token" and "download URL" for later use
TOKEN=`grep "token" $OUTFILE | cut -d"\"" -f4`
URL=` grep "url" $OUTFILE | cut -d"\"" -f4`
# Uncomment to see token and URL displayed on screen
# echo "Token: $TOKEN"
# "URL: $URL"
echo
# Upload the CSV file
# To debug data sent to host, add "--trace-ascii /dev/stdout" to
# the end of the curl command
echo "Uploading CSV data"
$CURL \
--cookie $COOKIEFILE \
--insecure \
-F name=$BASE_CSVFILE \
-F filedata=@$CSVFILE \
-X POST $URL > $OUTFILE
EXIT_CODE=$?
check_for_errors
echo
# Start the CSV import job
echo "Starting CSV import job"
$CURL \
--cookie $COOKIEFILE \
--insecure \
-H "Content-Type: application/json" \
-X POST https://$HOST/wapi/$VERSION/fileop?_function=csv_import \
-d "{ \"action\":\"START\", \"operation\":\"INSERT\",\"token\":\"$TOKEN\",\"on_error\":\"CONTINUE\" }" > $OUTFILE
EXIT_CODE=$?
check_for_errors
cat $OUTFILE
echo
echo
echo
exit
10903 
0
