SprightlySoft Blog

Amazon has a service called AWS Security Token Service which allows you to generate temporary credentials to access your AWS resources. SprightlySoft S3 Sync can be configured to use temporary credentials. The following article shows how to generate temporary credentials and use them with S3 Sync.

AWS Security Token Service is typically used by large organizations that do not want to manage many permanent AWS Identity and Access Management (IAM) users. These organizations will generate a temporary IAM user through STS that exists for only a few hours. An organization user will be able to use this IAM account for their required task. No extra work is required to expire the temporary account. To read more about Security Token Service see http://docs.aws.amazon.com/STS/latest/UsingSTS/Welcome.html

The organization will call the GetFederationToken function of the STS service to generate temporary security credentials. When calling this function the organization will choose how long the credentials are valid for. To read more about the GetFederationToken function see http://docs.aws.amazon.com/STS/latest/APIReference/API_GetFederationToken.html

The GetFederationToken function will return an AccessKeyId, SecretAccessKey, and SessionToken. These values can be used with S3 Sync to preform a file synchronization. Enter the AccessKeyId and SecretAccessKey and you normally would in the application. The SessionToken value needs to go in the RequestHeaders parameter in the format of “x-amz-security-token:[STSVALUE]”. When S3 Sync makes calls to Amazon it will add a x-amz-security-token header in every request. Amazon will validate the token in conjunction with the AccessKeyId and SecretAccessKey.

The following is an example of a S3 Sync command line using temporary credentials and a session token.

C:\Program Files (x86)\SprightlySoft\S3 Sync\S3Sync.exe" -AWSAccessKeyId xxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxx -BucketName mybucket -SyncDirection Upload -LocalFolderPath "C:\myfolder" -LicenseKey xxxxxxxxxxxx -RequestHeaders "x-amz-security-token:xxxxxxxxxxxx"

 

You can use a batch file to execute commands after S3 Sync completes. Say you want to upload files to S3 then delete the local files if the upload was successful. The following batch file is an example of this process.

Upload files to S3 then delete local files.

C:\Program Files (x86)\SprightlySoft\S3 Sync\S3Sync.exe" -AWSAccessKeyId xxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxx -BucketName mybucket -S3FolderKeyName "myfolder/" -SyncDirection Upload -LocalFolderPath "C:\myfolder" -DeleteS3Items true -LogOnlyMode false -OutputLevel 1 -CompareFilesBy Timestamp -LicenseKey xxxxxxxxxxxx -LogFilePath "C:\Temp\S3 Sync <BucketName> <S3FolderKeyName> <<yyyy-MM-dd HH.mm.ss>> <SyncDirection>.txt"

@if %ERRORLEVEL% neq 0 goto error

@echo S3 upload successful.
RMDIR "C:\myfolder" /Q /S
REM pause
exit 0

:error
@echo S3 upload error. Local delete not executed.
REM pause
exit 1

• The first line in the script above uploads files with S3 Sync.
• The %ERRORLEVEL% line checks the error level returned from S3 Sync. If the error level is not 0, the application skips the next block of code and goes to the :error section.
• The @echo line writes a message to the console window.
• The line with RMDIR deletes the local folder. This line will only be executed if error level from S3 Sync was 0 which means success.
• The REM pause line would wait for the use to press a key to continue. The REM statement comments out the line and it will not be executed. Remove REM if you would like to test the script and want to be notified before continuing.
• The exit 0 line exits the batch script with a success code. The remainder of the script will not be executed.
• The :error line is a section marker of the script.
• The @echo line writes a message to the console window.
• The REM pause line can be uncommented during testing.
• The exit 1 line exits the batch script with an error code.

The following is an example of downloading files with S3 Sync then deleting those files with S3 Delete. You can get S3 Delete for free at http://sprightlysoft.com/S3Delete/

Download files from S3 then delete files on S3.

"C:\Program Files (x86)\SprightlySoft\S3 Sync\S3Sync.exe" -AWSAccessKeyId xxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxx -BucketName mybucket -S3FolderKeyName "myfolder/" -SyncDirection Download -LocalFolderPath "C:\myfolder" -DeleteLocalItems true -LogOnlyMode false -OutputLevel 1 -CompareFilesBy Timestamp -LicenseKey xxxxxxxxxxxx -LogFilePath "C:\Temp\S3 Sync <BucketName> <S3FolderKeyName> <<yyyy-MM-dd HH.mm.ss>> <SyncDirection>.txt"

@if %ERRORLEVEL% neq 0 goto error

@echo S3 download successful.
"C:\Program Files (x86)\SprightlySoft\S3 Delete\S3Delete.exe" -AWSAccessKeyId xxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxx -BucketName mybucket -S3KeyName "myfolder/" -LogFilePath "C:\Temp\S3 Sync delete.txt" -OutputLevel 2
REM pause
exit 0

:error
@echo S3 download error. S3 delete not executed.
REM pause
exit 1

• The first line in the script above downloads files with S3 Sync.
• The %ERRORLEVEL% line checks the error level returned from S3 Sync. If the error level is not 0, the application skips the next block of code and goes to the :error section.
• The @echo line writes a message to the console window.
• The line with S3Delete.exe deletes the files from S3. This line will only be executed if error level from S3 Sync was 0 which means success.
• The REM pause line would wait for the use to press a key to continue. The REM statement comments out the line and it will not be executed. Remove REM if you would like to test the script and want to be notified before continuing.
• The exit 0 line exits the batch script with a success code. The remainder of the script will not be executed.
• The :error line is a section marker of the script.
• The @echo line writes a message to the console window.
• The REM pause line can be uncommented during testing.
• The exit 1 line exits the batch script with an error code.

To use the batch files above copy the code an place them in a text file using a tool such as Notepad. Change the parameters such as AWSAccessKeyId to your values. Save the file with a .bat extension. An example of the file name is “DownloadThenDelete.bat”. You can double click the bat file to execute it.

S3 Sync now supports server-side encryption using Amazon KMS-Managed Keys and Customer-Provided Keys. Server-side encryption is the process where Amazon encrypts files after you upload them. If you provide the correct credentials when retrieving a file, Amazon decrypts the file and returns it to you. Server-side encryption makes storing files on Amazon more secure.

Server-Side Encryption using AWS KMS-Managed Keys (SSE-KMS)

Amazon allows you to generate encryption keys within Amazon and specify which encryption key to use when uploading a file. This method is called AWS KMS-Managed Keys. You specify the ID of the encryption key to use when uploading a file. When downloading a file you must specify the same ID of the encryption key. You generate and manage encryption keys through the Identity and Access Management service which is accessible through the AWS web management console. If someone gets access to your S3 bucket they will not be able to retrieve a file unless they specify the correct ID of the encryption key. When managing encryption keys through the Identity and Access Management service you can delegate encryption key administrators and  encryption key users. These are the users that will be able to encrypt data, decrypt data, and manage encryption keys. When using SSE-KMS, AWS CloudTrail is available. CloudTrail keeps and audit history of who used an encryption key and when.

To use SSE-KMS in S3 Sync you will need to use the UploadHeaders parameter. The following is an example of this parameter.

-UploadHeaders “x-amz-server-side-encryption:aws:kms|x-amz-server-side-encryption-aws-kms-key-id:c112fc98-2e5d-4eab-aebc-0f565aa7e6fc”

The x-amz-server-side-encryption section tells S3 you will be using SSE-KMS. The x-amz-server-side-encryption-aws-kms-key-id section tells S3 which encryption key to use for the operation. You can get the key ID for an encryption key you generated in the AWS web management console under the Identity and Access Management service.

Note: The UploadHeaders parameter applies to upload, download, and bidirectional syncs in S3 Sync.

Server-Side Encryption using Customer-Provided Keys (SSE-C)

Amazon allows you to generate your own encryption key and send that key to S3 when uploading a file. Amazon will encrypt the file with your encryption key after it receives it. Amazon will then discard the key. When requesting the file you must include the same encryption key that was sent when uploading the file. Amazon will decrypt the file and return it to you. The benefit here is that Amazon does not store the encryption key so there is no way for someone with access to your account to retrieve a file. The drawback is you need to securely store your encryption keys locally. If you loose your keys you cannot retrieve your files.

The following is an example of the S3 Sync RequestHeaders parameter for using SSE-C.

-RequestHeaders “x-amz-server-side-encryption-customer-algorithm:AES256|x-amz-server-side-encryption-customer-key:Qi1sHpQnppeJAo5WyM8w/BGJXJmTO/LBg6dcjThY6nM=|x-amz-server-side-encryption-customer-key-MD5:IcpiSupe46fQ0fb5AGQ2RQ==”

The x-amz-server-side-encryption-customer-algorithm section says you will be using the AES 256 encryption method on S3. The x-amz-server-side-encryption-customer-key section is the encryption key. The x-amz-server-side-encryption-customer-key-MD5 section is the MD5 hash of the encryption key. Amazon will store the x-amz-server-side-encryption-customer-key-MD5 value with the file but not the x-amz-server-side-encryption-customer-key value.

The following is code to generate an encryption key and it’s MD5 hash in C#.

System.Security.Cryptography.AesManaged MyAesManaged = new System.Security.Cryptography.AesManaged();
MyAesManaged.GenerateKey();
String CustomerKey = Convert.ToBase64String(MyAesManaged.Key);

System.Security.Cryptography.MD5 MyMD5 = System.Security.Cryptography.MD5.Create();
Byte[] MD5Bytes = MyMD5.ComputeHash(MyAesManaged.Key);
String CustomerKeyMD5 = Convert.ToBase64String(MD5Bytes);

To read more about server-side encryption see http://docs.aws.amazon.com/AmazonS3/latest/dev/serv-side-encryption.html

Microsoft Windows has a built in task scheduler. It allows you to automatically run a program at a certain time. Task scheduler is great for automating backups. You can configure a task to send files to Amazon S3 using SprightlySoft S3 Sync. The following article will take you step by step through the process of creating a scheduled task to automatically upload files Amazon S3.

First run the S3 Sync Command-Line Wizard to build a S3 Sync command line. Enter your parameters of which folder you want to upload and which S3 bucket you want to save files to. When all your parameters are entered you will arrive at the Command-Line tab in the wizard. This screen allows you to save the command line to a batch file. Click the Save Command-Line button.

In the Save As dialogue box enter a name for your batch file.

Now that your batch file is saved you can double click it to run the command-line. This makes it easier to run S3 Sync. However in some situations you may want to run the command-line often and you do not want to click the batch file each time. This is where Windows Task Scheduler comes in handy. You can create a task to run the batch file once an hour. The following shows how to create a scheduled task.

In Windows go to the Control Panel. Under System and Security you will see Administrative Tools. Click it to see the administrative tools.

Under Administrative Tools click Task Scheduler.

The Task Scheduler screen will open up. Right click in the main area and click Create New Task.

Enter a name for your scheduled task. You will need to select the user the task runs under. It can be your account or another account. It’s best to select “Run whether user is logged on or not” so the task will run even if the user is not logged in. Click OK when you are complete.

In the Create Task screen click on the Triggers tab and click the New button.

On the New Trigger screen select how often the task will run. In the example below the trigger is set to run once an hour. You can choose different settings for your task if you’d like.

When you are finished with your trigger go to the Actions tab on the Create Task screen. Click the New button.

Under Program/script select the batch file you created earlier. Click the OK button when complete.

The settings for your new task are now entered. Click the OK button to create the task. You may be prompted to enter the password of the user the task runs under. Enter the password to continue.

You will now see the task in the Task Scheduler. To confirm the task is configured correctly right click on it and click Run. The Task Schuler will execute the batch file which will run S3 Sync with your settings. View the S3 Sync log to make sure S3 Sync ran correctly.

With the scheduled task configured you can relax and know your files will automatically be backed up to Amazon S3.

Amazon Glacier is a service that allows you to archive your files on Amazon’s cloud infrastructure. It is designed for large files that are accessed infrequently such as video and picture backups.

The main advantage of Glacier is the price. It costs $1 for 100 GB of storage space per month. This is 88% cheaper than the cost of standard storage on S3 and 85% cheaper than reduced redundancy storage on S3.

The main drawback to Glacier is that your files are not immediately available on request. It take 3 – 5 hours between the time you initiate a download request, and the time a file is made available for download.

There a 2 ways to take advantage of Amazon Glacier; you can use the Amazon Glacier service or you can use the Glacier storage class in Amazon S3. SprightlySoft recommends that you use the Glacier storage class in Amazon S3 for the following reasons:

• When using the Glacier storage class in S3 you can use the S3 web management console to view and manage files. The Amazon Glacier service does not have a web interface and it’s more difficult to list and manage files.
• It takes a long time to list files with the Amazon Glacier service. You list files by initiating an inventory job. This job takes up to 24 hours to complete. With S3 you can list files immediately even if they are in the Glacier storage class.
• Files stored in S3 using the Glacier storage class can be managed by any application that works with S3 and the Glacier storage class. When you store files in the Amazon Glacier service there is no standard way to store information such as file name. Each application that stores information stores it differently and this causes compatibility issues between applications.

To read more about using S3 and the Glacier storage class see http://aws.amazon.com/s3/faqs/.

To use the Glacier storage class in S3 you configure a lifecycle rule that moves files to the Glacier storage class. The easiest way to configure this rule is through the S3 management console. The following describes how to do this.

Enter the bucket where you want to use the Glacier storage class and click the Properties button.

Click the Lifecycle option.

Click the Add rule button.

In the Lifecycle Rule dialog click the Apply to Entire Bucket checkbox to make this rule apply to all files in the bucket. Next click the Move to Glacier button to get the Glacier options. In the Time Period field enter 0 to make files immediately go to the Glacier storage class. Click the Save button to apply the rule to your bucket.

You now have a lifecycle rule that pushes files to the Glacier storage class. Don’t worry if files stay in their previous storage class for a while. It may take up to a day for the files to be moved over and for the new storage class to be displayed in the web management console.

You can use SprightlySoft S3 Sync to upload files to a bucket with a Glacier lifecycle rule and to download files from the Glacier storage class. When S3 Sync encounters a file in the Glacier storage class it will make a request to retrieve the file. S3 Sync will wait until the file is available and when it is ready, it will be downloaded.

Give it a try today and reduce your S3 storage costs by using the Glacier storage class.

Do you want to use multiple IAM users with a single S3 bucket but don’t want the users to access each other’s files? You can craft a S3 bucket policy to limit a user to a specific S3 sub folder. The following will show you how to create a bucket policy and use SprightlySoft S3 Sync to work with that sub folder.

First find the User ARN of the user you want to restrict access to. You can find this in the AWS Management Console. Below is a screen shot of User ARN for a user called myuser.

Next go to the properties bucket you want to use in the AWS Management Console. In this example we will use a bucket called bucketwithpolicy. On the properties page click “Add bucket policy”.

Below is the bucket policy to restrict the myuser user to a folder called subfolder/ in the bucketwithpolicy bucket. You will need to replace the user ARN, bucket name, and sub folder name if you would like to use the policy.

{
  "Statement": [
    {
      "Sid": "myuserBucketActions",
      "Action": [
        "s3:GetBucketLocation",
        "s3:ListBucketMultipartUploads"
      ],
      "Effect": "Allow",
      "Resource": "arn:aws:s3:::bucketwithpolicy",
      "Principal": {
        "AWS": [
          "arn:aws:iam::657267205342:user/myuser"
        ]
      }
    },
    {
      "Sid": "myuserListBucket",
      "Action": [
        "s3:ListBucket"
      ],
      "Effect": "Allow",
      "Resource": "arn:aws:s3:::bucketwithpolicy",
      "Condition": {
        "StringLike": {
          "s3:prefix": "subfolder/*"
        }
      },
      "Principal": {
        "AWS": [
          "arn:aws:iam::657267205342:user/myuser"
        ]
      }
    },
    {
      "Sid": "myuserObjectActions",
      "Action": [
		"s3:AbortMultipartUpload",
		"s3:DeleteObject",
		"s3:GetObject",
		"s3:GetObjectAcl",
		"s3:PutObject",
		"s3:PutObjectAcl"
      ],
      "Effect": "Allow",
      "Resource": "arn:aws:s3:::bucketwithpolicy/subfolder/*",
      "Principal": {
        "AWS": [
          "arn:aws:iam::657267205342:user/myuser"
        ]
      }
    }
  ]
}

In the policy above the first statement allows the user to execute the GetBucketLocation and ListBucketMultipartUploads commands on the bucket.

The next statement allows the user to list files in the bucket where the prefix is subfolder/.

The last statement allows the user to perform actions within the sub folder within the bucket.

To read more about bucket policies see http://docs.aws.amazon.com/AmazonS3/latest/dev/AccessPolicyLanguage_UseCases_s3_a.html

Take the bucket policy you created and enter it in the AWS Management Console.

Now that your bucket policy is applied, the user has access to the sub folder within the bucket. The user can not use S3 Sync to upload or download files from that sub folder. The user will not be able to access any other folder in the bucket.

Below is a screen shot of configuring S3 Sync using the command line wizard.

The command line to run S3 Sync will be similar to the one below.

"C:\Program Files (x86)\SprightlySoft\S3 Sync\S3Sync.exe" -AWSAccessKeyId xxxxxxxxxxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx -BucketName bucketwithpolicy -S3FolderKeyName subfolder/ -SyncDirection Upload -LocalFolderPath C:\Temp\bucketwithpolicy\subfolder

When the user runs the S3 Sync command line their files will be transferred.

S3 Sync version 4 has been released. The latest version supports downloading files that have been moved to the Glacier storage class. Amazon Glacier is a file archiving service. Storing a file in Glacier costs 1/10th the cost of storing it in S3. The drawback of Glacier is that if you want to retrieve a file you need to put in a request and wait up to 5 hours before the file becomes available. 

You can use a S3 lifecycle policy to move files from S3 to Glacier. Create a S3 lifecycle policy through Amazon’s AWS Management Console web application.  When creating a lifecycle policy you can set the number of days before a file on S3 is moved to Glacier. Amazon does the work of monitoring this policy and moving files when required.

When a file is moved to Glacier it can no longer be downloaded through the Internet. It needs to be restored before it can be retrieved. The latest S3 Sync can detect if your files are on the Glacier storage class and it makes a request to restore them if required. The application waits until the restore is complete then downloads the files.

Glacier is great for backing up large files that you do not need immediate access to. For example backing up videos on S3 is expensive because the files are large. You usually only need to retrieve the files if your local copy is lost. When you store the files on Glacier the cost is low and the files can be available within few hours.

Try the latest version of S3 Sync and see how easy it is to restore files from Glacier.

SprightlySoft is pleased to announce the release of Glacier Sync. Glacier Sync is a Windows application that allows you to synchronize a folder on your computer with a vault on Amazon Glacier.

Amazon Glacier is an extremely inexpensive file archiving service. It is designed to store files for a long period of time where the files are accessed infrequently. It is great for backing up important files such as family pictures, tax receipts, your music collection, videos, and documents. By storing files on Glacier you have the piece of mind that your files will be available if they are ever needed.

Backing up files is important because once a file is lost, the information is gone forever. Hard drive failures are common and it is expensive to recover data. Backing up data to another computer is good, but if the other computer is in the same location your data may not be safe. A fire can destroy all the computers or a thief may steal the computers. A better solution is to back up your files to another location.

SprightlySoft Glacier Sync makes it easy to upload your important files to Amazon Glacier. Use the wizard to enter your information and start an upload. The application can be run from the command line which makes it easy to run automatically as a scheduled task. The application also has advanced features such as excluding certain files, creating a log file, and sending an email on completion.

To learn more and download Glacier Sync visit http://sprightlysoft.com/GlacierSync/.

Plupload is a component that makes it easy to upload files through a web browser. When you add Plupload  to a web page, users can select multiple files to upload and users can see the progress while an upload is taking place. To read more about Plupload see http://www.plupload.com/.

Plupload can be configured to upload files to Amazon S3. The following article describes how to create an ASP.NET web page which uploads files to S3 using Plupload.

Start by download the sample .NET web project at the bottom of this article. The project contains a file called crossdomain.xml which must be uploaded to the root of your S3 bucket. The crossdomain.xml file contains the following lines of code:

<?xml version="1.0"?>
<!DOCTYPE cross-domain-policy SYSTEM "<a href="http://www.macromedia.com/xml/dtds/cross-domain-policy.dtd">http://www.macromedia.com/xml/dtds/cross-domain-policy.dtd</a>">
<cross-domain-policy>
<allow-access-from domain="*" secure="false" />
</cross-domain-policy>

Make sure the crossdomain.xml file has public permission on S3 after you upload it. The crossdomain.xml file will allow Flash, which Plupload uses, to interact with your bucket.

The sample project contains the Plupload files and an ASP.NET page which hosts Plupload. The ASP.NET web page is displayed below.

<%@ Page Language="C#"%>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

<script runat="server">

//You must upload the crossdomain.xml file in this project to the root of your bucket in
//order for this example to work. You must make this file public (everyone view permission).

String AWSAccessKeyID;
String AWSSecretAccessKey;
String BucketName;
String PolicyDocument;
String PolicyDocumentSignature;

protected void Page_Load(object sender, EventArgs e)
{
AWSAccessKeyID = "";        //** put your value here **
AWSSecretAccessKey = "";    //** put your value here **
BucketName = "";            //** put your value here **

DateTime ExpirationDate;
ExpirationDate = DateTime.UtcNow.AddMinutes(60);

PolicyDocument = "";
PolicyDocument += "{";
PolicyDocument += "  \"expiration\": \"" + ExpirationDate.ToString("s") + ".000Z\",";
PolicyDocument += "  \"conditions\": [";
PolicyDocument += "    {\"bucket\": \"" + BucketName + "\"},";
PolicyDocument += "    {\"acl\": \"public-read\"},";
PolicyDocument += "    {\"success_action_status\": \"201\"},";
//PolicyDocument += "    [\"starts-with\", \"$Content-Type\", \"image/\"],";
PolicyDocument += "    [\"starts-with\", \"$Filename\", \"\"],";
PolicyDocument += "    [\"starts-with\", \"$name\", \"\"],";
PolicyDocument += "    [\"starts-with\", \"$key\", \"\"],";
PolicyDocument += "  ]";
PolicyDocument += "}";

Byte[] ByteArray;
ByteArray = System.Text.Encoding.UTF8.GetBytes(PolicyDocument);
PolicyDocument = System.Convert.ToBase64String(ByteArray);

ByteArray = System.Text.Encoding.UTF8.GetBytes(AWSSecretAccessKey);
System.Security.Cryptography.HMACSHA1 MyHMACSHA1 = new System.Security.Cryptography.HMACSHA1(ByteArray);

ByteArray = System.Text.Encoding.UTF8.GetBytes(PolicyDocument);
Byte[] HashArray;

HashArray = MyHMACSHA1.ComputeHash(ByteArray);
PolicyDocumentSignature = System.Convert.ToBase64String(HashArray);
}
</script>

<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8"/>
<title>Plupload to Amazon S3 Example</title>
<style type="text/css">
body {
font-family:Verdana, Geneva, sans-serif;
font-size:13px;
color:#333;
}
</style>

<link rel="stylesheet" href="https://ajax.googleapis.com/ajax/libs/jqueryui/1.9.1/themes/base/jquery-ui.css" type="text/css" />
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.8.3/jquery.min.js" type="text/javascript"></script>
<script src=" https://ajax.googleapis.com/ajax/libs/jqueryui/1.9.1/jquery-ui.min.js"></script>
<link rel="stylesheet" href="/plupload_v1.5.4/js/jquery.ui.plupload/css/jquery.ui.plupload.css" type="text/css" />
<script type="text/javascript" src="/plupload_v1.5.4/js/plupload.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js/plupload.gears.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js/plupload.silverlight.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js/plupload.flash.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js/plupload.browserplus.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js/plupload.html4.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js//plupload.html5.js"></script>
<script type="text/javascript" src="/plupload_v1.5.4/js/jquery.ui.plupload/jquery.ui.plupload.js"></script>
</head>
<body>

<h1>Plupload to Amazon S3 Example</h1>
<div id="uploader">
<p>You browser doesn't have Flash, Silverlight, Gears, BrowserPlus or HTML5 support.</p>
</div>

<script type="text/javascript">
// Convert divs to queue widgets when the DOM is ready
$(function () {
$("#uploader").plupload({
runtimes: 'flash,silverlight',
url: 'https://<%=BucketName%>.s3.amazonaws.com/',
max_file_size: '50mb',
multipart: true,
multipart_params: {
'key': '${filename}', // use filename as a key
'Filename': '${filename}', // adding this to keep consistency across the runtimes
'acl': 'public-read',
//'Content-Type': 'image/jpeg',
'success_action_status': '201',
'AWSAccessKeyId': '<%=AWSAccessKeyID%>',
'policy': '<%=PolicyDocument%>',
'signature': '<%=PolicyDocumentSignature%>'
},

// !!!Important!!!
// this is not recommended with S3, since it will force Flash runtime into the mode, with no progress indication
//resize : {width : 800, height : 600, quality : 60},  // Resize images on clientside, if possible
// optional, but better be specified directly
file_data_name: 'file',

// re-use widget (not related to S3, but to Plupload UI Widget)
multiple_queues: true,

// Specify what files to browse for
//filters : [
//                {title : "JPEG files", extensions : "jpg"}
//],

// Flash settings
flash_swf_url: '/plupload_v1.5.4/js/plupload.flash.swf',

// Silverlight settings
silverlight_xap_url: '/plupload_v1.5.4/js/plupload.silverlight.xap'
});
});
</script>
</body>
</html>

When using the code enter your values for AWSAccessKeyID, AWSSecretAccessKey, and BucketName.

The code starts by creating a policy document. The policy document describes what is allowed to be uploaded. Read more about policy documents at http://docs.amazonwebservices.com/AmazonS3/latest/dev/HTTPPOSTForms.html.

Next the code creates a hash of the policy document using your AWSSecretAccessKey. Both the hash and the policy document are uploaded to Amazon. Amazon knows the policy document is from you since only you can create the correct hash.

Next the code sets references to the required jQuery and Plupload files.

Next the code created an instance of Plupload and sets it’s parameters. Here we use the values of the BucketName, AWSAccessKeyID, policy document, and policy document hash.

When the code is run the Plupload window is displayed and the user can select files to upload. When the start upload button is clicked, the files will be uploaded to the bucket specified in  the code.

Download the Plupload sampe project (259 KB)

SprightlySoft is pleased to announce S3 Sync now supports Amzon’s AWS GovCloud service. GovCloud provides compute and storage services for US government agencies. Data in this environment is segregated and complies with specific requirements for hosting government information.  To read more about GovCloud see http://aws.amazon.com/govcloud-us/.

To use S3 Sync with GovCloud you must first have a GovCloud account. Run the program normally but specify the RequestEndpoint parameter. Here is an example of the command line for uploading files to GovCloud.

S3Sync.exe -AWSAccessKeyId xxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxxxx -SyncDirection upload -LocalFolderPath “C:\myfolder” -BucketName govbucket -RequestEndpoint s3-us-gov-west-1.amazonaws.com

S3 Sync also supports third party hosting providers that are compatable with the S3 API. One of these providers is GreenQloud. To use S3 Sync with GreenQloud set the RequestEndpoint parameter to s.greenqloud.com. Here is an example of the command line to upload files to GreenQloud.

S3Sync.exe -AWSAccessKeyId xxxxxxxxxxxx -AWSSecretAccessKey xxxxxxxxxxxxxx -SyncDirection upload -LocalFolderPath “C:\myfolder” -BucketName mybucket -RequestEndpoint s.greenqloud.com

Learn about GreenQloud’s Storage Qloud service at http://greenqloud.com/storageqloud/.

 S3 Sync is built with the SprightlySoft AWS Component for .NET. The AWS Component allows Microsoft developers to quickly build applications that interact with Amazon Web Services and third parties that are compatable their API.

For information on S3 Sync see http://sprightlysoft.com/S3Sync/.

For information on the AWS Component for .NET see http://sprightlysoft.com/AWSComponent/.