RightGrid

RightGrid is our back-end batch processing framework.  Cloud computing provides the perfect solution for batch processing because you are no longer limited by a dedicated compute capacity.  If there is a large number of jobs in the queue that need to be processed by your back-end worker servers, now you can increase the number of compute resources to reduce the total processing time.   Cloud computing lets you "scale-up" the number of resources at a rate and number that suits your needs and then "scale-down" once the number of jobs have been processed.  You are only limited by how much you're willing to spend.  But, at $0.10/hr per server, with no long-term contracts or upfront hardware investments, Amazon EC2 provides a cost-efficient solution, especially for those that believe that time is money!

The RightGrid batch processing system leverages Amazon’s EC2, SQS, and S3 web services to process large numbers of jobs in a scalable and cost efficient manner. It can also be used to process long running tasks that are spawned off of a web site.

The goal of the RightGrid system is to hide any operations specific to Amazon Web Services (AWS) so that the processing core can be plugged in with minimal effort. RightGrid takes care of all the scheduling, load management, and data transport so that the job processing can operate on local data, on an EC2 instance. RightGrid also monitors overall progress of jobs and provides access to log files and any associated error information.