How can I too many files upload more fast way to Cloud files in Rasckspace?

Posted by andy kim on Server Fault See other posts from Server Fault or by andy kim
Published on 2012-07-09T06:48:14Z Indexed on 2012/07/09 9:17 UTC
Read the original article Hit count: 260

Filed under:

python

|

Cloud

|

image

|

rackspace

|

cloud-storage

I have a lot of image files, it's all I want to upload to RackSpace cloud files about a million in a single directory the fastest and most efficient way.

but I'm use uploading python-cloudfiles script is very slow and I want to know different ways or python script code.

because one by one connection upload is very slow. I think one files tar and uncompress directory is better way. but cloudfiles do not support this way.

Who know any other way?

© Server Fault or respective owner

Related posts about python

unmet dependencies in Ubuntu 12.04

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I tried today to install a dvb-card on my Ubuntu 12.04 (Linux blauhai-linux 3.2.0-25-generic #40-Ubuntu SMP Wed May 23 20:30:51 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux ). The installation failed with an error. After that, i tried to install python (it was already installed but i got this error): linux:~$… >>> More
How can I get sikuli-ide to work?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I installed sikuli-ide with sudo apt-get install sikuli-ide Everything was fine until I tried to start it from the terminal. I typed sikuli-ide But the only response I got was [info] locale: en_US The application was not started, furthermore there is no desktop file and sikuli-ide does not… >>> More
Getting PATH right for python after MacPorts install

as seen on Super User - Search for 'Super User'
I can't import some python libraries (PIL, psycopg2) that I just installed with MacPorts. I looked through these forums, and tried to adjust my PATH variable in $HOME/.bash_profile in order to fix this but it did not work. I added the location of PIL and psycopg2 to PATH. I know that Terminal is… >>> More
call python with system() in R to run a python script emulating the python console

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to pass a chunk of Python code to Python in R with something like system('python ...'), and I'm wondering if there is an easy way to emulate the python console in this case. For example, suppose the code is "print 'hello world'", how can I get the output like this in R? >>> print… >>> More
Python - Calling a non python program from python?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am currently struggling to call a non python program from a python script. I have a ~1000 files that when passed through this C++ program will generate ~1000 outputs. Each output file must have a distinct name. The command I wish to run is of the form: program_name -input -output -o1 -o2… >>> More

Related posts about Cloud

Understanding: cloud-server, cloud-hosting, cloud-computing, the cloud

as seen on Server Fault - Search for 'Server Fault'
There's a lot of buzz about these subjects and there seems little consensus on the terms. Is that just me not understanding the subject, or is there a clear meaning for each of these terms? Are there more elaborate terms or descriptions that describe what a cloud provider has, is or offers? EDIT:… >>> More
amazon cloud vs rackspace cloud

as seen on Server Fault - Search for 'Server Fault'
Hi, I'm looking to take a dedicated server - in the process I read about Amazon Cloud computing & Rackspace Cloud Servers. Now I'm not sure which one to opt? Could somebody suggest - Performance & Price wise. Regards >>> More
BULL nous parle de Cloud Maker, offre de cloud computing s'appuyant sur l'hyperviseur de Microsoft

as seen on Developper.com - Search for 'Developper.com'
BULL nous parle de Cloud Maker, offre de cloud computing s'appuyant sur l'hyperviseur de Microsoft Lors des Tech Days 2010, organisés par Microsoft, Bull avait annoncé la signature d'un accord de coopération stratégique dans le domaine de l'interopérabilité avec la firme de Redmond. De ce fait… >>> More
Big Data – Role of Cloud Computing in Big Data – Day 11 of 21

as seen on SQL Authority - Search for 'SQL Authority'
In yesterday’s blog post we learned the importance of the NewSQL. In this article we will understand the role of Cloud in Big Data Story What is Cloud? Cloud is the biggest buzzword around from last few years. Everyone knows about the Cloud and it is extremely well defined online. In this article… >>> More
amazon cloud vs rackspace cloud [closed]

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I'm looking to take a dedicated server - in the process I read about Amazon Cloud computing & Rackspace Cloud Servers. Now I'm not sure which one to opt? Could somebody suggest - Performance & Price wise. Regards >>> More