Export Mysql Query to Amazon S3 Bucket
Based on the Accepted Answer Here, I Am Able to Export the Results of Mysql Query to a Csv File on My Amazon Ec2 Instance Using the Following: Mysql -User...
Based on the accepted answer here, I am able to export the results of mysql query to a csv file on my Amazon EC2 instance using the following:
mysql -user -pass -e "SELECT * FROM table" > /data.csv
However, as the file exported is large, I want to export an Amazon s3-bucket (s3:\\mybucket) which is accessible from my EC2 instance
I tried:
mysql -user -pass -e "SELECT * FROM table" > s3:\\mybucket\data.csv
But it doesn't export the file.
1 Answer
If you want to use the mysql command line program, then you have two choices:
- Increase the size of your instance's storage so that the file can be created. Then copy the file to S3
- Create a separate program or script that reads from Standard Input and writes to S3.
Another solution would be to create a simple program that processes your SELECT and directly writes to S3. There are lots of examples of this on the Internet in Python, Java, etc.
Maya is a hardware enthusiast who tests and reviews smart home devices, smartphones, wearables, and audio gear. She focuses on practical consumer value and build quality.
