4259 links
  • Arnaud's links
  • Home
  • RSS Feed
  • Tag cloud
  • Login
search: tag:aws tag:s3 — newest first
  • Bucket - ACK
    February 12, 2024 - permalink - https://aws-controllers-k8s.github.io/community/reference/s3/v1alpha1/bucket/
    ack aws s3
  • Working with presigned URLs - Amazon Simple Storage Service

    If you created a presigned URL by using a temporary token, then the URL expires when the token expires, even if you created the URL with a later expiration time. For more information about how the credentials you use affect the expiration time, see Who can create a presigned URL.

    So you have to use regular IAM user instead of IAM role for service generating presigned urls..? :-/

    August 12, 2023 - permalink - https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-presigned-url.html#who-presigned-url
    aws iam presigned s3
  • Sharing an object with a presigned URL - Amazon Simple Storage Service
    August 11, 2021 - permalink - https://docs.aws.amazon.com/AmazonS3/latest/userguide/ShareObjectPreSignedURL.html
    aws s3 share
  • Access S3 using Pyspark by assuming an AWS role. - Leyth Gorgeis - Medium
    January 3, 2020 - permalink - https://medium.com/@leythg/access-s3-using-pyspark-by-assuming-an-aws-role-9558dbef0b9e
    aws role s3 spark
  • Amazon S3 Path Deprecation Plan – The Rest of the Story | AWS News Blog
    May 9, 2019 - permalink - https://aws.amazon.com/fr/blogs/aws/amazon-s3-path-deprecation-plan-the-rest-of-the-story/
    aws s3
  • How Do I Create a Lifecycle Policy for an S3 Bucket? - Amazon Simple Storage Service

    To apply this lifecycle rule to all objects in the bucket, choose Next.

    That's why wildcard was not working :D

    September 22, 2017 - permalink - http://docs.aws.amazon.com/AmazonS3/latest/user-guide/create-lifecycle.html
    aws policy s3
  • Note: Count object in bucket/folder

    aws s3 ls s3://bucket/path/ --recursive --summarize | grep "Total Objects:"

    July 12, 2017 - permalink - https://links.infomee.fr/shaare/rcG0hg
    aws count s3
  • Amazon Glacier Direct Upload vs Glacier Upload via Amazon S3

    So you can put your data into glacier with 2 differents ways:
    1) directly to glacier via API
    2) Store them to s3 then with a management policy, it'll go to Glacier

    Warning : Huge cost when you download from glacier and when you delete before 3 months

    June 27, 2017 - permalink - https://www.cloudberrylab.com/blog/compare-amazon-glacier-direct-upload-and-glacier-upload-through-amazon-s3/
    aws glacier s3
  • Example 2: Bucket Owner Granting Cross-Account Bucket Permissions - Amazon Simple Storage Service

    Donc pour autoriser un compte externe, on va créer une bucket policy sur notre bucket pour autoriser "arn:aws:iam::account_id:root" ou plus précis sur l'user arn:aws:iam::account_id:user/foobar ou le role

    C'est le compte en face qui va décider qui a le droit de venir sur notre bucket avec des user policy standard (quand on est dans le contexte du compte en face, c'est comme si le bucket nous appartenait)

    Exemple bucket policy à mettre sur le BUCKET de l'account A pour autoriser l'account xxx en RW

    {
    "Version": "2012-10-17",
    "Statement": [

        {
            "Sid": "Allow account_xx on aws account xxx RW",
            "Effect": "Allow",
            "Principal": {
                "AWS": "arn:aws:iam::OTHER_ACCOUNT_ID:root"
            },
            "Action": ["s3:GetBucketLocation", "s3:ListBucket"],
            "Resource": "arn:aws:s3:::BUCKET"
        },
        {
            "Sid": "Allow account_xx on aws account xxx RW",
            "Effect": "Allow",
            "Principal": {
                "AWS": "arn:aws:iam::OTHER_ACCOUNT_ID:root"
            },
            "Action": [
                "s3:*"
            ],
            "Resource": "arn:aws:s3:::BUCKET/*"
        }
    
    
    
    
    ]
    

    }

    Pour Read only, remplacer action du deuxieme bloc par "Action": ["s3:Get","s3:List"],

    June 12, 2017 - permalink - http://docs.aws.amazon.com/AmazonS3/latest/dev/example-walkthroughs-managing-access-example2.html
    aws cross iam nomarkdown policy s3
  • Copy between S3 buckets w/ different accounts · GitHub
    June 8, 2017 - permalink - https://gist.github.com/ushu/7217693
    aws s3
  • Note: s3 policy one bucket

    ReadWrite :

    {
    "Version": "2012-10-17",
    "Statement": [
    {
    "Effect": "Allow",
    "Action": ["s3:GetBucketLocation", "s3:ListBucket"],
    "Resource": [
    "arn:aws:s3:::LeBucket"
    ]
    },
    {
    "Effect": "Allow",
    "Action": [
    "s3:"
    ],
    "Resource": [
    "arn:aws:s3:::LeBucket/
    "
    ]
    }
    ]
    }

    Pour Read only, remplacer action du deuxieme bloc par "Action": ["s3:Get","s3:List"],

    May 17, 2017 - permalink - https://links.infomee.fr/shaare/Vp7r6Q
    aws iam nomarkdown s3
  • Note: s3 enpoint

    If you enable s3 enpoint in your route table, it's kind of tricky to know if the endpoint is really working. Two things to validate:
    1) traceroute tcp before and after (traceroute -T s3-us-west-1.amazonaws.com 443)
    You will see more hope when endpoint not activated
    2) try an s3 sync cross region with enpoint activated : it should failed since it's not supported (yet @ 2017-05-02)

    May 2, 2017 - permalink - https://links.infomee.fr/shaare/1wF2Kg
    aws enpoint s3
  • s3fs-fuse/s3fs-fuse: FUSE-based file system backed by Amazon S3

    I may have to use this one, but issue number is freaking me out

    March 30, 2017 - permalink - https://github.com/s3fs-fuse/s3fs-fuse
    aws fs s3 s3fs
  • Writing IAM Policies: How to Grant Access to an Amazon S3 Bucket | AWS Security Blog

    Don't give s3 full access policy to your app user
    Prefer to allow access only for specific bucket

    I wonder what's the best choice : create managed policy or simply use inline policy. I got a 1 to 1 relationship between my app-users and bucket so... inline policy looks good here

    March 15, 2017 - permalink - https://aws.amazon.com/blogs/security/writing-iam-policies-how-to-grant-access-to-an-amazon-s3-bucket/
    aws policy s3
  • How to Setup AWS S3 Access from Specific IPs - Pete Cheslock

    {
    "Id": "S3PolicyId1",
    "Statement": [
    {
    "Sid": "IPDeny",
    "Effect": "Deny",
    "Principal": {
    "AWS": ""
    },
    "Action": "s3:
    ",
    "Resource": "arn:aws:s3:::my-wicked-awesome-bucket/*",
    "Condition": {
    "NotIpAddress": {
    "aws:SourceIp": "72.309.38.2/32"
    }
    }
    }
    ]
    }

    December 19, 2016 - permalink - https://pete.wtf/2012/05/01/how-to-setup-aws-s3-access-from-specific-ips/
    aws ip s3
  • Multipart Upload Overview - Amazon Simple Storage Service
    December 8, 2016 - permalink - http://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html
    aws multipart s3
  • minio/mc: Minio Client is a replacement for ls, cp, mkdir, diff and rsync commands for filesystems and object storage.

    via Doo

    September 30, 2016 - permalink - https://github.com/minio/mc
    aws s3