4259 links
  • Arnaud's links
  • Home
  • RSS Feed
  • Tag cloud
  • Login
search: tag:s3 — newest first
  • Bucket - ACK
    February 12, 2024 - permalink - https://aws-controllers-k8s.github.io/community/reference/s3/v1alpha1/bucket/
    ack aws s3
  • Bucket - upbound/provider-aws-s3@v1.0.0
    February 12, 2024 - permalink - https://marketplace.upbound.io/providers/upbound/provider-aws-s3/v1.0.0/resources/s3.aws.upbound.io/Bucket/v1beta1#doc:spec-forProvider-forceDestroy
    crossplane s3
  • Working with presigned URLs - Amazon Simple Storage Service

    If you created a presigned URL by using a temporary token, then the URL expires when the token expires, even if you created the URL with a later expiration time. For more information about how the credentials you use affect the expiration time, see Who can create a presigned URL.

    So you have to use regular IAM user instead of IAM role for service generating presigned urls..? :-/

    August 12, 2023 - permalink - https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-presigned-url.html#who-presigned-url
    aws iam presigned s3
  • GitHub - pottava/aws-s3-proxy: Reverse proxy for AWS S3 with basic authentication.
    August 4, 2022 - permalink - https://github.com/pottava/aws-s3-proxy
    browser proxy s3
  • Provide cross-account access to objects in Amazon S3 objects
    May 10, 2022 - permalink - https://aws.amazon.com/premiumsupport/knowledge-center/cross-account-access-s3/
    cross s3
  • Sharing an object with a presigned URL - Amazon Simple Storage Service
    August 11, 2021 - permalink - https://docs.aws.amazon.com/AmazonS3/latest/userguide/ShareObjectPreSignedURL.html
    aws s3 share
  • GitHub - kahing/goofys: a high-performance, POSIX-ish Amazon S3 file system written in Go
    January 6, 2020 - permalink - https://github.com/kahing/goofys
    s3 s3fs
  • Access S3 using Pyspark by assuming an AWS role. - Leyth Gorgeis - Medium
    January 3, 2020 - permalink - https://medium.com/@leythg/access-s3-using-pyspark-by-assuming-an-aws-role-9558dbef0b9e
    aws role s3 spark
  • Amazon S3 Path Deprecation Plan – The Rest of the Story | AWS News Blog
    May 9, 2019 - permalink - https://aws.amazon.com/fr/blogs/aws/amazon-s3-path-deprecation-plan-the-rest-of-the-story/
    aws s3
  • crunchyroll/evs-s3helper: CXOPS-792 This will be deployed on the vod service alongside nginx to manage instance credentials.

    via Philippe

    December 13, 2018 - permalink - https://github.com/crunchyroll/evs-s3helper
    go s3
  • How Do I Create a Lifecycle Policy for an S3 Bucket? - Amazon Simple Storage Service

    To apply this lifecycle rule to all objects in the bucket, choose Next.

    That's why wildcard was not working :D

    September 22, 2017 - permalink - http://docs.aws.amazon.com/AmazonS3/latest/user-guide/create-lifecycle.html
    aws policy s3
  • Note: Count object in bucket/folder

    aws s3 ls s3://bucket/path/ --recursive --summarize | grep "Total Objects:"

    July 12, 2017 - permalink - https://links.infomee.fr/shaare/rcG0hg
    aws count s3
  • Amazon Glacier Direct Upload vs Glacier Upload via Amazon S3

    So you can put your data into glacier with 2 differents ways:
    1) directly to glacier via API
    2) Store them to s3 then with a management policy, it'll go to Glacier

    Warning : Huge cost when you download from glacier and when you delete before 3 months

    June 27, 2017 - permalink - https://www.cloudberrylab.com/blog/compare-amazon-glacier-direct-upload-and-glacier-upload-through-amazon-s3/
    aws glacier s3
  • Note: s3 bucket size by api

    aws s3api list-objects --bucket BUCKET_NAME --output json --query "[sum(Contents[].Size), length(Contents[])]"

    Retourne la taille en bytes et le nombre d'objets

    Avec un ficheir qui contient le nom des bucket :

    for BUCKET_NAME in $(cat s3list); do echo -n "$BUCKET_NAME " ; region=$(aws s3api get-bucket-location --bucket $BUCKET_NAME|jq '.LocationConstraint' -r); aws s3api list-objects --region $region --bucket $BUCKET_NAME --output json --query "sum(Contents[].Size)"; done

    June 13, 2017 - permalink - https://links.infomee.fr/shaare/pbKktw
    s3 size
  • Example 2: Bucket Owner Granting Cross-Account Bucket Permissions - Amazon Simple Storage Service

    Donc pour autoriser un compte externe, on va créer une bucket policy sur notre bucket pour autoriser "arn:aws:iam::account_id:root" ou plus précis sur l'user arn:aws:iam::account_id:user/foobar ou le role

    C'est le compte en face qui va décider qui a le droit de venir sur notre bucket avec des user policy standard (quand on est dans le contexte du compte en face, c'est comme si le bucket nous appartenait)

    Exemple bucket policy à mettre sur le BUCKET de l'account A pour autoriser l'account xxx en RW

    {
    "Version": "2012-10-17",
    "Statement": [

        {
            "Sid": "Allow account_xx on aws account xxx RW",
            "Effect": "Allow",
            "Principal": {
                "AWS": "arn:aws:iam::OTHER_ACCOUNT_ID:root"
            },
            "Action": ["s3:GetBucketLocation", "s3:ListBucket"],
            "Resource": "arn:aws:s3:::BUCKET"
        },
        {
            "Sid": "Allow account_xx on aws account xxx RW",
            "Effect": "Allow",
            "Principal": {
                "AWS": "arn:aws:iam::OTHER_ACCOUNT_ID:root"
            },
            "Action": [
                "s3:*"
            ],
            "Resource": "arn:aws:s3:::BUCKET/*"
        }
    
    
    
    
    ]
    

    }

    Pour Read only, remplacer action du deuxieme bloc par "Action": ["s3:Get","s3:List"],

    June 12, 2017 - permalink - http://docs.aws.amazon.com/AmazonS3/latest/dev/example-walkthroughs-managing-access-example2.html
    aws cross iam nomarkdown policy s3
  • Copy between S3 buckets w/ different accounts · GitHub
    June 8, 2017 - permalink - https://gist.github.com/ushu/7217693
    aws s3
  • Amazon S3 :: How to set Public read permission to Selected folder

    all item in one folder public

    May 31, 2017 - permalink - http://support.bucketexplorer.com/topic1995.html
    s3
  • Note: s3 policy one bucket

    ReadWrite :

    {
    "Version": "2012-10-17",
    "Statement": [
    {
    "Effect": "Allow",
    "Action": ["s3:GetBucketLocation", "s3:ListBucket"],
    "Resource": [
    "arn:aws:s3:::LeBucket"
    ]
    },
    {
    "Effect": "Allow",
    "Action": [
    "s3:"
    ],
    "Resource": [
    "arn:aws:s3:::LeBucket/
    "
    ]
    }
    ]
    }

    Pour Read only, remplacer action du deuxieme bloc par "Action": ["s3:Get","s3:List"],

    May 17, 2017 - permalink - https://links.infomee.fr/shaare/Vp7r6Q
    aws iam nomarkdown s3
  • Note: s3 enpoint

    If you enable s3 enpoint in your route table, it's kind of tricky to know if the endpoint is really working. Two things to validate:
    1) traceroute tcp before and after (traceroute -T s3-us-west-1.amazonaws.com 443)
    You will see more hope when endpoint not activated
    2) try an s3 sync cross region with enpoint activated : it should failed since it's not supported (yet @ 2017-05-02)

    May 2, 2017 - permalink - https://links.infomee.fr/shaare/1wF2Kg
    aws enpoint s3
  • s3fs-fuse/s3fs-fuse: FUSE-based file system backed by Amazon S3

    I may have to use this one, but issue number is freaking me out

    March 30, 2017 - permalink - https://github.com/s3fs-fuse/s3fs-fuse
    aws fs s3 s3fs
  • IAM Policies and Bucket Policies and ACLs! Oh, My! (Controlling Access to S3 Resources) | AWS Security Blog

    Easy one?
    Not even close

    March 24, 2017 - permalink - https://aws.amazon.com/blogs/security/iam-policies-and-bucket-policies-and-acls-oh-my-controlling-access-to-s3-resources/
    iam policy s3
  • Writing IAM Policies: How to Grant Access to an Amazon S3 Bucket | AWS Security Blog

    Don't give s3 full access policy to your app user
    Prefer to allow access only for specific bucket

    I wonder what's the best choice : create managed policy or simply use inline policy. I got a 1 to 1 relationship between my app-users and bucket so... inline policy looks good here

    March 15, 2017 - permalink - https://aws.amazon.com/blogs/security/writing-iam-policies-how-to-grant-access-to-an-amazon-s3-bucket/
    aws policy s3
  • How to Setup AWS S3 Access from Specific IPs - Pete Cheslock

    {
    "Id": "S3PolicyId1",
    "Statement": [
    {
    "Sid": "IPDeny",
    "Effect": "Deny",
    "Principal": {
    "AWS": ""
    },
    "Action": "s3:
    ",
    "Resource": "arn:aws:s3:::my-wicked-awesome-bucket/*",
    "Condition": {
    "NotIpAddress": {
    "aws:SourceIp": "72.309.38.2/32"
    }
    }
    }
    ]
    }

    December 19, 2016 - permalink - https://pete.wtf/2012/05/01/how-to-setup-aws-s3-access-from-specific-ips/
    aws ip s3
  • Multipart Upload Overview - Amazon Simple Storage Service
    December 8, 2016 - permalink - http://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html
    aws multipart s3
  • minio/mc: Minio Client is a replacement for ls, cp, mkdir, diff and rsync commands for filesystems and object storage.

    via Doo

    September 30, 2016 - permalink - https://github.com/minio/mc
    aws s3