SpringBoot集成AWS S3 生成预签名url进行上传文件到S3_amazons3.generatepresignedurl_小诺大人的博客

link之家
链接快照平台
输入网页链接，自动生成快照
标签化管理网页链接
service接口层

* 预签名上传文件 * @param bucket bucket * @param fileName 文件名 * @return {@link PreUploadRes} 上传连接和key在这里插入代码片 PreUploadRes preUploadFile ( String bucket , String fileName ) ; * 将文件上传到s3 * @param bucket 桶 * @param file 文件 * @return {@link AwsS3UploadFileResDto} public AwsS3UploadFileResDto uploadFileToS3 ( String bucket , MultipartFile file ) ;
service实现层

预签名url生成

使用postman进行请求后获得url
通过生成的预签名url进行上传到S3，返回200则说明文件上传成功了！
然后通过CDN映射到S3的域名进行访问，或者直接访问S3，可以查看文件。
其他方法（可以参考着用）

在这里插入代码片
 * AwsS3 服务实现
 * @author yunnuo
 * @date 2022-04-14
 * @since 1.0
@Slf4j
@Service
public class AwsS3ServiceImpl implements AwsS3Service {
    private final ConfigCenter configCenter;
    private static final String OPS_PREFIX = "ops";
    public AwsS3ServiceImpl(ConfigCenter configCenter) {
        this.configCenter = configCenter;
    @Override
    public List<AwsS3UploadFileResDto> uploadFilesToS3(String bucket, List<MultipartFile> files) {
        log.info("start upload files to s3 files size:{}", files.size());
        if (CollUtil.isEmpty(files)) {
            log.warn("upload to s3 files is must be nut null!");
            throw new ServiceException(ErrorCode.FILE_IS_EMPTY);
        return files.stream().filter(Objects::nonNull).map(file -> uploadFileToS3(bucket, file)).collect(Collectors.toList());
    @Override
    public PreUploadRes preUploadFile(String prefix) {
        PreUploadRes res = new PreUploadRes();
        try {
            Optional<List<GpLandPageConfigDto>> s3config = configCenter.getDataWithType2(GpLandPageConstant.CONFIG_KEY, GpLandPageConfigDto.class);
            s3config.flatMap(configs -> configs.stream().findFirst()).ifPresent(config -> {
                AmazonS3 amazonS3 = s3client();
                String fastFileName = getFileKey(prefix);
                // 往后1小时
                DateTime expiration = DateUtil.offsetHour(new Date(), 1);
                URL url = amazonS3.generatePresignedUrl(new GeneratePresignedUrlRequest(config.getS3Bucket(), fastFileName).withExpiration(expiration).withMethod(HttpMethod.PUT));
                res.setKey(config.getCdnPrefix() + "/" + fastFileName).setUrl(url.toString());
                log.info("Generate preUrl Request is success :{}", JSONUtil.toJsonStr(res));
            });
        } catch (Exception e) {
            log.error("Generate preUrl Request is failure :{}", e.getMessage(), e);
            throw new ServiceException(ErrorCode.CONNECT_S3_FAILED);
        return res;
    @Override
    public AwsS3UploadFileResDto uploadFileToS3(String bucket, MultipartFile file) {
        String fastFileName = getFileKey(file.getOriginalFilename());
        try {
            PutObjectRequest request = new PutObjectRequest(bucket, fastFileName, file.getInputStream(), null);
            ObjectMetadata metadata = new ObjectMetadata();
            metadata.setContentType(file.getContentType());
            request.setMetadata(metadata);
            PutObjectResult putObjectResult = s3client().putObject(request);
//            String url = getUrlFor7Day(bucket, fastFileName);
            GpLandPageConfigDto config = getConfig();
            String url = config.getCdnPrefix() + "/" + fastFileName;
            log.info("upload to s3 bucket:{} file:{} url:{} is success ! ===> putRes:{}", bucket, fastFileName, url, JSONUtil.toJsonStr(putObjectResult));
            AwsS3UploadFileResDto awsS3UploadFileResDto = new AwsS3UploadFileResDto().setS3PutRes(putObjectResult);
            awsS3UploadFileResDto.setFileName(fastFileName);
            awsS3UploadFileResDto.setBucketName(bucket);
            awsS3UploadFileResDto.setFileUrl(url);
            return awsS3UploadFileResDto;
        } catch (Exception e) {
            log.error("upload original file:{}, fastFileName:{} to S3 is Error:{}", file.getName(), fastFileName, e.getMessage());
            throw new ServiceException(ErrorCode.CONNECT_S3_FAILED);
    private GpLandPageConfigDto getConfig() {
        GpLandPageConfigDto landPageConfigDto = new GpLandPageConfigDto();
        configCenter.getDataWithType2(GpLandPageConstant.CONFIG_KEY, GpLandPageConfigDto.class).flatMap(configs -> configs.stream().findFirst()).ifPresent(config -> BeanUtil.copyProperties(config, landPageConfigDto));
        if (StringUtils.isBlank(landPageConfigDto.getS3Bucket())) {
            throw new ServiceException(ErrorCode.CONFIG_CENTER_CONFIG_EMPTY);
        return landPageConfigDto;
     * s3client
     * @return {@link AmazonS3}
    public AmazonS3 s3client() {
        try {
            AtomicReference<AmazonS3> res = new AtomicReference<>();
            Optional<List<GpLandPageConfigDto>> s3config = configCenter.getDataWithType2(GpLandPageConstant.CONFIG_KEY, GpLandPageConfigDto.class);
            s3config.flatMap(configs -> configs.stream().findFirst()).ifPresent(config -> {
                Regions regions = Regions.fromName(config.getRegions());
                res.set(AmazonS3ClientBuilder.standard().withCredentials(new AWSStaticCredentialsProvider(new BasicAWSCredentials(config.getS3AccessKeyId(), config.getS3SecretAccessKey()))).withRegion(regions).build());
            });
            if (Objects.isNull(res.get())) {
                log.warn("connect S3 Server is failure , please check your config param!");
                throw new ServiceException(ErrorCode.CONNECT_S3_FAILED);
            return res.get();
        } catch (ServiceException | IllegalArgumentException e) {
            log.warn("Failed to connect to S3 server e:{}", e.getMessage(), e);
            throw new ServiceException(ErrorCode.CONNECT_S3_FAILED);
    @Override
    public InputStream downloadFile(String bucketName, String fileKey) {
        AmazonS3 s3client = s3client();
        GetObjectRequest request = new GetObjectRequest(bucketName, fileKey);
        S3Object response = s3client.getObject(request);
        return response.getObjectContent();
    @Override
    public void deleteFile(String bucketName, String fileKey) {
        log.info("delete S3 file bucketName:{}, fileKey:{}", bucketName, fileKey);
        AmazonS3 s3client = s3client();
        DeleteObjectRequest request = new DeleteObjectRequest(bucketName, fileKey);
        s3client.deleteObject(request);
    @Override
    public void deleteFiles(String bucketName, List<String> fileKeys) {
        if (StringUtils.isBlank(bucketName) || CollUtil.isEmpty(fileKeys)) {
            log.warn("bucketName or fileKeys");
        AmazonS3 s3client = s3client();
        DeleteObjectsRequest deleteObjectsRequest = new DeleteObjectsRequest(bucketName).withKeys(StringUtils.join(fileKeys, ","));
        DeleteObjectsResult deleteObjectsResult = s3client.deleteObjects(deleteObjectsRequest);
        log.info("S3 deleteObjectsResult:{}", JSONUtil.toJsonStr(deleteObjectsResult));
    @Override
    public List<Bucket> listFile() {
        AmazonS3 s3client = s3client();
        ListBucketsRequest request = new ListBucketsRequest();
        return s3client.listBuckets(request);
    @Override
    public boolean isExistBucket(String bucketName) {
        AmazonS3 s3client = s3client();
        try {
            HeadBucketRequest request = new HeadBucketRequest(bucketName);
            s3client.headBucket(request);
        } catch (Exception e) {
            return false;
        return true;
    @Override
    public void createBucket(String bucketName) {
        boolean isBucketExists = isExistBucket(bucketName);
        AmazonS3 s3client;
        if (!isBucketExists) {
            s3client = s3client();
            CreateBucketRequest request = new CreateBucketRequest(bucketName);
            s3client.createBucket(request);
    @Override
    public void deleteBucket(String bucketName) {
        AmazonS3 s3client = s3client();
        DeleteBucketRequest request = new DeleteBucketRequest(bucketName);
        s3client.deleteBucket(request);
    @Override
    public boolean isExistFileKey(String bucketName, String fileKey) {
        AmazonS3 s3client = s3client();
        GetObjectRequest request = new GetObjectRequest(bucketName, fileKey);
        S3Object response = s3client.getObject(request);
        return response != null && fileKey.equals(response.getKey());
    @Override
    public String getUrlFor7Day(String bucketName, String fileKey) {
        GeneratePresignedUrlRequest urlRequest = new GeneratePresignedUrlRequest(bucketName, fileKey);
        // 往后7天
        DateTime offset = DateUtil.offsetDay(new Date(), 7);
        urlRequest.setExpiration(offset);
        urlRequest.setMethod(HttpMethod.GET);
        URL url = s3client().generatePresignedUrl(urlRequest);
        return url.toString();
    @Override
    public String getFileKey(String fileName) {
        String uuid = UUID.randomUUID().toString().replaceAll("-", "");
        String dateDir = new SimpleDateFormat("yyyyMMdd").format(new Date());
        return String.format("%s/%s/%s_%s", OPS_PREFIX, dateDir, uuid, fileName);
    @Override
    public S3FileInfoDto getFileInfoByUrl(String url) {
        String urlPreFix = url.substring(url.indexOf("//") + 2);
        GpLandPageConfigDto config = getConfig();
        String bucket = config.getS3Bucket();
        String fileName = urlPreFix.substring(urlPreFix.indexOf('/') + 1);
        return new S3FileInfoDto(fileName, bucket, url);
S3工具类
 
AWS S3 Util
 
https://blog.csdn.net/ayunnuo/article/details/127211608 
OCI S3 Util
 
https://blog.csdn.net/ayunnuo/article/details/127212315
                    然后通过CDN映射到S3的域名进行访问，或者直接访问S3，可以查看文件。通过生成的预签名url进行上传到S3，返回200则说明文件上传成功了！使用postman进行请求后获得url。
				S3通过签名来完成对像的访问控制
S3（Amazon Simple Storage Service）是一种对象存储服务，提供可扩展性、数据可用性、安全性和性能。S3 可达到 99.999999999%（11 个 9）的持久性。客户使用 S3 作为云原生应用程序的主要存储；作为分析的批量存储库或“数据湖”；作为备份和恢复以及灾难恢复的目标；并将其与无服务器计算配合使用。
现在越来越多的客户使用S3作...
				FasterS3Url
 在ruby中更快地生成公共和预签名的AWS S3 GET URL
 当生成用于访问S3对象的URL时，官方的实际上非常慢且未优化。 如果一次只创建几个S3 URL，则可能没有关系。 但这一次甚至可能影响两三百，尤其是在创建预先签名的URL时，AWS SDK并未对此进行特别优化。
 对于公共和预签名的S3 GET URL，此gem提供了一个快得多的实现方式（大约一个数量级）。 预签名的URL支持其他S3参数，例如response-content-disposition 。
signer = FasterS3Url :: Builder . new (
  bucket_name : "my-bucket" ,
  region : "us-east-1" ,
  access_key_id : ENV [ 'AWS_ACCESS_KEY' ] ,
    @GetMapping("/uploadFile")
    public Object generatePreSignedUrlAndUploadObject(String fileName){
        Map<St.
				idea连接mysql报错： No appropriate protocol (protocol is disabled or cipher suites are inappropriate（已解决）
					34686
				执行nrm报错 internal/validators.js:124  throw new ERR_INVALID_ARG_TYPE(name, ‘string‘, value)；
					11359
                idea连接mysql报错： No appropriate protocol (protocol is disabled or cipher suites are inappropriate（已解决）
                    小诺大人: 
                    大哥， 你这礼太重， 我受不起啊
                idea连接mysql报错： No appropriate protocol (protocol is disabled or cipher suites are inappropriate（已解决）
                    w123456000000: 
                    大佬啊我爱你困扰我一周了死活连不上啊所有东西都重装一遍了还连不上我真的要给你跪下了
                idea连接mysql报错： No appropriate protocol (protocol is disabled or cipher suites are inappropriate（已解决）
                    yemini: 
                    谢谢您  折磨我很久的问题终于解决了