当前位置：首页 > news >正文

专注微信网站建设关键词看片

news 2025/8/6 9:05:50

专注微信网站建设,关键词看片,南京做网站引流的公司,网站建设团队缘起今年(2023年) 2月的时候做了个适配Amazon S3对象存储接口的需求，由于4月份自学考试临近，一直在备考就拖着没总结记录下，开发联调过程中也出现过一些奇葩的问题，最近人刚从考试缓过来顺手记录一下。 S3对象存储的基本概念 …

缘起

今年(2023年) 2月的时候做了个适配Amazon S3对象存储接口的需求，由于4月份自学考试临近，一直在备考就拖着没总结记录下，开发联调过程中也出现过一些奇葩的问题，最近人刚从考试缓过来顺手记录一下。

S3对象存储的基本概念

S3是什么？

Amazon S3(Simple Storage Service)对象存储出现得比较早且使用简单的RESTful API，于是成为了对象存储服务(Object Storage Service，OSS)业内的标准接口规范。

S3的逻辑模型

如下图，我们可以把S3的存储空间想象成无限的，想存储一个任意格式的文件到S3服务中，只需要知道要把它放到哪个桶(Bucket)中，它的名字（Object Id）应该是什么。

按图中的模型，可简单理解为S3是由若干个桶（Bucket）组成，每个桶中包含若干个不同标识的对象（Object），还有就是统一的访问入口(RESTful API)，这样基本就足够了。

Minio客户端方式操作S3

详细API文档：https://min.io/docs/minio/linux/developers/java/API.html

以下代码异常处理做了简化，真实使用时请注意捕获异常做处理。

引入依赖

Maven:

<dependency><groupId>io.minio</groupId><artifactId>minio</artifactId><version>8.5.2</version>
</dependency>

Gradle:

dependencies {implementation("io.minio:minio:8.5.2")
}

初始化客户端

private static final String HTTP_PROTOCOL = "http";private MinioClient minioClient;
private String endpoint = "http://192.168.0.8:9200";
private String accessKey = "testKey";
private String secretKey = "testSecretKey";public void init() throws MalformedURLException {URL endpointUrl = new URL(endpoint);try {// url上无端口号时，识别http为80端口，https为443端口int port = endpointUrl.getPort() != -1 ? endpointUrl.getPort() : endpointUrl.getDefaultPort();boolean security = HTTP_PROTOCOL.equals(endpointUrl.getProtocol()) ? false : true;//@formatter:offthis.minioClient = MinioClient.builder().endpoint(endpointUrl.getHost(), port, security).credentials(accessKey, secretKey).build();//@formatter:on// 忽略证书校验，防止自签名证书校验失败导致无法建立连接this.minioClient.ignoreCertCheck();} catch (Exception e) {e.printStackTrace();}
}

建桶

public boolean createBucket(String bucket) {try {minioClient.makeBucket(MakeBucketArgs.builder().bucket(bucket).build());} catch (Exception e) {e.printStackTrace();return false;}return true;
}

删桶

public boolean deleteBucket(String bucket) {try {minioClient.removeBucket(RemoveBucketArgs.builder().bucket(bucket).build());logger.info("删除桶[{}]成功", bucket);} catch (Exception e) {e.printStackTrace();return false;}return true;
}

判断桶是否存在

public boolean bucketExists(String bucket) {try {return minioClient.bucketExists(BucketExistsArgs.builder().bucket(bucket).build());} catch (Exception e) {e.printStackTrace();return false;}
}

上传对象

public void upload(String bucket, String objectId, InputStream input) {try {//@formatter:offminioClient.putObject(PutObjectArgs.builder().bucket(bucket).object(objectId).stream(input, input.available(), -1).build());//@formatter:on} catch (Exception e) {e.printStackTrace();}
}

下载对象

提供两个下载方法，一个将输入流返回，另一个用参数输出流写出

public InputStream download(String bucket, String objectId) {try {return minioClient.getObject(GetObjectArgs.builder().bucket(bucket).object(objectId).build());} catch (Exception e) {e.printStackTrace();}return null;
}public void download(String bucket, String objectId, OutputStream output) {//@formatter:offtry (InputStream input = minioClient.getObject(GetObjectArgs.builder().bucket(bucket).object(objectId).build())) {IOUtils.copyLarge(input, output);} catch (Exception e) {e.printStackTrace();}//@formatter:on
}

删除对象

public boolean deleteObject(String bucket, String objectId) {//@formatter:offtry {minioClient.removeObject(RemoveObjectArgs.builder().bucket(bucket).object(objectId).build());} catch (Exception e) {e.printStackTrace();}//@formatter:onreturn true;
}

判断对象是否存在

public boolean objectExists(String bucket, String key) {//@formatter:offtry {// minio客户端未提供判断对象是否存在的方法，此方法中调用出现异常时说明对象不存在minioClient.statObject(StatObjectArgs.builder().bucket(bucket).object(key).build());} catch (Exception e) {return false;}//@formatter:onreturn true;
}

完整代码

import java.io.InputStream;
import java.io.OutputStream;
import java.net.MalformedURLException;
import java.net.URL;import org.apache.tomcat.util.http.fileupload.IOUtils;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;import io.minio.BucketExistsArgs;
import io.minio.GetObjectArgs;
import io.minio.MakeBucketArgs;
import io.minio.MinioClient;
import io.minio.PutObjectArgs;
import io.minio.RemoveBucketArgs;
import io.minio.RemoveObjectArgs;
import io.minio.StatObjectArgs;public class S3MinioClientDemo {private static final Logger logger = LoggerFactory.getLogger(S3MinioClientDemo.class);private static final String HTTP_PROTOCOL = "http";private MinioClient minioClient;private String endpoint = "http://192.168.0.8:9200";private String accessKey = "testKey";private String secretKey = "testSecretKey";public void init() throws MalformedURLException {URL endpointUrl = new URL(endpoint);try {// url上无端口号时，识别http为80端口，https为443端口int port = endpointUrl.getPort() != -1 ? endpointUrl.getPort() : endpointUrl.getDefaultPort();boolean security = HTTP_PROTOCOL.equals(endpointUrl.getProtocol()) ? false : true;//@formatter:offthis.minioClient = MinioClient.builder().endpoint(endpointUrl.getHost(), port, security).credentials(accessKey, secretKey).build();//@formatter:on// 忽略证书校验，防止自签名证书校验失败导致无法建立连接this.minioClient.ignoreCertCheck();} catch (Exception e) {e.printStackTrace();}}public boolean createBucket(String bucket) {try {boolean found = minioClient.bucketExists(BucketExistsArgs.builder().bucket(bucket).build());if (found) {logger.info("桶名[{}]已存在", bucket);return false;}minioClient.makeBucket(MakeBucketArgs.builder().bucket(bucket).build());} catch (Exception e) {e.printStackTrace();}return true;}public boolean deleteBucket(String bucket) {try {minioClient.removeBucket(RemoveBucketArgs.builder().bucket(bucket).build());logger.info("删除桶[{}]成功", bucket);} catch (Exception e) {e.printStackTrace();return false;}return true;}public boolean bucketExists(String bucket) {try {return minioClient.bucketExists(BucketExistsArgs.builder().bucket(bucket).build());} catch (Exception e) {e.printStackTrace();return false;}}public void upload(String bucket, String objectId, InputStream input) {try {//@formatter:offminioClient.putObject(PutObjectArgs.builder().bucket(bucket).object(objectId).stream(input, input.available(), -1).build());//@formatter:on} catch (Exception e) {e.printStackTrace();}}public InputStream download(String bucket, String objectId) {try {return minioClient.getObject(GetObjectArgs.builder().bucket(bucket).object(objectId).build());} catch (Exception e) {e.printStackTrace();}return null;}public void download(String bucket, String objectId, OutputStream output) {//@formatter:offtry (InputStream input = minioClient.getObject(GetObjectArgs.builder().bucket(bucket).object(objectId).build())) {IOUtils.copyLarge(input, output);} catch (Exception e) {e.printStackTrace();}//@formatter:on}public boolean objectExists(String bucket, String objectId) {//@formatter:offtry {// minio客户端未提供判断对象是否存在的方法，此方法中调用出现异常时说明对象不存在minioClient.statObject(StatObjectArgs.builder().bucket(bucket).object(objectId).build());} catch (Exception e) {return false;}//@formatter:onreturn true;}public boolean deleteObject(String bucket, String objectId) {//@formatter:offtry {minioClient.removeObject(RemoveObjectArgs.builder().bucket(bucket).object(objectId).build());} catch (Exception e) {e.printStackTrace();}//@formatter:onreturn true;}public void close() {minioClient = null;}}

Amazon S3 SDK方式操作S3

官方API文档：https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html

这里由于项目上提供的SDK和文档都是1.x的，这里就暂时只提供1.x的代码