Product
MinIO Enterprise Object Store
Overview Architecture
Features
MinIO for Public Cloud
AWS GCS Azure
MinIO for Private Cloud
OpenShift SUSE Rancher Tanzu
MinIO for Baremetal
Linux and Windows
Determine your raw and usable capacity Erasure Code Calculator MinIO's Recommended Hardware Configuration Reference Hardware
Solutions
AI Storage Object storage is powering the AI revolution. Learn how MinIO is leading the AI storage market through performance at scale. Modern Datalakes Modern, multi-engine datalakes depend on object stores that deliver performance at scale. Learn more about this core MinIO use case. Hybrid Cloud Effective multi-cloud storage strategies rely on utilizing architecture and tools that can function seamlessly across diverse environments. Equinix Repatriate your data onto the cloud you control with MinIO on Equinix to lower costs while maintaining public cloud adjacency. Splunk Find out how MinIO is delivering performance at scale for Splunk SmartStores. Snowflake Query and analyze multiple data sources, including streaming data, residing on MinIO with the Snowflake Data Cloud. No need to move the data, just query using SnowSQL. SQL Server Discover how to pair SQL Server 2022 with MinIO to run queries on your data on any cloud - without having to move it. HDFS Migration Modernize and simplify your big data storage infrastructure with high-performance, Kubernetes-native object storage from MinIO. VMware Discover how MinIO integrates with VMware across the portfolio from the Persistent Data platform to TKG and how we support their Kubernetes ambitions. Veeam Learn how MinIO and Veeam have partnered to drive performance and scalability for a variety of backup use cases. Commvault Learn how Commvault and MinIO are partnered to deliver performance at scale for mission critical backup and restore workloads. Integrations Browse our vast portfolio of integrations.
Community
GitHub Join our GitHub open source community: explore, experiment, ask questions, and contribute. Slack Channel The MinIO Community Slack provides an open forum for discussing topics related to MinIO. All support is provided on a best-effort basis.
Docs Blog Resources Training Partner Pricing Download

s3verify — A simple tool to verify AWS S3 API compatibility

MinIO MinIO MinIO on S3

s3verify performs a series of API calls against an object storage server and checks the responses for AWS S3 signature version 4 compatibility. s3verify is licensed under Apache V2.0 license.

Why we built s3verify

Amazon Web Service’s (AWS) Simple Storage Service (S3) has emerged as the goto cloud storage, so any new competing service has a strong incentive to comply with their APIs.

Version 4 of the AWS S3 API has matured and become quite extensive. AWS now supports over 20 different APIs and countless variations on those APIs. It is no longer just simple get/put requests.

Without a tool like s3verify, making frequent high quality releases is nearly impossible. New feature additions and Pull Requests can easily cause regressions and break existing compatibility.

Dependency on other SDKs or libraries could mask bugs. Instead s3verify creates its own handcrafted HTTP requests and sends them to the user specified server.

s3verify’s primary goal is to verify the correctness of the implementation. For each possible valid input the correct response must be returned. It also tests with invalid inputs and expects failures in response. Possible invalid inputs are far too many; however the current invalid inputs are a good start.

Who can use s3verify

s3verify is intended to be used by both application developers and object storage vendors. Applications that are dependent on the AWS S3 API may use s3verify to eliminate bugs introduced by incompatible changes by the cloud storage provider. Object storage vendors are strongly advised to integrate s3verify into their CI to stop incompatible changes from creeping in. s3verify is designed to be easy to be integrated as a part of CI builds.

Install s3verify

Assuming that you have a working Go environment copy/paste the following command to your terminal. If you do not yet have a Go environment follow the instructions here: Install Go.

$ go get -u https://github.com/minio/mint

Conclusion

s3verify is meant to be full and robust. Please feel free to fork our project and contribute any new test or feature. We’d love to see your Pull Request.

Please note that s3verify has been replaced by Mint: https://github.com/minio/mint. Mint is a testing framework for Minio object server, available as a docker image. It runs correctness, benchmarking and stress tests.

For any questions and nice comments join our Slack.

Previous Post Next Post
S3 Select Security Modern Data Lakes Apache Presto SQL Performance S3 Brand/Design Golang Programming Cloud Computing Microservices Docker AWS Kubernetes Apache Spark Open Source Benchmarks Integrations SUBNET Edge Computing Sidekick Secure-by-Design Splunk Veeam Intel Apache Nifi Immutability Software Defined Storage VMware Apache Arrow Hybrid Cloud Red Hat OpenShift Multicloud Scalability Cloud Field Day Cloud Native Apache Kafka Architect's Guide Awards Operator's Guide Security Advisory AI/ML AGPLv3 Apache Hadoop SFD Azure GCP Observability Analytics R H20 DirectPV DevOps Apache Iceberg Apache Hudi YouTube Summaries EKS Elastic Load Balancers CI/CD Object Storage Compliance opentelemetry BC/DR Storage Newsletter Predictions Best Practices Dremio New MinIO Features partners Small Files Databases DuckDB PostgreSQL Delta Lake Cloud Repatriation Python Object Lambdas Data Pipelines Cloud Operating Model Webhook ClickHouse Vector Database Events Value Engineering Change Data Capture Enterprise Object Store GitOps Case Study Equinix