- 新增图像生成接口,支持试用、积分和自定义API Key模式 - 实现生成图片结果异步上传至MinIO存储,带重试机制 - 优化积分预扣除和异常退还逻辑,保障用户积分准确 - 添加获取生成历史记录接口,支持时间范围和分页 - 提供本地字典配置接口,支持模型、比例、提示模板和尺寸 - 实现图片批量上传接口,支持S3兼容对象存储 feat(admin): 增加管理员角色管理与权限分配接口 - 实现角色列表查询、角色创建、更新及删除功能 - 增加权限列表查询接口 - 实现用户角色分配接口,便于统一管理用户权限 - 增加系统字典增删查改接口,支持分类过滤和排序 - 权限控制全面覆盖管理接口,保证安全访问 feat(auth): 完善用户登录注册及权限相关接口与页面 - 实现手机号验证码发送及校验功能,保障注册安全 - 支持手机号注册、登录及退出接口,集成日志记录 - 增加修改密码功能,验证原密码后更新 - 提供动态导航菜单接口,基于权限展示不同菜单 - 实现管理界面路由及日志、角色、字典管理页面访问权限控制 - 添加系统日志查询接口,支持关键词和等级筛选 feat(app): 初始化Flask应用并配置蓝图与数据库 - 创建应用程序工厂,加载配置,初始化数据库和Redis客户端 - 注册认证、API及管理员蓝图,整合路由 - 根路由渲染主页模板 - 应用上下文中自动创建数据库表,保证运行环境准备完毕 feat(database): 提供数据库创建与迁移支持脚本 - 新增数据库创建脚本,支持自动检测是否已存在 - 添加数据库表初始化脚本,支持创建和删除所有表 - 实现RBAC权限初始化,包含基础权限和角色创建 - 新增字段手动修复脚本,添加用户API Key和积分字段 - 强制迁移脚本支持清理连接和修复表结构,初始化默认数据及角色分配 feat(config): 新增系统配置参数 - 配置数据库、Redis、Session和MinIO相关参数 - 添加AI接口地址及试用Key配置 - 集成阿里云短信服务配置及开发模式相关参数 feat(extensions): 初始化数据库、Redis和MinIO客户端 - 创建全局SQLAlchemy数据库实例和Redis客户端 - 配置基于boto3的MinIO兼容S3客户端 chore(logs): 添加示例系统日志文件 - 记录用户请求、验证码发送成功与失败的日志信息
186 lines
5.4 KiB
ReStructuredText
186 lines
5.4 KiB
ReStructuredText
List objects in an Amazon S3 bucket
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
The following example shows how to use an Amazon S3 bucket resource to list
|
|
the objects in the bucket.
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
|
|
s3 = boto3.resource('s3')
|
|
bucket = s3.Bucket('amzn-s3-demo-bucket')
|
|
for obj in bucket.objects.all():
|
|
print(obj.key)
|
|
|
|
|
|
List top-level common prefixes in Amazon S3 bucket
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
This example shows how to list all of the top-level common prefixes in an
|
|
Amazon S3 bucket:
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
|
|
client = boto3.client('s3')
|
|
paginator = client.get_paginator('list_objects')
|
|
result = paginator.paginate(Bucket='amzn-s3-demo-bucket', Delimiter='/')
|
|
for prefix in result.search('CommonPrefixes'):
|
|
print(prefix.get('Prefix'))
|
|
|
|
|
|
Restore Glacier objects in an Amazon S3 bucket
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
The following example shows how to initiate restoration of glacier objects in
|
|
an Amazon S3 bucket, determine if a restoration is on-going, and determine if a
|
|
restoration is finished.
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
|
|
s3 = boto3.resource('s3')
|
|
bucket = s3.Bucket('amzn-s3-demo-bucket')
|
|
for obj_sum in bucket.objects.all():
|
|
obj = s3.Object(obj_sum.bucket_name, obj_sum.key)
|
|
if obj.storage_class == 'GLACIER':
|
|
# Try to restore the object if the storage class is glacier and
|
|
# the object does not have a completed or ongoing restoration
|
|
# request.
|
|
if obj.restore is None:
|
|
print('Submitting restoration request: %s' % obj.key)
|
|
obj.restore_object(RestoreRequest={'Days': 1})
|
|
# Print out objects whose restoration is on-going
|
|
elif 'ongoing-request="true"' in obj.restore:
|
|
print('Restoration in-progress: %s' % obj.key)
|
|
# Print out objects whose restoration is complete
|
|
elif 'ongoing-request="false"' in obj.restore:
|
|
print('Restoration complete: %s' % obj.key)
|
|
|
|
|
|
Uploading/downloading files using SSE KMS
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
This example shows how to use SSE-KMS to upload objects using
|
|
server side encryption with a key managed by KMS.
|
|
|
|
We can either use the default KMS master key, or create a
|
|
custom key in AWS and use it to encrypt the object by passing in its
|
|
key id.
|
|
|
|
With KMS, nothing else needs to be provided for getting the
|
|
object; S3 already knows how to decrypt the object.
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
import os
|
|
|
|
BUCKET = 'amzn-s3-demo-bucket'
|
|
s3 = boto3.client('s3')
|
|
keyid = '<the key id>'
|
|
|
|
print("Uploading S3 object with SSE-KMS")
|
|
s3.put_object(Bucket=BUCKET,
|
|
Key='encrypt-key',
|
|
Body=b'foobar',
|
|
ServerSideEncryption='aws:kms',
|
|
# Optional: SSEKMSKeyId
|
|
SSEKMSKeyId=keyid)
|
|
print("Done")
|
|
|
|
# Getting the object:
|
|
print("Getting S3 object...")
|
|
response = s3.get_object(Bucket=BUCKET,
|
|
Key='encrypt-key')
|
|
print("Done, response body:")
|
|
print(response['Body'].read())
|
|
|
|
|
|
Uploading/downloading files using SSE Customer Keys
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
This example shows how to use SSE-C to upload objects using
|
|
server side encryption with a customer provided key.
|
|
|
|
First, we'll need a 32 byte key. For this example, we'll
|
|
randomly generate a key but you can use any 32 byte key
|
|
you want. Remember, you must the same key to download
|
|
the object. If you lose the encryption key, you lose
|
|
the object.
|
|
|
|
Also note how we don't have to provide the SSECustomerKeyMD5.
|
|
Boto3 will automatically compute this value for us.
|
|
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
import os
|
|
|
|
BUCKET = 'amzn-s3-demo-bucket'
|
|
KEY = os.urandom(32)
|
|
s3 = boto3.client('s3')
|
|
|
|
print("Uploading S3 object with SSE-C")
|
|
s3.put_object(Bucket=BUCKET,
|
|
Key='encrypt-key',
|
|
Body=b'foobar',
|
|
SSECustomerKey=KEY,
|
|
SSECustomerAlgorithm='AES256')
|
|
print("Done")
|
|
|
|
# Getting the object:
|
|
print("Getting S3 object...")
|
|
# Note how we're using the same ``KEY`` we
|
|
# created earlier.
|
|
response = s3.get_object(Bucket=BUCKET,
|
|
Key='encrypt-key',
|
|
SSECustomerKey=KEY,
|
|
SSECustomerAlgorithm='AES256')
|
|
print("Done, response body:")
|
|
print(response['Body'].read())
|
|
|
|
|
|
Downloading a specific version of an S3 object
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
This example shows how to download a specific version of an
|
|
S3 object.
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
s3 = boto3.client('s3')
|
|
|
|
s3.download_file(
|
|
"amzn-s3-demo-bucket", "key-name", "tmp.txt",
|
|
ExtraArgs={"VersionId": "my-version-id"}
|
|
)
|
|
|
|
|
|
Filter objects by last modified time using JMESPath
|
|
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
|
|
|
This example shows how to filter objects by last modified time
|
|
using JMESPath.
|
|
|
|
.. code-block:: python
|
|
|
|
import boto3
|
|
s3 = boto3.client("s3")
|
|
|
|
s3_paginator = s3.get_paginator('list_objects_v2')
|
|
s3_iterator = s3_paginator.paginate(Bucket='amzn-s3-demo-bucket')
|
|
|
|
filtered_iterator = s3_iterator.search(
|
|
"Contents[?to_string(LastModified)>='\"2022-01-05 08:05:37+00:00\"'].Key"
|
|
)
|
|
|
|
for key_data in filtered_iterator:
|
|
print(key_data)
|