- 新增图像生成接口,支持试用、积分和自定义API Key模式 - 实现生成图片结果异步上传至MinIO存储,带重试机制 - 优化积分预扣除和异常退还逻辑,保障用户积分准确 - 添加获取生成历史记录接口,支持时间范围和分页 - 提供本地字典配置接口,支持模型、比例、提示模板和尺寸 - 实现图片批量上传接口,支持S3兼容对象存储 feat(admin): 增加管理员角色管理与权限分配接口 - 实现角色列表查询、角色创建、更新及删除功能 - 增加权限列表查询接口 - 实现用户角色分配接口,便于统一管理用户权限 - 增加系统字典增删查改接口,支持分类过滤和排序 - 权限控制全面覆盖管理接口,保证安全访问 feat(auth): 完善用户登录注册及权限相关接口与页面 - 实现手机号验证码发送及校验功能,保障注册安全 - 支持手机号注册、登录及退出接口,集成日志记录 - 增加修改密码功能,验证原密码后更新 - 提供动态导航菜单接口,基于权限展示不同菜单 - 实现管理界面路由及日志、角色、字典管理页面访问权限控制 - 添加系统日志查询接口,支持关键词和等级筛选 feat(app): 初始化Flask应用并配置蓝图与数据库 - 创建应用程序工厂,加载配置,初始化数据库和Redis客户端 - 注册认证、API及管理员蓝图,整合路由 - 根路由渲染主页模板 - 应用上下文中自动创建数据库表,保证运行环境准备完毕 feat(database): 提供数据库创建与迁移支持脚本 - 新增数据库创建脚本,支持自动检测是否已存在 - 添加数据库表初始化脚本,支持创建和删除所有表 - 实现RBAC权限初始化,包含基础权限和角色创建 - 新增字段手动修复脚本,添加用户API Key和积分字段 - 强制迁移脚本支持清理连接和修复表结构,初始化默认数据及角色分配 feat(config): 新增系统配置参数 - 配置数据库、Redis、Session和MinIO相关参数 - 添加AI接口地址及试用Key配置 - 集成阿里云短信服务配置及开发模式相关参数 feat(extensions): 初始化数据库、Redis和MinIO客户端 - 创建全局SQLAlchemy数据库实例和Redis客户端 - 配置基于boto3的MinIO兼容S3客户端 chore(logs): 添加示例系统日志文件 - 记录用户请求、验证码发送成功与失败的日志信息
260 lines
9.5 KiB
Python
260 lines
9.5 KiB
Python
"""Base implementation."""
|
|
|
|
import asyncio
|
|
import collections
|
|
import contextlib
|
|
import functools
|
|
import itertools
|
|
import socket
|
|
from typing import List, Optional, Sequence, Set, Union
|
|
|
|
from . import _staggered
|
|
from .types import AddrInfoType, SocketFactoryType
|
|
|
|
|
|
async def start_connection(
|
|
addr_infos: Sequence[AddrInfoType],
|
|
*,
|
|
local_addr_infos: Optional[Sequence[AddrInfoType]] = None,
|
|
happy_eyeballs_delay: Optional[float] = None,
|
|
interleave: Optional[int] = None,
|
|
loop: Optional[asyncio.AbstractEventLoop] = None,
|
|
socket_factory: Optional[SocketFactoryType] = None,
|
|
) -> socket.socket:
|
|
"""
|
|
Connect to a TCP server.
|
|
|
|
Create a socket connection to a specified destination. The
|
|
destination is specified as a list of AddrInfoType tuples as
|
|
returned from getaddrinfo().
|
|
|
|
The arguments are, in order:
|
|
|
|
* ``family``: the address family, e.g. ``socket.AF_INET`` or
|
|
``socket.AF_INET6``.
|
|
* ``type``: the socket type, e.g. ``socket.SOCK_STREAM`` or
|
|
``socket.SOCK_DGRAM``.
|
|
* ``proto``: the protocol, e.g. ``socket.IPPROTO_TCP`` or
|
|
``socket.IPPROTO_UDP``.
|
|
* ``canonname``: the canonical name of the address, e.g.
|
|
``"www.python.org"``.
|
|
* ``sockaddr``: the socket address
|
|
|
|
This method is a coroutine which will try to establish the connection
|
|
in the background. When successful, the coroutine returns a
|
|
socket.
|
|
|
|
The expected use case is to use this method in conjunction with
|
|
loop.create_connection() to establish a connection to a server::
|
|
|
|
socket = await start_connection(addr_infos)
|
|
transport, protocol = await loop.create_connection(
|
|
MyProtocol, sock=socket, ...)
|
|
"""
|
|
if not (current_loop := loop):
|
|
current_loop = asyncio.get_running_loop()
|
|
|
|
single_addr_info = len(addr_infos) == 1
|
|
|
|
if happy_eyeballs_delay is not None and interleave is None:
|
|
# If using happy eyeballs, default to interleave addresses by family
|
|
interleave = 1
|
|
|
|
if interleave and not single_addr_info:
|
|
addr_infos = _interleave_addrinfos(addr_infos, interleave)
|
|
|
|
sock: Optional[socket.socket] = None
|
|
# uvloop can raise RuntimeError instead of OSError
|
|
exceptions: List[List[Union[OSError, RuntimeError]]] = []
|
|
if happy_eyeballs_delay is None or single_addr_info:
|
|
# not using happy eyeballs
|
|
for addrinfo in addr_infos:
|
|
try:
|
|
sock = await _connect_sock(
|
|
current_loop,
|
|
exceptions,
|
|
addrinfo,
|
|
local_addr_infos,
|
|
None,
|
|
socket_factory,
|
|
)
|
|
break
|
|
except (RuntimeError, OSError):
|
|
continue
|
|
else: # using happy eyeballs
|
|
open_sockets: Set[socket.socket] = set()
|
|
try:
|
|
sock, _, _ = await _staggered.staggered_race(
|
|
(
|
|
functools.partial(
|
|
_connect_sock,
|
|
current_loop,
|
|
exceptions,
|
|
addrinfo,
|
|
local_addr_infos,
|
|
open_sockets,
|
|
socket_factory,
|
|
)
|
|
for addrinfo in addr_infos
|
|
),
|
|
happy_eyeballs_delay,
|
|
)
|
|
finally:
|
|
# If we have a winner, staggered_race will
|
|
# cancel the other tasks, however there is a
|
|
# small race window where any of the other tasks
|
|
# can be done before they are cancelled which
|
|
# will leave the socket open. To avoid this problem
|
|
# we pass a set to _connect_sock to keep track of
|
|
# the open sockets and close them here if there
|
|
# are any "runner up" sockets.
|
|
for s in open_sockets:
|
|
if s is not sock:
|
|
with contextlib.suppress(OSError):
|
|
s.close()
|
|
open_sockets = None # type: ignore[assignment]
|
|
|
|
if sock is None:
|
|
all_exceptions = [exc for sub in exceptions for exc in sub]
|
|
try:
|
|
first_exception = all_exceptions[0]
|
|
if len(all_exceptions) == 1:
|
|
raise first_exception
|
|
else:
|
|
# If they all have the same str(), raise one.
|
|
model = str(first_exception)
|
|
if all(str(exc) == model for exc in all_exceptions):
|
|
raise first_exception
|
|
# Raise a combined exception so the user can see all
|
|
# the various error messages.
|
|
msg = "Multiple exceptions: {}".format(
|
|
", ".join(str(exc) for exc in all_exceptions)
|
|
)
|
|
# If the errno is the same for all exceptions, raise
|
|
# an OSError with that errno.
|
|
if isinstance(first_exception, OSError):
|
|
first_errno = first_exception.errno
|
|
if all(
|
|
isinstance(exc, OSError) and exc.errno == first_errno
|
|
for exc in all_exceptions
|
|
):
|
|
raise OSError(first_errno, msg)
|
|
elif isinstance(first_exception, RuntimeError) and all(
|
|
isinstance(exc, RuntimeError) for exc in all_exceptions
|
|
):
|
|
raise RuntimeError(msg)
|
|
# We have a mix of OSError and RuntimeError
|
|
# so we have to pick which one to raise.
|
|
# and we raise OSError for compatibility
|
|
raise OSError(msg)
|
|
finally:
|
|
all_exceptions = None # type: ignore[assignment]
|
|
exceptions = None # type: ignore[assignment]
|
|
|
|
return sock
|
|
|
|
|
|
async def _connect_sock(
|
|
loop: asyncio.AbstractEventLoop,
|
|
exceptions: List[List[Union[OSError, RuntimeError]]],
|
|
addr_info: AddrInfoType,
|
|
local_addr_infos: Optional[Sequence[AddrInfoType]] = None,
|
|
open_sockets: Optional[Set[socket.socket]] = None,
|
|
socket_factory: Optional[SocketFactoryType] = None,
|
|
) -> socket.socket:
|
|
"""
|
|
Create, bind and connect one socket.
|
|
|
|
If open_sockets is passed, add the socket to the set of open sockets.
|
|
Any failure caught here will remove the socket from the set and close it.
|
|
|
|
Callers can use this set to close any sockets that are not the winner
|
|
of all staggered tasks in the result there are runner up sockets aka
|
|
multiple winners.
|
|
"""
|
|
my_exceptions: List[Union[OSError, RuntimeError]] = []
|
|
exceptions.append(my_exceptions)
|
|
family, type_, proto, _, address = addr_info
|
|
sock = None
|
|
try:
|
|
if socket_factory is not None:
|
|
sock = socket_factory(addr_info)
|
|
else:
|
|
sock = socket.socket(family=family, type=type_, proto=proto)
|
|
if open_sockets is not None:
|
|
open_sockets.add(sock)
|
|
sock.setblocking(False)
|
|
if local_addr_infos is not None:
|
|
for lfamily, _, _, _, laddr in local_addr_infos:
|
|
# skip local addresses of different family
|
|
if lfamily != family:
|
|
continue
|
|
try:
|
|
sock.bind(laddr)
|
|
break
|
|
except OSError as exc:
|
|
msg = (
|
|
f"error while attempting to bind on "
|
|
f"address {laddr!r}: "
|
|
f"{(exc.strerror or '').lower()}"
|
|
)
|
|
exc = OSError(exc.errno, msg)
|
|
my_exceptions.append(exc)
|
|
else: # all bind attempts failed
|
|
if my_exceptions:
|
|
raise my_exceptions.pop()
|
|
else:
|
|
raise OSError(f"no matching local address with {family=} found")
|
|
await loop.sock_connect(sock, address)
|
|
return sock
|
|
except (RuntimeError, OSError) as exc:
|
|
my_exceptions.append(exc)
|
|
if sock is not None:
|
|
if open_sockets is not None:
|
|
open_sockets.remove(sock)
|
|
try:
|
|
sock.close()
|
|
except OSError as e:
|
|
my_exceptions.append(e)
|
|
raise
|
|
raise
|
|
except:
|
|
if sock is not None:
|
|
if open_sockets is not None:
|
|
open_sockets.remove(sock)
|
|
try:
|
|
sock.close()
|
|
except OSError as e:
|
|
my_exceptions.append(e)
|
|
raise
|
|
raise
|
|
finally:
|
|
exceptions = my_exceptions = None # type: ignore[assignment]
|
|
|
|
|
|
def _interleave_addrinfos(
|
|
addrinfos: Sequence[AddrInfoType], first_address_family_count: int = 1
|
|
) -> List[AddrInfoType]:
|
|
"""Interleave list of addrinfo tuples by family."""
|
|
# Group addresses by family
|
|
addrinfos_by_family: collections.OrderedDict[int, List[AddrInfoType]] = (
|
|
collections.OrderedDict()
|
|
)
|
|
for addr in addrinfos:
|
|
family = addr[0]
|
|
if family not in addrinfos_by_family:
|
|
addrinfos_by_family[family] = []
|
|
addrinfos_by_family[family].append(addr)
|
|
addrinfos_lists = list(addrinfos_by_family.values())
|
|
|
|
reordered: List[AddrInfoType] = []
|
|
if first_address_family_count > 1:
|
|
reordered.extend(addrinfos_lists[0][: first_address_family_count - 1])
|
|
del addrinfos_lists[0][: first_address_family_count - 1]
|
|
reordered.extend(
|
|
a
|
|
for a in itertools.chain.from_iterable(itertools.zip_longest(*addrinfos_lists))
|
|
if a is not None
|
|
)
|
|
return reordered
|