16 Commits

Author SHA1 Message Date
suyiiyii e1c97aacad Update pyproject.toml
docker optional-dependencies
2024-12-23 01:03:27 +08:00
suyiiyii 2645314899 ♻️ Install playwright before pytest 2024-12-23 00:51:34 +08:00
suyiiyii 979f6b4cb2 ♻️ 锁依赖 2024-12-23 00:45:50 +08:00
suyiiyii 1274093622 🐛 change "proxies" to "proxy" in http.py 2024-12-22 21:32:55 +08:00
suyiiyii 0f1fe1515f ♻️ 怎么还是限制死了是单引号的 ( 2024-12-22 21:27:38 +08:00
suyiiyii 99c949691e ♻️ 全部换成字符串试试 2024-12-22 21:23:59 +08:00
suyiiyii 5bd67ad7ad ♻️ 忘记改类型了 ( 2024-12-22 21:21:22 +08:00
suyiiyii cac5e09f71 ♻️ 为什么会报这个错误呢 /home/runner/work/nonebot-bison/nonebot-bison/./.github/actions/setup-python/action.yml (Line: 28, Col: 7): Required property is missing: shell 2024-12-22 21:19:10 +08:00
suyiiyii 08c8bb955f ♻️ 将所有 poetry 替换为 uv 2024-12-22 21:15:32 +08:00
suyiiyii 6c8b37f085 ♻️ 更新 action workflow 2024-12-22 21:02:32 +08:00
suyiiyii 8550ff975a 🚀 在现有 Dockerfile 的基础上,修改无浏览器镜像 2024-12-22 20:34:40 +08:00
suyiiyii 8c6e77dd94 🚀 使用 带前端,sentry,浏览器的版本作为默认Dockerfile 2024-12-22 19:20:04 +08:00
suyiiyii 93b6055391 🚀 优化 dockerfile 2024-12-22 19:06:35 +08:00
BalconyJH 5a5b27d285 💚 Update docker build and remove obsolete dockerfile. 2024-12-22 17:35:32 +08:00
Azide c8df2b3cc2 🚧 重写 Dockerfile 2024-12-19 23:55:12 +08:00
Azide e20aba9040 ♻️ 迁移到 uv 2024-12-19 23:54:42 +08:00
25 changed files with 605 additions and 773 deletions
+5 -3
View File
@@ -2,9 +2,9 @@
"name": "Default Linux Universal",
"image": "mcr.microsoft.com/devcontainers/universal:2-linux",
"features": {
"ghcr.io/va-h/devcontainers-features/uv:1": {}
"ghcr.io/devcontainers-contrib/features/poetry:2": {}
},
"postCreateCommand": "uv venv && uv sync --all-groups --all-extras && uv run pre-commit install && npm install -g pnpm && pnpm install",
"postCreateCommand": "poetry config virtualenvs.in-project true && poetry install -E all && poetry run pre-commit install && npm install -g pnpm && pnpm install",
"customizations": {
"vscode": {
"settings": {
@@ -12,7 +12,7 @@
"python.analysis.typeCheckingMode": "basic",
"ruff.organizeImports": false,
"[python]": {
"editor.defaultFormatter": "charliermarsh.ruff",
"editor.defaultFormatter": "ms-python.black-formatter",
"editor.codeActionsOnSave": {
"source.fixAll.ruff": true,
"source.organizeImports": true
@@ -44,6 +44,8 @@
"extensions": [
"ms-python.python",
"ms-python.vscode-pylance",
"ms-python.isort",
"ms-python.black-formatter",
"charliermarsh.ruff",
"EditorConfig.EditorConfig",
"esbenp.prettier-vscode",
+3 -3
View File
@@ -1,9 +1,12 @@
*.ini
#*.yaml
*.yml
*.md
#*.json
*.xml
tests
node_modules
#admin-frontend
data*
htmlcov
docker
@@ -19,6 +22,3 @@ venv
/.prettierrc
/.devcontainer/
/.github/
# self install 时需要
!README.md
+1 -1
View File
@@ -27,7 +27,7 @@ body:
description: 请选择安装方式
options:
- 通过 nb-cli 安装
- 使用 uv/poetry/pdm 等现代包管理器安装
- 使用 poetry/pdm 等现代包管理器安装
- 通过 pip install 安装
- 克隆或下载项目直接使用
-9
View File
@@ -10,10 +10,6 @@ inputs:
description: Install dependencies
required: false
default: "false"
install-playwright:
description: Install Playwright
required: false
default: "false"
runs:
using: "composite"
@@ -33,8 +29,3 @@ runs:
if: ${{ inputs.install-deps == 'true' }}
run: uv sync --frozen
shell: bash
- name: Install Playwright
if: ${{ inputs.install-playwright == 'true' }}
run: uv run playwright install
shell: bash
+8 -4
View File
@@ -73,7 +73,9 @@ jobs:
with:
python-version: ${{ matrix.python-version }}
install-deps: "true"
install-playwright: "true"
- name: Install playwright
run: uv run playwright install
- name: Run Pytest
run: uv run pytest --cov-report xml --cov=./nonebot_bison -k 'not compare and not render' -n auto
@@ -106,7 +108,9 @@ jobs:
with:
python-version: ${{ matrix.python-version }}
install-deps: "true"
install-playwright: "true"
- name: Install playwright
run: uv run playwright install
- name: Run Pytest
run: uv run pytest --cov-report xml --cov=./nonebot_bison -k 'not compare' -n auto
@@ -172,8 +176,8 @@ jobs:
cache-from: type=gha
cache-to: type=gha,mode=max
docker-main-nobrowser:
name: Docker main without browser
docker-main-sentry:
name: Docker main sentry
runs-on: ubuntu-latest
needs: [build-frontend, test]
if: github.event_name != 'pull_request'
+2 -2
View File
@@ -37,8 +37,8 @@ jobs:
cache-from: type=gha
cache-to: type=gha,mode=max
docker-main-nobrowser:
name: Docker main without browser
docker-main-sentry:
name: Docker main sentry
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
+4 -1
View File
@@ -55,7 +55,10 @@ jobs:
python-version: ${{ matrix.python-version }}
- name: Install prerequisites
run: uv add pydantic==1.10 && uv sync --frozen && uv run playwright install
run: uv add pydantic==1.10 && uv sync --frozen
- name: Install playwright
run: uv run playwright install
- name: Run Pytest
run: uv run pytest -k 'not compare and not render' -n auto
+1 -1
View File
@@ -19,7 +19,7 @@ jobs:
- uses: actions/checkout@v4
- name: Run Ruff Lint
uses: astral-sh/ruff-action@v3
uses: astral-sh/ruff-action@v2
with:
src: >-
nonebot_bison/
-1
View File
@@ -9,7 +9,6 @@
### Bug 修复
- :bug: 修复新版 httpx 中 proxy 不起效的问题 [@suyiiyii](https://github.com/suyiiyii) ([#669](https://github.com/MountainDash/nonebot-bison/pull/669))
- :bug: 修复 cookie 模块 type hint [@suyiiyii](https://github.com/suyiiyii) ([#658](https://github.com/MountainDash/nonebot-bison/pull/658))
- :bug: B站转发动态补充 DeletedItem 类型解析 [@AzideCupric](https://github.com/AzideCupric) ([#659](https://github.com/MountainDash/nonebot-bison/pull/659))
- :bug: 小刻食堂cdn使用https [@phidiaLam](https://github.com/phidiaLam) ([#650](https://github.com/MountainDash/nonebot-bison/pull/650))
+31 -46
View File
@@ -56,7 +56,7 @@ ENV TZ=Asia/Shanghai \
COPY ./admin-frontend/package.json ./admin-frontend/pnpm-lock.yaml ./
RUN corepack enable && \
corepack prepare pnpm@latest --activate && \
corepack prepare pnpm@9.15.1 --activate && \
echo "🔔 Verifying Node.js installation..." && \
if NODE_VERSION=$(node --version 2>&1); then \
echo "✅ Node.js version ${NODE_VERSION} installed successfully"; \
@@ -79,7 +79,7 @@ RUN echo "🏗️ Starting frontend build..." && \
pnpm run build && \
echo "✅ Frontend build completed"
FROM ghcr.io/astral-sh/uv:python3.12-bookworm-slim AS playwright-stage
FROM python:3.12-slim AS playwright-stage
WORKDIR /tmp
@@ -87,43 +87,22 @@ ENV DEBIAN_FRONTEND=noninteractive \
PYTHONUNBUFFERED=1 \
TZ=Asia/Shanghai
COPY --from=ghcr.io/astral-sh/uv:latest /uv /uvx /bin/
RUN echo "📦 Installing playwright..." && \
uvx playwright install --with-deps chromium && \
echo "✅ Playwright installed successfully"
FROM ghcr.io/astral-sh/uv:python3.12-bookworm-slim AS uv-stage
FROM python:3.12-slim AS production
WORKDIR /app
#ENV UV_INDEX_URL=https://mirrors.aliyun.com/pypi/simple/
ENV DEBIAN_FRONTEND=noninteractive \
PYTHONUNBUFFERED=1 \
UV_COMPILE_BYTECODE=1 \
UV_FROZEN=1 \
UV_LINK_MODE=copy \
TZ=Asia/Shanghai
RUN echo "🔔 Verifying uv installation..." && \
if UV_VERSION=$(uv --version 2>&1); then \
echo "✅ uv version ${UV_VERSION} installed successfully"; \
else \
echo "❌ uv installation failed" && exit 1; \
fi
RUN --mount=type=cache,target=/root/.cache/uv \
--mount=type=bind,source=uv.lock,target=uv.lock \
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
echo "📦 Installing project dependencies..." && \
uv sync --no-install-project --no-dev --extra docker && \
echo "✅ Dependencies installed successfully"
FROM ghcr.io/astral-sh/uv:python3.12-bookworm-slim AS production
WORKDIR /app
ENV DEBIAN_FRONTEND=noninteractive \
UV_SYSTEM_PYTHON=true \
PYTHONUNBUFFERED=1 \
UV_COMPILE_BYTECODE=1 \
UV_FROZEN=1 \
UV_LINK_MODE=copy \
TZ=Asia/Shanghai \
SHELL="/bin/bash"
@@ -177,30 +156,36 @@ RUN echo "📦 Installing system dependencies..." && \
rm -rf /var/lib/apt/lists/* && \
echo "✅ System dependencies installed successfully"
# 少变动的放上面,频繁变动的放下面
COPY ./docker.env.prod ./.env
COPY --from=playwright-stage /root/.cache/ms-playwright /root/.cache/ms-playwright
COPY extra_plugins/ /app/extra_plugins/
COPY --from=frontend-stage /tmp/nonebot_bison/admin_page/dist ./nonebot_bison/admin_page/dist
COPY --from=uv-stage /app /app
COPY ./pyproject.toml ./uv.lock ./README.md ./
COPY nonebot_bison/ /app/nonebot_bison/
COPY --from=metadata-stage /tmp/VERSION /app/VERSION
RUN --mount=type=cache,target=/root/.cache/uv \
echo "📦 Installing bison project..." && \
uv sync --no-dev --extra docker && \
uv run nb adapter install nonebot-adapter-satori && \
uv run nb adapter install nonebot-adapter-qq && \
uv run nb plugin install nonebot-plugin-sentry && \
echo "✅ Bison installed successfully"
COPY --from=ghcr.io/astral-sh/uv:latest /uv /uvx /bin/
RUN echo "🔔 Verifying uv installation..." && \
if UV_VERSION=$(uv --version 2>&1); then \
echo "✅ uv version ${UV_VERSION} installed successfully"; \
else \
echo "❌ uv installation failed" && exit 1; \
fi
COPY ./pyproject.toml ./uv.lock ./
RUN --mount=type=cache,target=/root/.cache/ \
--mount=type=cache,target=/root/.uv \
echo "📦 Installing bison dependencies..." && \
uv pip install --extra=docker --requirement pyproject.toml --no-cache && \
echo "✅ Dependencies installed successfully" && \
echo "🔔 Cleaning up uv..." && \
rm -rf /bin/uv /bin/uvx && \
echo "✅ UV cleanup completed"
COPY --from=metadata-stage /tmp/VERSION /app/VERSION
COPY nonebot_bison/ /app/nonebot_bison/
COPY --from=frontend-stage /tmp/nonebot_bison/admin_page/dist ./nonebot_bison/admin_page/dist
COPY --from=playwright-stage /root/.cache/ms-playwright /root/.cache/ms-playwright
EXPOSE 8080
RUN echo '#!/bin/bash' > /app/start.sh && \
echo 'echo "📌 Current bison Version: $(cat /app/VERSION)"' >> /app/start.sh && \
echo 'echo "🚀 Starting service..."' >> /app/start.sh && \
echo 'source /app/.venv/bin/activate' >> /app/start.sh && \
echo 'nb run' >> /app/start.sh && \
chmod +x /app/start.sh
+38 -40
View File
@@ -32,6 +32,7 @@ RUN echo "📋 Collecting metadata..." && \
echo "$DESCRIPTION" > /tmp/DESCRIPTION && \
echo "$AUTHOR" > /tmp/AUTHOR
RUN --mount=type=bind,source=./.git/,target=/tmp/.git/ \
echo "🏷️ Checking version information..." && \
VERSION=$(git describe --tags --exact-match 2>/dev/null || git rev-parse --short HEAD || echo "unknown") && \
@@ -55,7 +56,7 @@ ENV TZ=Asia/Shanghai \
COPY ./admin-frontend/package.json ./admin-frontend/pnpm-lock.yaml ./
RUN corepack enable && \
corepack prepare pnpm@latest --activate && \
corepack prepare pnpm@9.15.1 --activate && \
echo "🔔 Verifying Node.js installation..." && \
if NODE_VERSION=$(node --version 2>&1); then \
echo "✅ Node.js version ${NODE_VERSION} installed successfully"; \
@@ -78,17 +79,35 @@ RUN echo "🏗️ Starting frontend build..." && \
pnpm run build && \
echo "✅ Frontend build completed"
FROM ghcr.io/astral-sh/uv:python3.12-bookworm-slim AS uv-stage
FROM python:3.12-slim AS playwright-stage
WORKDIR /app
WORKDIR /tmp
ENV DEBIAN_FRONTEND=noninteractive \
PYTHONUNBUFFERED=1 \
UV_COMPILE_BYTECODE=1 \
UV_FROZEN=1 \
UV_LINK_MODE=copy \
TZ=Asia/Shanghai
COPY --from=ghcr.io/astral-sh/uv:latest /uv /uvx /bin/
RUN echo "📦 Installing playwright..." && \
uvx playwright install --with-deps chromium && \
echo "✅ Playwright installed successfully"
FROM python:3.12-slim AS production
WORKDIR /app
ENV DEBIAN_FRONTEND=noninteractive \
UV_COMPILE_BYTECODE=1 \
UV_SYSTEM_PYTHON=true \
PYTHONUNBUFFERED=1 \
UV_LINK_MODE=copy \
TZ=Asia/Shanghai \
SHELL="/bin/bash"
COPY --from=ghcr.io/astral-sh/uv:latest /uv /uvx /bin/
RUN echo "🔔 Verifying uv installation..." && \
if UV_VERSION=$(uv --version 2>&1); then \
echo "✅ uv version ${UV_VERSION} installed successfully"; \
@@ -96,41 +115,21 @@ RUN echo "🔔 Verifying uv installation..." && \
echo "❌ uv installation failed" && exit 1; \
fi
RUN --mount=type=cache,target=/root/.cache/uv \
--mount=type=bind,source=uv.lock,target=uv.lock \
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
echo "📦 Installing project dependencies..." && \
uv sync --no-install-project --no-dev --extra docker && \
echo "✅ Dependencies installed successfully"
FROM ghcr.io/astral-sh/uv:python3.12-bookworm-slim AS production
WORKDIR /app
ENV DEBIAN_FRONTEND=noninteractive \
PYTHONUNBUFFERED=1 \
UV_COMPILE_BYTECODE=1 \
UV_FROZEN=1 \
UV_LINK_MODE=copy \
TZ=Asia/Shanghai \
SHELL="/bin/bash"
# 少变动的放上面,频繁变动的放下面
COPY ./pyproject.toml ./uv.lock ./
COPY ./docker.env.prod ./.env
COPY extra_plugins/ /app/extra_plugins/
COPY --from=frontend-stage /tmp/nonebot_bison/admin_page/dist ./nonebot_bison/admin_page/dist
COPY --from=uv-stage /app /app
COPY ./pyproject.toml ./uv.lock ./README.md ./
COPY nonebot_bison/ /app/nonebot_bison/
COPY --from=metadata-stage /tmp/VERSION /app/VERSION
RUN --mount=type=cache,target=/root/.cache/uv \
echo "📦 Installing bison project..." && \
uv sync --no-dev --extra docker && \
uv run nb adapter install nonebot-adapter-satori && \
uv run nb adapter install nonebot-adapter-qq && \
uv run nb plugin install nonebot-plugin-sentry && \
echo "✅ Bison installed successfully"
RUN --mount=type=cache,target=/root/.cache/ \
--mount=type=cache,target=/root/.uv \
echo "📦 Installing bison dependencies..." && \
uv pip install --extra=docker --requirement pyproject.toml --no-cache && \
echo "✅ Dependencies installed successfully" && \
echo "🔔 Cleaning up uv..." && \
rm -rf /bin/uv /bin/uvx && \
echo "✅ UV cleanup completed"
COPY --from=metadata-stage /tmp/VERSION /app/VERSION
COPY nonebot_bison/ /app/nonebot_bison/
COPY --from=frontend-stage /tmp/nonebot_bison/admin_page/dist ./nonebot_bison/admin_page/dist
EXPOSE 8080
@@ -140,7 +139,6 @@ ENV BISON_SKIP_BROWSER_CHECK=True \
RUN echo '#!/bin/bash' > /app/start.sh && \
echo 'echo "📌 Current bison Version: $(cat /app/VERSION)"' >> /app/start.sh && \
echo 'echo "🚀 Starting service..."' >> /app/start.sh && \
echo 'source /app/.venv/bin/activate' >> /app/start.sh && \
echo 'nb run' >> /app/start.sh && \
chmod +x /app/start.sh
+3 -3
View File
@@ -8,7 +8,7 @@ next: /dev/cookie
## 语言以及工具
1. 本项目使用了`python3.10`的特性进行开发,所以请确保你的 Python 版本>=3.10
2. 本项目使用 uv 进行依赖管理,请确保开发之前已经进行过`uv sync`,运行时在`uv venv`的环境中进行运行
2. 本项目使用 poetry 进行依赖管理,请确保开发之前已经进行过`poetry install`,运行时在`poetry shell`的环境中进行运行
3. 本项目使用的 node 项目管理工具是 pnpm
::: tip 参考
@@ -30,7 +30,7 @@ next: /dev/cookie
2. 运行 bot
```bash
uv run nb run
poetry run nb run
```
3. 运行前端:
@@ -50,7 +50,7 @@ next: /dev/cookie
## 代码格式
本项目使用了 pre-commit 来进行代码美化和格式化。在`uv venv`状态下执行`pre-commit install`来安装 git hook,可自动在 commit 时
本项目使用了 pre-commit 来进行代码美化和格式化。在`poetry shell`状态下执行`pre-commit install`来安装 git hook,可自动在 commit 时
格式化代码。
## 适配新网站
+5 -3
View File
@@ -83,8 +83,10 @@ sequenceDiagram
目前 CookieClientManager 具有以下方法
- `refresh_anonymous_cookie(cls)` 移除已有的匿名 cookie,添加一个新的匿名 cookie,应该在 CCM 初始化时调用
- `add_user_cookie(cls, content: str)` 添加用户 cookie,在这里对 Cookie 进行检查并获取 cookie_name,写入数据库
- `_generate_hook(self, cookie: Cookie) -> Callable` hook 函数生成器,用于回写请求状态到数据库
- `_choose_cookie(self, target: Target) -> Cookie` 选择 cookie 的具体算法
- `add_identified_cookie(cls, content: str, cookie_name: str | None = None) -> Cookie` 对外的接口,添加实名 cookie,内部会调用 Site 的方法进行检查
- `add_user_cookie(cls, content: str, cookie_name: str | None = None) -> Cookie` 对外的接口,添加用户 cookie,内部会调用 Site 的方法进行检查
- `get_client(self, target: Target | None) -> AsyncClient` 对外的接口,获取 client,根据 target 选择 cookie
- `_assemble_client(self, client, cookie) -> AsyncClient` 组装 client,可以自定义 cookie 对象的 content 装配到 client 中的方式
@@ -98,7 +100,7 @@ sequenceDiagram
简单来说:
- 如果需要修改 Cookie 的默认参数,可以重写`add_identified_cookie`方法,这里设置需要的字段
- 如果需要修改 Cookie 的默认参数,可以重写`add_user_cookie`方法,这里设置需要的字段
- 如果需要修改选择 Cookie 的逻辑,可以重写`_choose_cookie`方法,使用自己的算法选择合适的 Cookie 并返回
- 如果需要自定义 Cookie 的格式,可以重写`valid_cookie`方法,自定义验证 Cookie 的逻辑,并重写`_assemble_client`方法,自定义将 Cookie 装配到 Client 中的逻辑
- 如果要在请求结束后做一些操作(例如保存此次请求的结果/状态),可以重写`_response_hook`方法,自定义请求结束后的行为
@@ -135,7 +137,7 @@ sequenceDiagram
- **无 Target 平台的 Cookie 处理方式**
对于不存在 Target 的平台,如小刻食堂,可以重写 add_identified_cookie 方法,为实名 cookie 设置 is_universal 字段。这样,在获取 Client 时,由于传入的 Target 为空,就只会选择 is_universal 的 cookie。实现了无 Target 平台的实名 cookie 调度。
对于不存在 Target 的平台,如小刻食堂,可以重写 add_user_cookie 方法,为用户 Cookie 设置 is_universal 字段。这样,在获取 Client 时,由于传入的 Target 为空,就只会选择 is_universal 的 cookie。实现了无 Target 平台的用户 Cookie 调度。
## 默认的调度策略
+8 -8
View File
@@ -23,7 +23,7 @@ next: /usage/easy-use
参考视频教程 [保姆级新手教学 - Well404](https://www.bilibili.com/video/BV1984y1b7JY)
:::
::: warning 防止环境冲突!
建议所有操作都在虚拟环境下进行,推荐使用[`uv`](https://docs.astral.sh/uv/)或者 python 自带的[`venv`](https://docs.python.org/zh-cn/3/library/venv.html)
建议所有操作都在虚拟环境下进行,推荐使用[`poetry`](https://python-poetry.org/)或者 python 自带的[`venv`](https://docs.python.org/zh-cn/3/library/venv.html)
:::
### 使用 nb-cli 安装 <Badge type="tip" text="推荐" vertical="top" />
@@ -43,17 +43,17 @@ next: /usage/easy-use
3. 在项目中添加依赖
```bash
uv add nonebot-bison
poetry add nonebot-bison
```
### 手动安装
1. 安装 pip 包`nonebot-bison`
::: code-tabs
@tab uv
@tab poetry
```bash
uv add nonebot-bison
poetry add nonebot-bison
```
@tab pip
@@ -169,13 +169,13 @@ Bison 的 WebUI 是需要编译后才能使用的,直接克隆源代码需要
本项目中使用了 Python 3.10 的语法,如果出现问题,请检查 Python 版本
:::
1. 首先安装 uv[安装方法](https://docs.astral.sh/uv/getting-started/installation/)
2. clone 本项目,在项目中使用`uv sync`安装依赖
1. 首先安装 poetry[安装方法](https://python-poetry.org/docs/#installation)
2. clone 本项目,在项目中`poetry install`安装依赖
```bash
git clone https://github.com/felinae98/nonebot-bison.git
cd nonebot-bison
uv sync
poetry install
```
#### WebUI 安装
@@ -235,5 +235,5 @@ Bison 的 WebUI 是需要编译后才能使用的,直接克隆源代码需要
2. 启动 Bot
```bash
uv run nb run
poetry run nb run
```
+1 -1
View File
@@ -235,7 +235,7 @@ async def get_cookie(site_name: str | None = None, target: str | None = None) ->
@router.post("/cookie", dependencies=[Depends(check_is_superuser)])
async def add_cookie(site_name: str, content: str) -> StatusResp:
client_mgr = cast(CookieClientManager, scheduler_dict[site_manager[site_name]].client_mgr)
await client_mgr.add_identified_cookie(content)
await client_mgr.add_user_cookie(content)
return StatusResp(ok=True, msg="")
+1 -43
View File
@@ -1,17 +1,14 @@
from collections.abc import Callable
from datetime import datetime, timedelta
import json
import random
from typing import TYPE_CHECKING, ClassVar, TypeVar
from typing_extensions import override
from httpx import AsyncClient, Response
from httpx import AsyncClient
from nonebot import logger, require
from playwright.async_api import Cookie
from nonebot_bison.config import config
from nonebot_bison.config.db_model import Cookie as CookieModel
from nonebot_bison.config.db_model import Target
from nonebot_bison.plugin_config import plugin_config
from nonebot_bison.utils import Site, http_client
from nonebot_bison.utils.site import CookieClientManager
@@ -28,8 +25,6 @@ B = TypeVar("B", bound="Bilibili")
class BilibiliClientManager(CookieClientManager):
_default_cookie_cd = timedelta(seconds=120)
current_identified_cookie: CookieModel | None = None
_site_name = "bilibili.com"
async def _get_cookies(self) -> list[Cookie]:
browser = await get_browser()
@@ -64,43 +59,6 @@ class BilibiliClientManager(CookieClientManager):
)
return cookie
def _generate_hook(self, cookie: CookieModel) -> Callable:
"""hook 函数生成器,用于回写请求状态到数据库"""
async def _response_hook(resp: Response):
await resp.aread()
if resp.status_code == 200 and "-352" not in resp.text:
logger.trace(f"请求成功: {cookie.id} {resp.request.url}")
cookie.status = "success"
else:
logger.warning(f"请求失败: {cookie.id} {resp.request.url}, 状态码: {resp.status_code}")
cookie.status = "failed"
self.current_identified_cookie = None
cookie.last_usage = datetime.now()
await config.update_cookie(cookie)
return _response_hook
async def _get_next_identified_cookie(self) -> CookieModel | None:
"""选择下一个实名 cookie"""
cookies = await config.get_cookie(self._site_name, is_anonymous=False)
available_cookies = [cookie for cookie in cookies if cookie.last_usage + cookie.cd < datetime.now()]
if not available_cookies:
return None
cookie = min(available_cookies, key=lambda x: x.last_usage)
return cookie
async def _choose_cookie(self, target: Target | None) -> CookieModel:
"""选择 cookie 的具体算法"""
if self.current_identified_cookie is None:
# 若当前没有选定实名 cookie 则尝试获取
self.current_identified_cookie = await self._get_next_identified_cookie()
if self.current_identified_cookie:
# 如果当前有选定的实名 cookie 则直接返回
return self.current_identified_cookie
# 否则返回匿名 cookie
return (await config.get_cookie(self._site_name, is_anonymous=True))[0]
@override
async def refresh_client(self):
await self._refresh_anonymous_cookie()
+1 -1
View File
@@ -76,7 +76,7 @@ def do_add_cookie(add_cookie: type[Matcher]):
@add_cookie.handle()
async def add_cookie_process(state: T_State):
client_mgr = cast(CookieClientManager, scheduler_dict[platform_manager[state["platform"]].site].client_mgr)
new_cookie = await client_mgr.add_identified_cookie(state["cookie"], state["cookie_name"])
new_cookie = await client_mgr.add_user_cookie(state["cookie"], state["cookie_name"])
await add_cookie.finish(
f"已添加 Cookie: {new_cookie.cookie_name} 到平台 {state['platform']}"
+ "\n请使用“关联cookie”为 Cookie 关联订阅"
@@ -34,7 +34,7 @@ def do_add_cookie_target(add_cookie_target_matcher: type[Matcher]):
@add_cookie_target_matcher.handle()
async def init_promote_cookie(state: T_State):
# 获取 site 的所有实名 cookie,再排除掉已经关联的 cookie,剩下的就是可以关联的 cookie
# 获取 site 的所有用户 cookie,再排除掉已经关联的 cookie,剩下的就是可以关联的 cookie
cookies = await config.get_cookie(site_name=state["site"].name, is_anonymous=False)
associated_cookies = await config.get_cookie(
target=state["target"]["target"],
+6 -6
View File
@@ -79,8 +79,8 @@ class CookieClientManager(ClientManager):
new_anonymous_cookie = await self._generate_anonymous_cookie()
await config.add_cookie(new_anonymous_cookie)
async def add_identified_cookie(self, content: str, cookie_name: str | None = None) -> Cookie:
"""添加实名 cookie"""
async def add_user_cookie(self, content: str, cookie_name: str | None = None) -> Cookie:
"""添加用户 cookie"""
if not await self.validate_cookie(content):
raise ValueError()
@@ -124,8 +124,8 @@ class CookieClientManager(ClientManager):
async def _choose_cookie(self, target: Target | None) -> Cookie:
"""选择 cookie 的具体算法"""
cookies = await config.get_cookie(self._site_name, target)
available_cookies = (cookie for cookie in cookies if cookie.last_usage + cookie.cd < datetime.now())
cookie = min(available_cookies, key=lambda x: x.last_usage)
avaliable_cookies = (cookie for cookie in cookies if cookie.last_usage + cookie.cd < datetime.now())
cookie = min(avaliable_cookies, key=lambda x: x.last_usage)
return cookie
async def get_client(self, target: Target | None) -> AsyncClient:
@@ -133,9 +133,9 @@ class CookieClientManager(ClientManager):
client = http_client()
cookie = await self._choose_cookie(target)
if cookie.is_universal:
logger.trace(f"平台 {self._site_name} 未获取到实名cookie, 使用匿名cookie")
logger.trace(f"平台 {self._site_name} 未获取到用户cookie, 使用匿名cookie")
else:
logger.trace(f"平台 {self._site_name} 获取到实名cookie: {cookie.id}")
logger.trace(f"平台 {self._site_name} 获取到用户cookie: {cookie.id}")
return await self._assemble_client(client, cookie)
+41 -41
View File
@@ -3,26 +3,26 @@ authors = [{ name = "felinae98", email = "felinae225@qq.com" }]
license = { text = "MIT" }
requires-python = "<4.0.0,>=3.10"
dependencies = [
"beautifulsoup4>=4.12.3",
"feedparser<7.0.0,>=6.0.11",
"httpx>=0.27.2",
"nonebot2[fastapi]<3.0.0,>=2.3.3",
"nonebot-adapter-onebot<3.0.0,>=2.4.5",
"nonebot-plugin-htmlrender>=0.3.5,!=0.5.0",
"nonebot-plugin-datastore<2.0.0,>=1.3.0",
"nonebot-plugin-apscheduler>=0.5.0",
"nonebot-plugin-send-anything-anywhere<0.7.2,>=0.7.1",
"pillow<11.1,>=11.0.0",
"pyjwt<3.0.0,>=2.9.0",
"python-socketio<6.0.0,>=5.11.4",
"tinydb<5.0.0,>=4.8.0",
"qrcode<8.0.0,>=7.4.2",
"pydantic!=2.5.0,!=2.5.1,<3.0.0,>=2.9.2",
"lxml>=5.3.0",
"yarl>=1.11.1",
"hishel<1.0.0,>=0.0.30",
"expiringdictx<2.0.0,>=1.1.0",
"rapidfuzz<4.0.0,>=3.9.7",
"beautifulsoup4==4.12.3",
"feedparser==6.0.11",
"httpx==0.27.2",
"nonebot2[fastapi]==2.3.3",
"nonebot-adapter-onebot==2.4.5",
"nonebot-plugin-htmlrender==0.3.5",
"nonebot-plugin-datastore==1.3.0",
"nonebot-plugin-apscheduler==0.5.0",
"nonebot-plugin-send-anything-anywhere==0.7.1",
"pillow==11.0.0",
"pyjwt==2.9.0",
"python-socketio==5.11.4",
"tinydb==4.8.0",
"qrcode==7.4.2",
"Pydantic==2.9.2",
"lxml==5.3.0",
"yarl==1.11.1",
"hishel==0.0.30",
"expiringdictx==1.1.0",
"rapidfuzz==3.9.7",
]
name = "nonebot-bison"
version = "0.9.5"
@@ -49,33 +49,33 @@ bison = "nonebot_bison.script.cli:main"
[dependency-groups]
dev = [
"ipdb<1.0.0,>=0.13.13",
"nonemoji<1.0.0,>=0.1.4",
"nb-cli<2.0.0,>=1.4.2",
"pre-commit<5.0.0,>=4.0.1",
"ruff<1.0.0,>=0.8.2",
"ipdb==0.13.13",
"nonemoji==0.1.4",
"nb-cli==1.4.2",
"pre-commit==4.0.1",
"ruff==0.8.2",
]
test = [
"flaky<4.0.0,>=3.8.1",
"nonebug<1.0.0,>=0.3.7",
"nonebug-saa<1.0.0,>=0.4.1",
"pytest<9.0.0,>=8.3.3",
"pytest-asyncio<0.24.1,>=0.24.0",
"pytest-cov<7,>=6.0.0",
"pytest-mock<4.0.0,>=3.14.0",
"pytest-xdist[psutil]<4.0.0,>=3.6.1",
"respx<0.23.0,>=0.22.0",
"freezegun<2.0.0,>=1.5.1",
"pytz>=2024.2",
"flaky==3.8.1",
"nonebug==0.3.7",
"pytz==2024.2",
"nonebug-saa==0.4.1",
"pytest==8.3.3",
"pytest-asyncio==0.24.0",
"pytest-cov==6.0.0",
"pytest-mock==3.14.0",
"pytest-xdist[psutil]==3.6.1",
"respx==0.21.1",
"freezegun==1.5.1",
]
[project.optional-dependencies]
docker = [
"nb-cli<2.0.0,>=1.4.2",
"nonebot2[aiohttp,fastapi]<3.0.0,>=2.3.3",
"nonebot-adapter-qq<2.0.0,>=1.5.1",
"nonebot-adapter-satori>=0.13.1",
"pip>=24.3.1",
"nb-cli==1.4.2",
"nonebot2[aiohttp,fastapi]==2.3.3",
"nonebot-adapter-red==0.9.0",
"nonebot-adapter-qq==1.5.1",
"poetry-core==1.9.0",
]
[tool.uv]
+4 -4
View File
@@ -34,9 +34,9 @@ async def test_cookie(app: App, init_scheduler):
cookies = await config.get_cookie(site_name=site.name)
assert len(cookies) == 1
# 添加实名cookie
await client_mgr.add_identified_cookie(json.dumps({"test_cookie": "1"}))
await client_mgr.add_identified_cookie(json.dumps({"test_cookie": "2"}))
# 添加用户cookie
await client_mgr.add_user_cookie(json.dumps({"test_cookie": "1"}))
await client_mgr.add_user_cookie(json.dumps({"test_cookie": "2"}))
cookies = await config.get_cookie(site_name=site.name)
assert len(cookies) == 3
@@ -68,7 +68,7 @@ async def test_cookie(app: App, init_scheduler):
tags=[],
)
await client_mgr.add_identified_cookie(json.dumps({"test_cookie": "3"}))
await client_mgr.add_user_cookie(json.dumps({"test_cookie": "3"}))
cookies = await config.get_cookie(site_name=site.name, is_anonymous=False)
# 多个target,多个cookie
+25 -1
View File
@@ -4,7 +4,31 @@ from nonebug.app import App
import pytest
from pytest_mock import MockerFixture
from tests.utils import BotReply, fake_private_message_event, fake_superuser
from tests.utils import BotReply, fake_admin_user, fake_private_message_event, fake_superuser
async def test_add_cookie_rule(app: App, mocker: MockerFixture):
from nonebot.adapters.onebot.v11.bot import Bot
from nonebot.adapters.onebot.v11.message import Message
from nonebot_bison.plugin_config import plugin_config
from nonebot_bison.sub_manager import add_cookie_matcher
mocker.patch.object(plugin_config, "bison_to_me", True)
async with app.test_matcher(add_cookie_matcher) as ctx:
bot = ctx.create_bot(base=Bot)
event = fake_private_message_event(message=Message("添加cookie"), sender=fake_superuser)
ctx.receive_event(bot, event)
ctx.should_pass_rule()
ctx.should_pass_permission()
async with app.test_matcher(add_cookie_matcher) as ctx:
bot = ctx.create_bot(base=Bot)
event = fake_private_message_event(message=Message("添加cookie"), sender=fake_admin_user)
ctx.receive_event(bot, event)
ctx.should_not_pass_rule()
ctx.should_pass_permission()
@pytest.mark.usefixtures("_clear_db")
+1 -2
View File
@@ -42,5 +42,4 @@ async def test_without_permission(app: App):
True,
)
ctx.should_pass_rule()
ctx.should_pass_permission(no_permission_matcher)
ctx.should_not_pass_permission(add_sub_matcher)
ctx.should_pass_permission()
+2 -2
View File
@@ -19,6 +19,6 @@ async def test_http_error(app: App):
"https://example.com Headers({'host': 'example.com', 'accept': '*/*', 'accept-encoding': 'gzip, deflate',"
" 'connection': 'keep-alive', 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36"
" (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36 Edg/130.0.0.0'}) | [403] Headers({'content-length': '"
"14', 'content-type':"
' \'application/json\'}) {"error":"gg"}'
"15', 'content-type':"
' \'application/json\'}) {"error": "gg"}'
]
Generated
+413 -546
View File
File diff suppressed because it is too large Load Diff