🔀 merge main

.pre-commit-config.yaml

@@ -7,7 +7,7 @@ ci:
   autoupdate_commit_msg: ":arrow_up: auto update by pre-commit hooks"
 repos:
   - repo: https://github.com/astral-sh/ruff-pre-commit
-    rev: v0.6.3
+    rev: v0.6.0
     hooks:
       - id: ruff
         args: [--fix, --exit-non-zero-on-fix]
@@ -34,7 +34,7 @@ repos:
         stages: [commit]
 
   - repo: https://github.com/pre-commit/mirrors-eslint
-    rev: v9.9.1
+    rev: v9.8.0
     hooks:
       - id: eslint
         additional_dependencies:

CHANGELOG.md

@@ -1,10 +1,9 @@
 # Change Log
 
-## v0.9.4
+## 最近更新
 
 ### Bug 修复
 
-- FSM 内部执行外部函数出现异常时不应崩溃 [@AzideCupric](https://github.com/AzideCupric) ([#616](https://github.com/MountainDash/nonebot-bison/pull/616))
 - 无权限用户尝试添加订阅时返回提示信息 [@suyiiyii](https://github.com/suyiiyii) ([#617](https://github.com/MountainDash/nonebot-bison/pull/617))
 - B站请求策略阶段行为优化 [@AzideCupric](https://github.com/AzideCupric) ([#610](https://github.com/MountainDash/nonebot-bison/pull/610))
 - Rss 不再删除格式化字符 [@suyiiyii](https://github.com/suyiiyii) ([#615](https://github.com/MountainDash/nonebot-bison/pull/615))

admin-frontend/package.json

@@ -5,26 +5,26 @@
   "homepage": "bison",
   "proxy": "http://127.0.0.1:8080",
   "dependencies": {
-    "@arco-design/web-react": "^2.64.0",
+    "@arco-design/web-react": "^2.63.1",
-    "@babel/core": "^7.25.2",
+    "@babel/core": "^7.24.7",
     "@babel/plugin-syntax-flow": "^7.24.7",
-    "@babel/plugin-transform-react-jsx": "^7.25.2",
+    "@babel/plugin-transform-react-jsx": "^7.24.7",
     "@reduxjs/toolkit": "^1.9.7",
     "@testing-library/dom": "^10.4.0",
-    "@testing-library/react": "^16.0.1",
+    "@testing-library/react": "^16.0.0",
     "@testing-library/user-event": "^14.5.2",
-    "@types/jest": "^29.5.13",
+    "@types/jest": "^29.5.12",
-    "@types/node": "^20.16.5",
+    "@types/node": "^20.14.10",
-    "@types/react": "^18.3.7",
+    "@types/react": "^18.3.3",
     "@types/react-dom": "^18.3.0",
     "react": "^18.3.1",
     "react-dom": "^18.3.1",
     "react-redux": "^9.1.2",
-    "react-router-dom": "^6.26.2",
+    "react-router-dom": "^6.24.1",
     "react-scripts": "5.0.1",
     "redux": "^5.0.1",
     "redux-persist": "^6.0.0",
-    "typescript": "^5.6.2",
+    "typescript": "^5.5.4",
     "web-vitals": "^3.5.2"
   },
   "scripts": {
@@ -53,17 +53,17 @@
     ]
   },
   "devDependencies": {
-    "@testing-library/jest-dom": "^6.5.0",
+    "@testing-library/jest-dom": "^6.4.6",
-    "@typescript-eslint/eslint-plugin": "^8.6.0",
+    "@typescript-eslint/eslint-plugin": "^8.0.0",
-    "@typescript-eslint/parser": "^8.6.0",
+    "@typescript-eslint/parser": "^8.0.0",
-    "eslint": "^8.57.1",
+    "eslint": "^9.6.0",
     "eslint-config-airbnb": "^19.0.4",
     "eslint-config-airbnb-typescript": "^18.0.0",
-    "eslint-import-resolver-typescript": "^3.6.3",
+    "eslint-import-resolver-typescript": "^3.6.1",
-    "eslint-plugin-import": "^2.30.0",
+    "eslint-plugin-import": "^2.29.1",
-    "eslint-plugin-jsx-a11y": "^6.10.0",
+    "eslint-plugin-jsx-a11y": "^6.9.0",
-    "eslint-plugin-react": "^7.36.1",
+    "eslint-plugin-react": "^7.34.3",
     "eslint-plugin-react-hooks": "^4.6.2",
-    "eslint-plugin-react-redux": "^4.2.0"
+    "eslint-plugin-react-redux": "^4.1.0"
   }
 }

docker/Dockerfile

@@ -1,4 +1,4 @@
-FROM node:20.17.0 as frontend
+FROM node:20.15.1 as frontend
 ADD . /app
 WORKDIR /app/admin-frontend
 RUN yarn && yarn build

docker/Dockerfile_with_frontend

@@ -1,4 +1,4 @@
-# syntax=docker/dockerfile:1.10
+# syntax=docker/dockerfile:1.8
 FROM python:3.11-slim-bullseye as base
 
 FROM base as builder

docker/Dockerfile_with_frontend_sentry

@@ -1,4 +1,4 @@
-# syntax=docker/dockerfile:1.10
+# syntax=docker/dockerfile:1.8
 FROM python:3.11-slim-bullseye as base
 
 FROM base as builder

nonebot_bison/apis.py

@@ -1,4 +1,5 @@
 from .types import Target
+from .config.db_model import Cookie
 from .scheduler import scheduler_dict
 from .platform import platform_manager
 
@@ -10,3 +11,13 @@ async def check_sub_target(platform_name: str, target: Target):
     client = await scheduler.client_mgr.get_query_name_client()
 
     return await platform_manager[platform_name].get_target_name(client, target)
+
+
+async def check_sub_target_cookie(platform_name: str, target: Target, cookie: str):
+    # TODO
+    return "check pass"
+
+
+async def get_cookie_friendly_name(cookie: Cookie):
+    # TODO
+    return f"{cookie.platform_name} [{cookie.content[:10]}]"

nonebot_bison/config/db_config.py

@@ -12,8 +12,8 @@ from nonebot_plugin_datastore import create_session
 
 from ..types import Tag
 from ..types import Target as T_Target
-from .utils import NoSuchTargetException
+from .utils import NoSuchTargetException, DuplicateCookieTargetException
-from .db_model import User, Target, Subscribe, ScheduleTimeWeight
+from .db_model import User, Cookie, Target, Subscribe, CookieTarget, ScheduleTimeWeight
 from ..types import Category, UserSubInfo, WeightConfig, TimeWeightConfig, PlatformWeightConfigResp
 
 
@@ -259,5 +259,79 @@ class DBConfig:
             )
         return res
 
+    async def get_cookie(self, platform_name: str = None, target: T_Target = None) -> list[Cookie]:
+        async with create_session() as sess:
+            query = select(Cookie).distinct()
+            if platform_name:
+                query = query.where(Cookie.platform_name == platform_name)
+            query = query.outerjoin(CookieTarget).options(selectinload(Cookie.targets))
+            res = (await sess.scalars(query)).all()
+            if target:
+                query = select(CookieTarget.cookie_id).join(Target).where(Target.target == target)
+                ids = set((await sess.scalars(query)).all())
+                res = [cookie for cookie in res if cookie.id in ids]
+            return res
+
+    async def add_cookie(self, platform_name: str, content: str) -> int:
+        async with create_session() as sess:
+            cookie = Cookie(platform_name=platform_name, content=content)
+            sess.add(cookie)
+            await sess.commit()
+            await sess.refresh(cookie)
+            return cookie.id
+
+    async def update_cookie(self, cookie: Cookie):
+        async with create_session() as sess:
+            cookie_in_db: Cookie | None = await sess.scalar(select(Cookie).where(Cookie.id == cookie.id))
+            if not cookie_in_db:
+                return
+            cookie_in_db.content = cookie.content
+            cookie_in_db.last_usage = cookie.last_usage
+            cookie_in_db.status = cookie.status
+            cookie_in_db.tags = cookie.tags
+            await sess.commit()
+
+    async def delete_cookie(self, cookie_id: int):
+        async with create_session() as sess:
+            await sess.execute(delete(Cookie).where(Cookie.id == cookie_id))
+            await sess.commit()
+
+    async def get_cookie_by_target(self, target: T_Target, platform_name: str) -> list[Cookie]:
+        async with create_session() as sess:
+            query = (
+                select(Cookie)
+                .join(CookieTarget)
+                .join(Target)
+                .where(Target.platform_name == platform_name, Target.target == target)
+            )
+            return list((await sess.scalars(query)).all())
+
+    async def add_cookie_target(self, target: T_Target, platform_name: str, cookie_id: int):
+        async with create_session() as sess:
+            target_obj = await sess.scalar(
+                select(Target).where(Target.platform_name == platform_name, Target.target == target)
+            )
+            # check if relation exists
+            cookie_target = await sess.scalar(
+                select(CookieTarget).where(CookieTarget.target == target_obj, CookieTarget.cookie_id == cookie_id)
+            )
+            if cookie_target:
+                raise DuplicateCookieTargetException()
+            cookie_obj = await sess.scalar(select(Cookie).where(Cookie.id == cookie_id))
+            cookie_target = CookieTarget(target=target_obj, cookie=cookie_obj)
+            sess.add(cookie_target)
+            await sess.commit()
+
+    async def delete_cookie_target(self, target: T_Target, platform_name: str, cookie_id: int):
+        async with create_session() as sess:
+            target_obj = await sess.scalar(
+                select(Target).where(Target.platform_name == platform_name, Target.target == target)
+            )
+            cookie_obj = await sess.scalar(select(Cookie).where(Cookie.id == cookie_id))
+            await sess.execute(
+                delete(CookieTarget).where(CookieTarget.target == target_obj, CookieTarget.cookie == cookie_obj)
+            )
+            await sess.commit()
+
 
 config = DBConfig()

nonebot_bison/config/db_model.py

@@ -1,4 +1,5 @@
 import datetime
+from typing import Any
 from pathlib import Path
 
 from nonebot_plugin_saa import PlatformTarget
@@ -6,7 +7,7 @@ from sqlalchemy.dialects.postgresql import JSONB
 from nonebot.compat import PYDANTIC_V2, ConfigDict
 from nonebot_plugin_datastore import get_plugin_data
 from sqlalchemy.orm import Mapped, relationship, mapped_column
-from sqlalchemy import JSON, String, ForeignKey, UniqueConstraint
+from sqlalchemy import JSON, String, DateTime, ForeignKey, UniqueConstraint
 
 from ..types import Tag, Category
 
@@ -36,6 +37,7 @@ class Target(Model):
 
     subscribes: Mapped[list["Subscribe"]] = relationship(back_populates="target")
     time_weight: Mapped[list["ScheduleTimeWeight"]] = relationship(back_populates="target")
+    cookies: Mapped[list["CookieTarget"]] = relationship(back_populates="target")
 
 
 class ScheduleTimeWeight(Model):
@@ -66,3 +68,23 @@ class Subscribe(Model):
 
     target: Mapped[Target] = relationship(back_populates="subscribes")
     user: Mapped[User] = relationship(back_populates="subscribes")
+
+
+class Cookie(Model):
+    id: Mapped[int] = mapped_column(primary_key=True)
+    platform_name: Mapped[str] = mapped_column(String(20))
+    content: Mapped[str] = mapped_column(String(1024))
+    last_usage: Mapped[datetime.datetime] = mapped_column(DateTime, default=datetime.datetime(1970, 1, 1))
+    status: Mapped[str] = mapped_column(String(20), default="")
+    tags: Mapped[dict[str, Any]] = mapped_column(JSON().with_variant(JSONB, "postgresql"), default={})
+
+    targets: Mapped[list["CookieTarget"]] = relationship(back_populates="cookie")
+
+
+class CookieTarget(Model):
+    id: Mapped[int] = mapped_column(primary_key=True)
+    target_id: Mapped[int] = mapped_column(ForeignKey("nonebot_bison_target.id", ondelete="CASCADE"))
+    cookie_id: Mapped[int] = mapped_column(ForeignKey("nonebot_bison_cookie.id", ondelete="CASCADE"))
+
+    target: Mapped[Target] = relationship(back_populates="cookies")
+    cookie: Mapped[Cookie] = relationship(back_populates="targets")

nonebot_bison/config/migrations/590dc2911ea7_add_cookie.py

@@ -0,0 +1,59 @@
+"""empty message
+
+Revision ID: 590dc2911ea7
+Revises: f9baef347cc8
+Create Date: 2024-08-31 23:06:02.123932
+
+"""
+
+import sqlalchemy as sa
+from alembic import op
+from sqlalchemy import Text
+from sqlalchemy.dialects import postgresql
+
+# revision identifiers, used by Alembic.
+revision = "590dc2911ea7"
+down_revision = "f9baef347cc8"
+branch_labels = None
+depends_on = None
+
+
+def upgrade() -> None:
+    # ### commands auto generated by Alembic - please adjust! ###
+    op.create_table(
+        "nonebot_bison_cookie",
+        sa.Column("id", sa.Integer(), nullable=False),
+        sa.Column("platform_name", sa.String(length=20), nullable=False),
+        sa.Column("content", sa.String(length=1024), nullable=False),
+        sa.Column("last_usage", sa.DateTime(), nullable=False),
+        sa.Column("status", sa.String(length=20), nullable=False),
+        sa.Column("tags", sa.JSON().with_variant(postgresql.JSONB(astext_type=Text()), "postgresql"), nullable=False),
+        sa.PrimaryKeyConstraint("id", name=op.f("pk_nonebot_bison_cookie")),
+    )
+    op.create_table(
+        "nonebot_bison_cookietarget",
+        sa.Column("id", sa.Integer(), nullable=False),
+        sa.Column("target_id", sa.Integer(), nullable=False),
+        sa.Column("cookie_id", sa.Integer(), nullable=False),
+        sa.ForeignKeyConstraint(
+            ["cookie_id"],
+            ["nonebot_bison_cookie.id"],
+            name=op.f("fk_nonebot_bison_cookietarget_cookie_id_nonebot_bison_cookie"),
+            ondelete="CASCADE",
+        ),
+        sa.ForeignKeyConstraint(
+            ["target_id"],
+            ["nonebot_bison_target.id"],
+            name=op.f("fk_nonebot_bison_cookietarget_target_id_nonebot_bison_target"),
+            ondelete="CASCADE",
+        ),
+        sa.PrimaryKeyConstraint("id", name=op.f("pk_nonebot_bison_cookietarget")),
+    )
+    # ### end Alembic commands ###
+
+
+def downgrade() -> None:
+    # ### commands auto generated by Alembic - please adjust! ###
+    op.drop_table("nonebot_bison_cookietarget")
+    op.drop_table("nonebot_bison_cookie")
+    # ### end Alembic commands ###

nonebot_bison/config/utils.py

@@ -8,3 +8,7 @@ class NoSuchSubscribeException(Exception):
 
 class NoSuchTargetException(Exception):
     pass
+
+
+class DuplicateCookieTargetException(Exception):
+    pass

nonebot_bison/platform/bilibili/fsm.py

@@ -2,24 +2,10 @@ import sys
 import asyncio
 import inspect
 from enum import Enum
-from functools import wraps
 from dataclasses import dataclass
 from collections.abc import Set as AbstractSet
 from collections.abc import Callable, Sequence, Awaitable, AsyncGenerator
-from typing import (
+from typing import TYPE_CHECKING, Any, Generic, TypeVar, Protocol, TypeAlias, TypedDict, NamedTuple, runtime_checkable
-    TYPE_CHECKING,
-    Any,
-    Generic,
-    TypeVar,
-    Protocol,
-    ParamSpec,
-    TypeAlias,
-    TypedDict,
-    NamedTuple,
-    Concatenate,
-    overload,
-    runtime_checkable,
-)
 
 from nonebot import logger
 
@@ -31,7 +17,6 @@ TAddon = TypeVar("TAddon", contravariant=True)
 TState = TypeVar("TState", contravariant=True)
 TEvent = TypeVar("TEvent", contravariant=True)
 TFSM = TypeVar("TFSM", bound="FSM", contravariant=True)
-P = ParamSpec("P")
 
 
 class StateError(Exception): ...
@@ -178,52 +163,6 @@ class FSM(Generic[TState, TEvent, TAddon]):
         self.started = False
 
         del self.machine
-        self.current_state = self.graph["initial"]
         self.machine = self._core()
 
         logger.trace("FSM closed")
-
-
-@overload
-def reset_on_exception(
-    func: Callable[Concatenate[TFSM, P], Awaitable[ActionReturn]],
-) -> Callable[Concatenate[TFSM, P], Awaitable[ActionReturn]]:
-    """自动在发生异常后重置 FSM"""
-
-
-@overload
-def reset_on_exception(
-    auto_start: bool = False,
-) -> Callable[
-    [Callable[Concatenate[TFSM, P], Awaitable[ActionReturn]]], Callable[Concatenate[TFSM, P], Awaitable[ActionReturn]]
-]:
-    """自动在异常后重置 FSM，当 auto_start 为 True 时，自动启动 FSM"""
-
-
-# 参考自 dataclasses.dataclass 的实现
-def reset_on_exception(func=None, /, *, auto_start=False):  # pyright: ignore[reportInconsistentOverload]
-    def warp(func: Callable[Concatenate[TFSM, P], Awaitable[ActionReturn]]):
-        return __reset_clear_up(func, auto_start)
-
-    # 判断调用的是 @reset_on_exception 还是 @reset_on_exception(...)
-    if func is None:
-        # 调用的是带括号的
-        return warp
-
-    # 调用的是不带括号的
-    return warp(func)
-
-
-def __reset_clear_up(func: Callable[Concatenate[TFSM, P], Awaitable[ActionReturn]], auto_start: bool):
-    @wraps(func)
-    async def wrapper(fsm_self: TFSM, *args: P.args, **kwargs: P.kwargs) -> ActionReturn:
-        try:
-            return await func(fsm_self, *args, **kwargs)
-        except Exception as e:
-            logger.error(f"Exception in {func.__name__}: {e}")
-            await fsm_self.reset()
-            if auto_start and not fsm_self.started:
-                await fsm_self.start()
-            raise e
-
-    return wrapper

nonebot_bison/platform/bilibili/retry.py

@@ -14,7 +14,7 @@ from httpx import URL as HttpxURL
 from nonebot_bison.types import Target
 
 from .models import DynRawPost
-from .fsm import FSM, Condition, StateGraph, Transition, ActionReturn, reset_on_exception
+from .fsm import FSM, Condition, StateGraph, Transition, ActionReturn
 
 if TYPE_CHECKING:
     from .platforms import Bilibili
@@ -218,11 +218,6 @@ class RetryFSM(FSM[RetryState, RetryEvent, RetryAddon[TBilibili]]):
         self.addon.reset_all()
         await super().reset()
 
-    @override
-    @reset_on_exception
-    async def emit(self, event: RetryEvent):
-        await super().emit(event)
-
 
 # FIXME: 拿出来是方便测试了，但全局单例会导致所有被装饰的函数共享状态，有待改进
 _retry_fsm = RetryFSM(RETRY_GRAPH, RetryAddon["Bilibili"]())

nonebot_bison/platform/rss.py

@@ -10,12 +10,14 @@ from ..post import Post
 from .platform import NewMessage
 from ..types import Target, RawPost
 from ..utils import Site, text_similarity
+from ..utils.site import create_cookie_client_manager
 
 
 class RssSite(Site):
     name = "rss"
     schedule_type = "interval"
     schedule_setting = {"seconds": 30}
+    client_mgr = create_cookie_client_manager("rss")
 
 
 class RssPost(Post):
@@ -63,7 +65,7 @@ class Rss(NewMessage):
         return post.id
 
     async def get_sub_list(self, target: Target) -> list[RawPost]:
-        client = await self.ctx.get_client()
+        client = await self.ctx.get_client(target)
         res = await client.get(target, timeout=10.0)
         feed = feedparser.parse(res)
         entries = feed.entries

nonebot_bison/sub_manager/__init__.py

@@ -14,6 +14,8 @@ from nonebot.adapters.onebot.v11.event import PrivateMessageEvent
 from .add_sub import do_add_sub
 from .del_sub import do_del_sub
 from .query_sub import do_query_sub
+from .add_cookie import do_add_cookie
+from .add_cookie_target import do_add_cookie_target
 from .utils import common_platform, admin_permission, gen_handle_cancel, configurable_to_me, set_target_user_info
 
 add_sub_matcher = on_command(
@@ -26,12 +28,10 @@ add_sub_matcher = on_command(
 add_sub_matcher.handle()(set_target_user_info)
 do_add_sub(add_sub_matcher)
 
-
 query_sub_matcher = on_command("查询订阅", rule=configurable_to_me, priority=5, block=True)
 query_sub_matcher.handle()(set_target_user_info)
 do_query_sub(query_sub_matcher)
 
-
 del_sub_matcher = on_command(
     "删除订阅",
     rule=configurable_to_me,
@@ -42,6 +42,26 @@ del_sub_matcher = on_command(
 del_sub_matcher.handle()(set_target_user_info)
 do_del_sub(del_sub_matcher)
 
+add_cookie_matcher = on_command(
+    "添加cookie",
+    rule=configurable_to_me,
+    permission=admin_permission(),
+    priority=5,
+    block=True,
+)
+add_cookie_matcher.handle()(set_target_user_info)
+do_add_cookie(add_cookie_matcher)
+
+add_cookie_target_matcher = on_command(
+    "关联cookie",
+    rule=configurable_to_me,
+    permission=admin_permission(),
+    priority=5,
+    block=True,
+)
+add_cookie_target_matcher.handle()(set_target_user_info)
+do_add_cookie_target(add_cookie_target_matcher)
+
 group_manage_matcher = on_command("群管理", rule=to_me(), permission=SUPERUSER, priority=4, block=True)
 
 group_handle_cancel = gen_handle_cancel(group_manage_matcher, "已取消")

nonebot_bison/sub_manager/add_cookie.py

@@ -0,0 +1,60 @@
+from nonebot.typing import T_State
+from nonebot.matcher import Matcher
+from nonebot.params import Arg, ArgPlainText
+from nonebot.adapters import Message, MessageTemplate
+
+from ..types import Target
+from ..config import config
+from ..platform import platform_manager
+from ..apis import check_sub_target_cookie
+from .utils import common_platform, gen_handle_cancel
+
+
+def do_add_cookie(add_cookie: type[Matcher]):
+    handle_cancel = gen_handle_cancel(add_cookie, "已中止添加cookie")
+
+    @add_cookie.handle()
+    async def init_promote(state: T_State):
+        state["_prompt"] = (
+            "请输入想要添加 Cookie 的平台，目前支持，请输入冒号左边的名称：\n"
+            + "".join(
+                [f"{platform_name}: {platform_manager[platform_name].name}\n" for platform_name in common_platform]
+            )
+            + "要查看全部平台请输入：“全部”\n中止添加cookie过程请输入：“取消”"
+        )
+
+    @add_cookie.got("platform", MessageTemplate("{_prompt}"), [handle_cancel])
+    async def parse_platform(state: T_State, platform: str = ArgPlainText()) -> None:
+        if platform == "全部":
+            message = "全部平台\n" + "\n".join(
+                [f"{platform_name}: {platform.name}" for platform_name, platform in platform_manager.items()]
+            )
+            await add_cookie.reject(message)
+        elif platform == "取消":
+            await add_cookie.finish("已中止添加cookie")
+        elif platform in platform_manager:
+            state["platform"] = platform
+        else:
+            await add_cookie.reject("平台输入错误")
+
+    @add_cookie.handle()
+    async def prepare_get_id(matcher: Matcher, state: T_State):
+        cur_platform = platform_manager[state["platform"]]
+        if cur_platform.has_target:
+            state["_prompt"] = "请输入 Cookie"
+        else:
+            matcher.set_arg("cookie", None)  # type: ignore
+            state["id"] = "default"
+
+    @add_cookie.got("cookie", MessageTemplate("{_prompt}"), [handle_cancel])
+    async def got_cookie(state: T_State, cookie: Message = Arg()):
+        cookie_text = cookie.extract_plain_text()
+        state["cookie"] = cookie_text
+        state["name"] = await check_sub_target_cookie(state["platform"], Target(""), cookie_text)
+
+    @add_cookie.handle()
+    async def add_cookie_process(state: T_State):
+        await config.add_cookie(state["platform"], state["cookie"])
+        await add_cookie.finish(
+            f"已添加 Cookie: {state['cookie']} 到平台 {state['platform']}" + "\n请使用“关联cookie”为 Cookie 关联订阅"
+        )

nonebot_bison/sub_manager/add_cookie_target.py

@@ -0,0 +1,63 @@
+from nonebot.typing import T_State
+from nonebot.matcher import Matcher
+from nonebot.params import ArgPlainText
+from nonebot_plugin_saa import MessageFactory
+from nonebot.internal.adapter import MessageTemplate
+
+from ..config import config
+from ..utils import parse_text
+from ..apis import get_cookie_friendly_name
+from .utils import gen_handle_cancel, generate_sub_list_text
+
+
+def do_add_cookie_target(add_cookie_target_matcher: type[Matcher]):
+    handle_cancel = gen_handle_cancel(add_cookie_target_matcher, "已中止关联 cookie")
+
+    @add_cookie_target_matcher.handle()
+    async def init_promote(state: T_State):
+        res = await generate_sub_list_text(add_cookie_target_matcher, state, is_index=True, is_show_cookie=True)
+        res += "请输入要关联 cookie 的订阅的序号\n输入'取消'中止"
+        await MessageFactory(await parse_text(res)).send()
+
+    @add_cookie_target_matcher.got("target_idx", parameterless=[handle_cancel])
+    async def got_target_idx(state: T_State, target_idx: str = ArgPlainText()):
+        try:
+            target_idx = int(target_idx)
+            state["target"] = state["sub_table"][target_idx]
+        except Exception:
+            await add_cookie_target_matcher.reject("序号错误")
+
+    @add_cookie_target_matcher.handle()
+    async def init_promote_cookie(state: T_State):
+
+        cookies = await config.get_cookie(platform_name=state["target"]["platform_name"])
+        associated_cookies = await config.get_cookie(
+            target=state["target"]["target"],
+            platform_name=state["target"]["platform_name"],
+        )
+        associated_cookie_ids = {cookie.id for cookie in associated_cookies}
+        cookies = [cookie for cookie in cookies if cookie.id not in associated_cookie_ids]
+        if not cookies:
+            await add_cookie_target_matcher.finish(
+                "当前平台暂无可关联的 Cookie，请使用“添加cookie”命令添加或检查已关联的 Cookie"
+            )
+        state["cookies"] = cookies
+        state["_prompt"] = "请选择一个 Cookie，已关联的 Cookie 不会显示\n" + "\n".join(
+            [f"{idx}. {await get_cookie_friendly_name(cookie)}" for idx, cookie in enumerate(cookies, 1)]
+        )
+
+    @add_cookie_target_matcher.got("cookie_idx", MessageTemplate("{_prompt}"), [handle_cancel])
+    async def got_cookie_idx(state: T_State, cookie_idx: str = ArgPlainText()):
+        try:
+            cookie_idx = int(cookie_idx)
+            state["cookie"] = state["cookies"][cookie_idx - 1]
+        except Exception:
+            await add_cookie_target_matcher.reject("序号错误")
+
+    @add_cookie_target_matcher.handle()
+    async def add_cookie_target_process(state: T_State):
+        await config.add_cookie_target(state["target"]["target"], state["target"]["platform_name"], state["cookie"].id)
+        await add_cookie_target_matcher.finish(
+            f"已关联 Cookie: {await get_cookie_friendly_name(state['cookie'])} "
+            f"到订阅 {state['target']['platform_name']} {state['target']['target']}"
+        )

nonebot_bison/sub_manager/utils.py

@@ -1,16 +1,21 @@
 import contextlib
 from typing import Annotated
+from itertools import groupby
+from operator import attrgetter
 
 from nonebot.rule import Rule
 from nonebot.adapters import Event
 from nonebot.typing import T_State
 from nonebot.matcher import Matcher
 from nonebot.permission import SUPERUSER
-from nonebot_plugin_saa import extract_target
 from nonebot.params import Depends, EventToMe, EventPlainText
+from nonebot_plugin_saa import PlatformTarget, extract_target
 
+from ..config import config
+from ..types import Category
 from ..platform import platform_manager
 from ..plugin_config import plugin_config
+from ..apis import get_cookie_friendly_name
 
 
 def _configurable_to_me(to_me: bool = EventToMe()):
@@ -60,3 +65,46 @@ def admin_permission():
         permission = permission | GROUP_ADMIN | GROUP_OWNER
 
     return permission
+
+
+async def generate_sub_list_text(
+    matcher: type[Matcher], state: T_State, user_info: PlatformTarget = None, is_index=False, is_show_cookie=False
+):
+    if user_info:
+        sub_list = await config.list_subscribe(user_info)
+    else:
+        sub_list = await config.list_subs_with_all_info()
+        sub_list = [
+            next(group)
+            for key, group in groupby(sorted(sub_list, key=attrgetter("target_id")), key=attrgetter("target_id"))
+        ]
+    if not sub_list:
+        await matcher.finish("暂无已订阅账号\n请使用“添加订阅”命令添加订阅")
+    res = "订阅的帐号为：\n"
+    state["sub_table"] = {}
+    for index, sub in enumerate(sub_list, 1):
+        state["sub_table"][index] = {
+            "platform_name": sub.target.platform_name,
+            "target": sub.target.target,
+        }
+        res += f"{index} " if is_index else ""
+        res += f"{sub.target.platform_name} {sub.target.target_name} {sub.target.target}\n"
+        if platform := platform_manager.get(sub.target.platform_name):
+            if platform.categories:
+                res += " [{}]".format(", ".join(platform.categories[Category(x)] for x in sub.categories)) + "\n"
+            if platform.enable_tag:
+                if sub.tags:
+                    res += " {}".format(", ".join(sub.tags)) + "\n"
+            if is_show_cookie:
+                target_cookies = await config.get_cookie(
+                    target=sub.target.target, platform_name=sub.target.platform_name
+                )
+                if target_cookies:
+                    res += "  关联的 Cookie：\n"
+                    for cookie in target_cookies:
+                        res += f"  \t{await get_cookie_friendly_name(cookie)}\n"
+
+        else:
+            res += f" （平台 {sub.target.platform_name} 已失效，请删除此订阅）"
+
+    return res

nonebot_bison/utils/site.py

@@ -1,9 +1,12 @@
+import json
 from typing import Literal
 from abc import ABC, abstractmethod
 
+import httpx
 from httpx import AsyncClient
 
 from ..types import Target
+from ..config import config
 from .http import http_client
 
 
@@ -35,6 +38,45 @@ class DefaultClientManager(ClientManager):
         pass
 
 
+class CookieClientManager(ClientManager):
+    _platform_name: str
+
+    async def _choose_cookie(self, target: Target) -> dict[str, str]:
+        if not target:
+            return {}
+        cookies = await config.get_cookie_by_target(target, self._platform_name)
+        if not cookies:
+            return {}
+        cookie = sorted(cookies, key=lambda x: x.last_usage, reverse=True)[0]
+        return json.loads(cookie.content)
+
+    async def get_client(self, target: Target | None) -> AsyncClient:
+        client = http_client()
+        cookie = await self._choose_cookie(target)
+        cookies = httpx.Cookies()
+        if cookie:
+            cookies.update(cookie)
+        client.cookies = cookies
+        return client
+
+    async def get_client_for_static(self) -> AsyncClient:
+        pass
+
+    async def get_query_name_client(self) -> AsyncClient:
+        pass
+
+    async def refresh_client(self):
+        pass
+
+
+def create_cookie_client_manager(platform_name: str) -> type[CookieClientManager]:
+    return type(
+        "CookieClientManager",
+        (CookieClientManager,),
+        {"_platform_name": platform_name},
+    )
+
+
 class Site:
     schedule_type: Literal["date", "interval", "cron"]
     schedule_setting: dict

package.json

@@ -11,9 +11,9 @@
     "docs:update-package": "pnpm dlx vp-update"
   },
   "devDependencies": {
-    "@vuepress/bundler-vite": "2.0.0-rc.15",
+    "@vuepress/bundler-vite": "2.0.0-rc.14",
-    "vue": "^3.5.6",
+    "vue": "^3.4.31",
-    "vuepress": "2.0.0-rc.15",
+    "vuepress": "2.0.0-rc.14",
-    "vuepress-theme-hope": "2.0.0-rc.52"
+    "vuepress-theme-hope": "2.0.0-rc.50"
   }
 }

pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "nonebot-bison"
-version = "0.9.4"
+version = "0.9.3"
 description = "Subscribe message from social medias"
 authors = ["felinae98 <felinae225@qq.com>"]
 license = "MIT"
@@ -24,40 +24,40 @@ classifiers = [
 python = ">=3.10,<4.0.0"
 beautifulsoup4 = ">=4.12.3"
 feedparser = "^6.0.11"
-httpx = ">=0.27.2"
+httpx = ">=0.27.0"
-nonebot2 = { extras = ["fastapi"], version = "^2.3.3" }
+nonebot2 = { extras = ["fastapi"], version = "^2.3.2" }
-nonebot-adapter-onebot = "^2.4.5"
+nonebot-adapter-onebot = "^2.4.4"
-nonebot-plugin-htmlrender = ">=0.3.5"
+nonebot-plugin-htmlrender = ">=0.3.3"
 nonebot-plugin-datastore = ">=1.3.0,<2.0.0"
 nonebot-plugin-apscheduler = ">=0.5.0"
-nonebot-plugin-send-anything-anywhere = ">=0.7.1,<0.7.2"
+nonebot-plugin-send-anything-anywhere = ">=0.6.1,<0.7.0"
-pillow = ">=10.4.0,<11.0"
+pillow = ">=8.4.0,<11.0"
-pyjwt = "^2.9.0"
+pyjwt = "^2.8.0"
-python-socketio = "^5.11.4"
+python-socketio = "^5.11.3"
 tinydb = "^4.8.0"
 qrcode = "^7.4.2"
-pydantic = ">=2.9.2,<3.0.0,!=2.5.0,!=2.5.1"
+pydantic = ">=1.10.17,<3.0.0,!=2.5.0,!=2.5.1"
-lxml = ">=5.3.0"
+lxml = ">=5.2.2"
-yarl = ">=1.11.1"
+yarl = ">=1.9.4"
-hishel = "^0.0.30"
+hishel = "^0.0.20"
-expiringdictx = "^1.1.0"
+expiringdictx = "^1.0.1"
-rapidfuzz = "^3.9.7"
+rapidfuzz = "^3.9.3"
 
 [tool.poetry.group.dev.dependencies]
-black = ">=24.8.0,<25.0"
+black = ">=23.12.1,<25.0"
 ipdb = "^0.13.13"
 isort = "^5.13.2"
 nonemoji = "^0.1.4"
-nb-cli = "^1.4.2"
+nb-cli = "^1.4.1"
-pre-commit = "^3.8.0"
+pre-commit = "^3.7.1"
-ruff = "^0.6.5"
+ruff = "^0.6.0"
 
 [tool.poetry.group.test.dependencies]
 flaky = "^3.8.1"
 nonebug = "^0.3.7"
 nonebug-saa = "^0.4.1"
-pytest = ">=8.3.3,<9.0.0"
+pytest = ">=7.4.4,<9.0.0"
-pytest-asyncio = ">=0.24.0,<0.24.1"
+pytest-asyncio = ">=0.23.7,<0.24.0"
 pytest-cov = ">=5.0.0,<6"
 pytest-mock = "^3.14.0"
 pytest-xdist = { extras = ["psutil"], version = "^3.6.1" }
@@ -68,10 +68,10 @@ freezegun = "^1.5.1"
 optional = true
 
 [tool.poetry.group.docker.dependencies]
-nb-cli = "^1.4.2"
+nb-cli = "^1.4.1"
-nonebot2 = { extras = ["fastapi", "aiohttp"], version = "^2.3.3" }
+nonebot2 = { extras = ["fastapi", "aiohttp"], version = "^2.3.2" }
 nonebot-adapter-red = "^0.9.0"
-nonebot-adapter-qq = "^1.5.1"
+nonebot-adapter-qq = "^1.4.4"
 poetry-core = "^1.9.0"
 
 [tool.poetry.extras]

tests/config/test_cookie.py

@@ -0,0 +1,107 @@
+import datetime
+
+from nonebug import App
+
+
+async def test_get_platform_target(app: App, init_scheduler):
+    from nonebot_plugin_saa import TargetQQGroup
+
+    from nonebot_bison.config.db_config import config
+    from nonebot_bison.types import Target as T_Target
+
+    await config.add_subscribe(
+        TargetQQGroup(group_id=123),
+        target=T_Target("weibo_id"),
+        target_name="weibo_name",
+        platform_name="weibo",
+        cats=[],
+        tags=[],
+    )
+    # await config.add_cookie(TargetQQGroup(group_id=123), "weibo", "cookie")
+    # cookies = await config.get_cookie_by_user(TargetQQGroup(group_id=123))
+    #
+    # res = await config.get_platform_target("weibo")
+    # assert len(res) == 2
+    # await config.del_subscribe(TargetQQGroup(group_id=123), T_Target("weibo_id1"), "weibo")
+    # res = await config.get_platform_target("weibo")
+    # assert len(res) == 2
+    # await config.del_subscribe(TargetQQGroup(group_id=123), T_Target("weibo_id"), "weibo")
+    # res = await config.get_platform_target("weibo")
+    # assert len(res) == 1
+    #
+    # async with AsyncSession(get_engine()) as sess:
+    #     res = await sess.scalars(select(Target).where(Target.platform_name == "weibo"))
+    #     assert len(res.all()) == 2
+    # await config.get_cookie_by_user(TargetQQGroup(group_id=123))
+
+
+async def test_cookie_by_user(app: App, init_scheduler):
+    from nonebot_plugin_saa import TargetQQGroup
+
+    from nonebot_bison.config.db_config import config
+    from nonebot_bison.types import Target as T_Target
+
+    await config.add_subscribe(
+        TargetQQGroup(group_id=123),
+        target=T_Target("weibo_id"),
+        target_name="weibo_name",
+        platform_name="weibo",
+        cats=[],
+        tags=[],
+    )
+
+    await config.add_cookie(TargetQQGroup(group_id=123), "weibo", "cookie")
+
+    cookies = await config.get_cookie(TargetQQGroup(group_id=123))
+    cookie = cookies[0]
+    assert len(cookies) == 1
+    assert cookie.content == "cookie"
+    assert cookie.platform_name == "weibo"
+    cookie.last_usage = 0
+    assert cookie.status == ""
+    assert cookie.tags == {}
+    cookie.content = "cookie1"
+    cookie.last_usage = datetime.datetime(2024, 8, 22, 0, 0, 0)
+    cookie.status = "status1"
+    cookie.tags = {"tag1": "value1"}
+    await config.update_cookie(cookie)
+    cookies = await config.get_cookie(TargetQQGroup(group_id=123))
+
+    assert len(cookies) == 1
+    assert cookies[0].content == cookie.content
+    assert cookies[0].last_usage == cookie.last_usage
+    assert cookies[0].status == cookie.status
+    assert cookies[0].tags == cookie.tags
+
+    await config.delete_cookie(cookies[0].id)
+    cookies = await config.get_cookie(TargetQQGroup(group_id=123))
+    assert len(cookies) == 0
+
+
+async def test_cookie_target_by_target(app: App, init_scheduler):
+    from nonebot_plugin_saa import TargetQQGroup
+
+    from nonebot_bison.config.db_config import config
+    from nonebot_bison.types import Target as T_Target
+
+    await config.add_subscribe(
+        TargetQQGroup(group_id=123),
+        target=T_Target("weibo_id"),
+        target_name="weibo_name",
+        platform_name="weibo",
+        cats=[],
+        tags=[],
+    )
+
+    id = await config.add_cookie(TargetQQGroup(group_id=123), "weibo", "cookie")
+
+    await config.add_cookie_target(T_Target("weibo_id"), "weibo", id)
+
+    cookies = await config.get_cookie_by_target(T_Target("weibo_id"), "weibo")
+    assert len(cookies) == 1
+    assert cookies[0].content == "cookie"
+    assert cookies[0].platform_name == "weibo"
+
+    await config.delete_cookie_target(T_Target("weibo_id"), "weibo", id)
+    cookies = await config.get_cookie_by_target(T_Target("weibo_id"), "weibo")
+    assert len(cookies) == 0

tests/platforms/test_bilibili.py

@@ -58,92 +58,6 @@ def without_dynamic(app: App):
     )
 
 
-@pytest.mark.asyncio
-async def test_reset_on_exception(app: App):
-    from strenum import StrEnum
-
-    from nonebot_bison.platform.bilibili.fsm import FSM, StateGraph, Transition, ActionReturn, reset_on_exception
-
-    class State(StrEnum):
-        A = "A"
-        B = "B"
-        C = "C"
-
-    class Event(StrEnum):
-        A = "A"
-        B = "B"
-        C = "C"
-
-    class Addon:
-        pass
-
-    async def raction(from_: State, event: Event, to: State, addon: Addon) -> ActionReturn:
-        logger.info(f"action: {from_} -> {to}")
-        raise RuntimeError("test")
-
-    async def action(from_: State, event: Event, to: State, addon: Addon) -> ActionReturn:
-        logger.info(f"action: {from_} -> {to}")
-
-    graph: StateGraph[State, Event, Addon] = {
-        "transitions": {
-            State.A: {
-                Event.A: Transition(raction, State.B),
-                Event.B: Transition(action, State.C),
-            },
-            State.B: {
-                Event.B: Transition(action, State.C),
-            },
-            State.C: {
-                Event.C: Transition(action, State.A),
-            },
-        },
-        "initial": State.A,
-    }
-
-    addon = Addon()
-
-    class AFSM(FSM[State, Event, Addon]):
-        @reset_on_exception(auto_start=True)
-        async def emit(self, event: Event):
-            return await super().emit(event)
-
-    fsm = AFSM(graph, addon)
-
-    await fsm.start()
-    with pytest.raises(RuntimeError):
-        await fsm.emit(Event.A)
-
-    assert fsm.started is True
-    await fsm.emit(Event.B)
-    await fsm.emit(Event.C)
-
-    class BFSM(FSM[State, Event, Addon]):
-        @reset_on_exception
-        async def emit(self, event: Event):
-            return await super().emit(event)
-
-    fsm = BFSM(graph, addon)
-    await fsm.start()
-    with pytest.raises(RuntimeError):
-        await fsm.emit(Event.A)
-
-    assert fsm.started is False
-    with pytest.raises(TypeError, match="can't send non-None value to a just-started async generator"):
-        await fsm.emit(Event.B)
-
-    class CFSM(FSM[State, Event, Addon]): ...
-
-    fsm = CFSM(graph, addon)
-    await fsm.start()
-    with pytest.raises(RuntimeError):
-        await fsm.emit(Event.A)
-
-    assert fsm.started is True
-
-    with pytest.raises(StopAsyncIteration):
-        await fsm.emit(Event.B)
-
-
 @pytest.mark.asyncio
 async def test_retry_for_352(app: App, mocker: MockerFixture):
     from nonebot_bison.post import Post

结项报告.md

@@ -1,230 +0,0 @@
-<br><br><br>
-
-<center><p style="font-size:56px"><b>结项报告</b></p></center>
-
-<br>
-
-<center>项目名称：<u>bison 爬虫的 Cookie 管理与调度系统</u></center>
-
-<center>项目主导师：<u><a href="mailto:felinae225@qq.com ">felinae98</a></u></center>
-
-<center>报告人：<u>杜家楷</u></center>
-
-<center>日期：<u>2024.09.30</u></center>
-
-<center>邮箱：<u>suyiiyii@gmail.com</u></center>
-
-[toc]
-
-# 项目背景
-
-Bison 是一个支持从各个站点和社交平台获取信息，并推送到 QQ 的 NoneBot 插件。但是随着从各个网站获取信息难得的提升，Bison 需要支持携带 Cookie 进行请求。
-
-本项目旨在为 Bison 添加 Cookie 功能的支持。完成一个通用的 Cookie 组件，为各个平台的信息采集提供支持并保证扩展能力，需要同时支持实名 Cookie 和匿名 Cookie 的调度；同时要实现完善的 UI 供管理员进行管理。
-
-# 方案描述：
-
-继承原有的 ClientManager，创建 CookieClientManger，在获取 client 时，会根据 Target 信息自动选择合适的 Cookie。
-
-## cookie 存储
-
-因为 Cookie 和订阅的 Target 之间是多对多关系，所以创建两张表，一张 Cookie 表用于存储 Cookie 的内容和状态等信息，另一张是 CookieTarget 表，用于存储 Cookie 和 target 直接的关系。
-
-```mermaid
-classDiagram
-    class Cookie {
-        int id
-        str site_name
-        str content
-        str cookie_name
-        datetime last_usage
-        str status
-        int cd_milliseconds
-        bool is_universal
-        bool is_anonymous
-        dict[str, Any] tags
-    }
-    class CookieTarget {
-        int id
-        int target_id
-        int cookie_id
-    }
-```
-
-## 获取 Cookie
-
-```python
-async def get_client(self, target: Target | None) -> AsyncClient: ...
-
-async def get_client_for_static(self) -> AsyncClient: ...
-
-async def get_query_name_client(self) -> AsyncClient: ...
-
-async def refresh_client(self): ...
-```
-
-现有的 ClientManager 有以上方法，Platform 模块抓取时，用的是 get_client 方法，获取到 AsyncClient，再使用获取到的 AsyncClient 进行请求。所以，只需要重写 get_client 方法，根据传入的 Target 信息返回带有 Cookie 的 client，即可实现携带 Cookie 请求。
-
-## 调度 Cookie
-
-首先，cookie 分为实名 Cookie 和匿名 Cookie。实名 Cookie 为用户上传的 cookie，匿名 Cookie 为程序可以自动生成的 cookie。
-
-同时，项目内还存在没有 target 概念的 Platform，还需要兼容这种情况。
-
-为了调度 Cookie，添加了`status` 、`last_usage`、 `cd`、 `is_anonymous` 等字段，具体定义和含义见下：
-
-```python
-    # 最后使用的时刻
-    last_usage: Mapped[datetime.datetime] = mapped_column(DateTime, default=datetime.datetime(1970, 1, 1))
-    # Cookie 当前的状态
-    status: Mapped[str] = mapped_column(String(20), default="")
-    # 使用一次之后，需要的冷却时间
-    cd_milliseconds: Mapped[int] = mapped_column(default=0)
-    # 是否是通用 Cookie（对所有 Target 都有效）
-    is_universal: Mapped[bool] = mapped_column(default=False)
-    # 是否是匿名 Cookie
-    is_anonymous: Mapped[bool] = mapped_column(default=False)
-    # 标签，扩展用
-    tags: Mapped[dict[str, Any]] = mapped_column(JSON().with_variant(JSONB, "postgresql"), default={})
-```
-
-其中：
-
-- **is_universal**：用于标记 Cookie 是否为通用 Cookie，即对所有 Target 都有效。可以理解为是一种特殊的 target，添加 Cookie 和获取 Cookie 时通过传入参数进行设置。
-
-- **is_anonymous**：用于标记 Cookie 是否为匿名 Cookie，目前的定义是：可以由程序自动生成的，适用于所有 target 的 Cookie。目前的逻辑是 bison 启动时，删除原有的匿名 cookie，再生成一个新的匿名 cookie。
-
-- **无 Target 平台的 Cookie 处理方式**
-
-  对于不存在 Target 的平台，如小刻食堂，可以重写 init_cookie 方法，为用户 Cookie 设置 is_universal 属性。这样，在获取 Client 时，由于传入的 Target 为空，就只会选择 is_universal 的 cookie。实现了无 Target 平台的用户 Cookie 调度。
-
-## 选择 cookie
-
-### 一种基于优先队列的 Cookie 选择算法
-
-只是简单的选择。
-
-设定：
-
-- Cookie 的「空闲时间」定义为从上次被选择到现在，经过的时间
-- 每一个 Cookie 有一个独立的 CD，每次使用之后必须间隔一定时间后才能够再次使用
-- 匿名 Cookie 作为保底，设置比实名 Cookie 短的 CD
-
-实现思路
-
-- 在每次 Cookie 被选择时，记录此时的时间
-- 每次选择时，选择空闲时间最长的 Cookie，并检查是否过了 CD，如果还在冷却，则选择下一个 Cookie，否则选择该 Cookie
-- 如果没有可用的 Cookie，则跳过本次选择
-
-# 时间规划：
-
-## 调研和熟悉阶段（07 月 01 日 - 08 月 01 日）
-
-- [x] 调研主流平台 Cookie 使用情况
-- [x] 详细阅读代码，跟踪调试，熟悉项目细节
-- [x] 整理开发方案，提交社区讨论
-
-## 开发阶段（08 月 01 日 - 09 月 01 日）
-
-- [x] 和社区共同讨论，确定开发方案
-- [x] 编写核心功能模块
-- [x] 添加相关组件的单元测试
-
-## 整理和收尾阶段（09 月 01 日 - 09 月 30 日）
-
-- [x] 和社区一起验收核心功能模块
-- [x] 完善相关文档
-- [x] 思考可以改进或者补充的地方
-
-# 效果展示
-
-## 使用对话添加 Cookie
-
-<img src="assets/image-20240928161112657.png" alt="image-20240928161112657" style="zoom:50%;" />
-
-## 使用对话关联 Cookie 到 Target
-
-<img src="assets/image-20240928161504145.png" alt="image-20240928161504145" style="zoom:50%;" />
-
-在此之后，Bison 会携带用户上传的 Cookie 进行请求，可以抓取到受限制的内容，比如说仅粉丝可见的消息
-
-<img src="assets/image-20240928171940890.png" alt="image-20240928171940890" style="zoom:50%;" />
-
-## 删除 Cookie
-
-<img src="assets/image-20240928172609762.png" alt="image-20240928172609762" style="zoom:50%;" />
-
-## Web UI
-
-在 Bison 原有 Web UI 的基础上，添加了管理 Cookie 的功能。
-
-<img src="assets/image-20240929160056550.png" alt="image-20240929160056550" style="zoom:50%;" />
-
-# 项目难点
-
-我认为项目的难点主要在 Cookie 的调度上。
-
-## 调度基础
-
-因为项目支持多个用户同时使用，每个用户都支持订阅不同的平台，项目对订阅的管理方式并不是简单的租户之间隔离，而是共用一套调度器。例如，如果用户A和用户B同时订阅了一个Target ，此Target并不会重复采集，而是采集之后同时发送给用户A和用户B。因此，在引入Cookie之后，如果只有一个用户上传了Cookie，那么使用该Cookie采集到的信息，是否要转发给另一个用户？
-
-经过和社区讨论，答案是：要转发。在此基础上我的解决方案是，全局仍然共用调度器，采取原有的调度逻辑。但是实际请求前，获取AsyncClient时，会根据请求的Target选择合适的Cookie。
-
-同时，一个实名Cookie可以访问多个受限的资源（例如一个账号可以关注多个微博用户），一个受限的资源也可以通过多个实名Cookie去访问。因此需要合理的对Cookie进行建模。
-
-我抽象了Cookie和CookieTarget两种对象，前者存储Cookie数据，后者存储Cookie和Target的关系，来处理Cookie和Target之间的多对多关系。
-
-## 实名Cookie和匿名Cookie
-
-实名Cookie指的是用户上传的Cookie，匿名Cookie指的是程序能够自己生成的Cookie。Bison 原来只有匿名Cookie，当匿名Cookie失效之后，会尝试重新生成Cookie，基本无额外成本。而如果使用实名Cookie，频繁请求可能会使Cookie关联的用户有安全风险，因此需要指定合理的请求策略。
-
-我将实名Cookie和匿名Cookie进行统一管理，使用同样的调度逻辑进行处理，但是匿名Cookie将会有与实名Cookie不同的参数。让两者在同一个框架下实现了统一调度。
-
-## 无目标概念的平台
-
-Bison还支持采集公告、博客类的，没有「目标」概念的站点（有目标概念的站点有微博，B站等）。对于此类平台，添加Cookie之后，无需关联到Target，也可以说只有该平台一个Target。
-
-对此，我给Cookie添加了`is_universal`属性，用来表示该Cookie是否适用于平台的所有Target，调度时默认在选择范围内。也为匿名Cookie的实现提供支持。
-
-## Cookie 调度
-
-为了实现在安全范围内尽可能快速采集的要求，我设计了默认的调度策略。
-
-- 选择所有匹配的Cookie（包括有关联的和`is_universal`的）
-- 在匹配的Cookie集合中，选择满足`last_usage + cd < now()`且`last_usage`值最小的Cookie
-
-这样做，可以以一种简单的方式实现对实名Cookie的选择，同时提供匿名Cookie为备用方案。
-
-同时，在编写Cookie模块时，我把调度Cookie中的各个阶段都使用函数抽象出来，如选择Cookie、组装Client、状态回写等，便于适配平台的个性化需求。
-
-# 项目总结
-
-- 已完成工作：
-
-  - 完成 CookieClientManger
-  - 创建存储 Cookie 的数据表，支持 CookieClientManger 选择 Cookie。
-  - 为管理员管理 Cookie 创建对话交互
-  - 在原有的 WebUI 上添加管理 Cookie 功能
-  - 导入导出功能支持 Cookie
-
-- 测试用例：
-
-  按照项目开发规范编写单元测试，覆盖率不下降，不低于 85%。
-
-- 后续工作安排：
-
-  目前，项目的功能已经开发完毕，已提交 PR。但由于个人和社区的时间分配问题，PR 的 review 工作还在进行中，所以接下来的时间将会和社区成员一起修改 PR，达到社区的要求后合并。
-
-# 心得体会
-
-起初，我是在学校里师兄的推荐下，了解到开源之夏活动。我自己很早就了解到开源，也想要参与开源，但是一直没有好的途径，非常感谢活动的组织方提供了这样一个机会让我接触开源，参与开源。
-
-我们的项目主要编程语言是 Python，在以往，我只会用 Python 写一些自用的脚本，最多就是一下简单的 REST API 后端，都是大家口中的「玩具」。而参与此次项目，才让我了解到一个真正有产品，有用户的开源项目是怎么运行的。Release、Issue、PR&Review，还有大家在一起讨论交流，这都是我做自己的项目体验不到的。
-
-同时，参与此次项目也极大的提高了我的代码能力，`装饰器`，`元类`，`类型参数`等高级用法，都是我之前没有接触过或接触过但仅限于使用的。还有单元测试，单元测试我一直想做，但是总是遇到些解决不了的问题就放弃了，项目中大量的单元测试，我可以照着已有的去写我自己的，在这个过程中我学到了很多。还有，项目惜字如金的码风，也极大的提高了我阅读缺少注释的代码的能力。
-
-这在里，要感谢社区的成员们，愿意回答我这个新人的各种问题，给我的代码和报告提建议，群友直接还有时不时的互动，给我家的感觉。
-
-还要特别感谢我的导师（felinae98），像一个家长一样，~~及时的~~详尽的 review 我的代码，通过引导让我自己意识到我的方案存在什么问题，并提供改进方案。对于我和社区提出的一些自己觉得很合理的方案，详细的给我们分析项目的情况和引入之后导致的复杂度，以及引入的必要性。我在后来更加深刻的理解项目之后才意识到，当时提出的方案是一个过度设计，也更加认可导师的观点。
-
-非常高兴能够参与开源之夏活动。未来，我将继续热衷于开源事业，积极参与其中。