100 Commits

This Branch

This Branch

All Branches

• fix: disable thinking
  earthjasonlin 2026-09-05 10:21:39 +08:00
  Verified 1a337aba4d
• fix(unsub): List-Unsubscribe 头兜底 + mailto 退订按钮放行

  两封推广邮件无退订按钮，两个独立根因：
  1. Cloudflare 邮件 (msg_id=1364)：程序只喂纯文本给 AI，纯文本里
     'Unsubscribe' 无 URL；邮件头 List-Unsubscribe 的权威退订链接被丢弃。
     -> 解析 List-Unsubscribe 头 (RFC 2369) 存入 Email.list_unsubscribe，
        注入 AI 提示词；显示层新增 _ensure_unsub_link 兜底：AI 漏提取时
        直接用头部 http(s)/mailto 链接补退订按钮（不依赖 AI）。
  2. InferX 邮件 (msg_id=1363)：AI 提取到 mailto:team@inferx.net?subject=Unsubscribe，
     但 _link_buttons 只放行 http 协议把它过滤掉。
     -> URL 校验放行 mailto:（退订场景常见）。
  
  send_summary / tg_send_and_mark 均应用兜底并写回 summary_data.links，
  回调恢复视图也能显示退订按钮。新增 6 个测试，共 14 个全部通过。

  earthjasonlin 2026-09-04 08:03:45 +08:00
  f65e67c2f2
• fix(tg_bot): 放宽退订链接 URL 长度上限，长 tracking 链接不被误杀

  实测 D:\DOWNLOADS\mail_bot.db 中 ChatGPT 推广邮件的退订链接
  (https://r.openai.com/asm/unsubscribe/?...) 长度 700+ 字符，
  而 _link_buttons 的 len(url) < 200 校验会把它过滤掉，导致
  即使 AI 提取出退订链接、显示层也修好了，按钮依然不显示。
  上限 200 -> 2048（Telegram inline URL 按钮安全范围）。
  
  新增回归测试 test_long_unsub_url_rendered / test_oversized_url_filtered，
  共 9 个用例全部通过。

  earthjasonlin 2026-09-03 23:52:31 +08:00
  8a471cb489
• fix(tg_bot): 推广邮件键盘渲染退订链接 + 强化提示词提取优先级

  - _summary_keyboard 推广分支忽略 links 参数，AI 提取到退订链接也不显示
    现改为退订链接排第一行(🔕)，保留告诉我更多/查看原文按钮
  - CALLBACK_PROMO_DETAIL 展开详情键盘同样带上退订链接
  - 抽取 _is_unsub_link/_link_buttons 辅助函数，退订链接(含 URL 关键词变体)排最前
  - SYSTEM_PROMPT: 退订提取规则提升为最高优先级，推广邮件必须输出退订链接
    且占 links 第一位，其余链接最多 2 条，不得挤掉退订链接
  - 新增 tests/test_unsub_keyboard.py 7 个用例全部通过

  earthjasonlin 2026-09-03 23:03:55 +08:00
  8dc85faf19
• fix: use find_user_by_chat_id for expand_promo_detail AI config
  earthjasonlin 2026-07-23 11:28:28 +08:00
  c28825ec87
• feat: AI hint supports multi-turn conversation with context - hint_history list stored in conversation, accumulates across rounds - Each new hint appended, full history passed to AI as combined prompt - Format: 'hint1 → hint2 → hint3' so AI understands the conversation flow
  earthjasonlin 2026-07-22 13:32:09 +08:00
  a517768083
• fix: use original email subject for reply, not AI-extracted title Reply emails should use the original subject from IMAP header (e.g. 'Re: [original]'), not the AI-generated Chinese summary title.
  earthjasonlin 2026-07-22 13:28:36 +08:00
  e0c2110c09
• fix: wrap original text in code block to avoid MarkdownV2 parse errors Email bodies contain *, _, etc. that break MarkdownV2 entity parsing. Wrapping in backtick code block prevents Telegram from parsing internals.
  earthjasonlin 2026-07-19 05:54:20 +08:00
  b18dcb0527
• feat: cleanup reply flow messages + AI comparison explanation - Track extra_msg_ids in conversation for code block messages - _cleanup_conv_messages: delete all intermediate messages on cancel/send - Cancel/send/edit all clean up extra messages before restoring summary view - AI prompts now return 'comparison' field with Chinese explanation of differences - _show_ai_suggestions displays comparison text above button list - generate_more_replies returns {suggestions, comparison}
  earthjasonlin 2026-07-19 01:28:05 +08:00
  9adb32cb0c
• feat: show full recipient and CC in email summary - Email class: add cc field - fetch_unseen_emails: parse Cc header - _format_normal: display full recipient, add CC line if present - send_summary/ai_process: pass cc through to email_context - save_email_context: store cc for callback use
  earthjasonlin 2026-07-18 20:07:21 +08:00
  beaa3f146e
• fix: update email_client and smtp_client for new config structure - email_client: use account.imap.server/port/ssl/starttls instead of flat fields - smtp_client: use s.ssl/starttls instead of s.use_ssl/use_starttls - tg_bot: fix _do_send_reply to use find_user_by_chat_id for email_accounts
  earthjasonlin 2026-07-17 22:19:20 +08:00
  7a01b29655
• chore: remove old YAML config files, keep config.example.json
  earthjasonlin 2026-07-17 22:08:14 +08:00
  c6180834bc
• feat: multi-user support - Config format: JSON with bot_token (global), users array - Each user has chat_id, AI config, email_accounts - Each email account has separate IMAP/SMTP with ssl/starttls - Config module: new dataclasses (UserConfig, ImapConfig, SmtpConfig) - find_user_by_chat_id() for callback dispatch - Main: email poller iterates all users, queues carry user object - Summarizer: accepts UserConfig, uses user-specific AI and chat_id - TG bot: all functions use bot_token string instead of TelegramConfig - Callback/message handlers look up user by chat_id - AI regen/hint threads use find_user_by_chat_id for AI config - Config example: config.example.json - Tests: 3/3 passing
  earthjasonlin 2026-07-17 22:05:59 +08:00
  f2b3793d4c
• chore: remove reply_suggestions from email summarization prompt AI reply suggestions are now generated on-demand when user clicks full/short reply buttons, using style-specific prompts.
  earthjasonlin 2026-07-17 21:02:50 +08:00
  9906f1675f
• fix: always regenerate AI replies when selecting style, ignore summary cache The cached reply_suggestions from summarization use a generic prompt, not matching full/short style. Now always triggers fresh generation.
  earthjasonlin 2026-07-17 21:01:03 +08:00
  8386ab3c89
• fix: pass links/is_promotion to _summary_keyboard in cancel and send_reply handlers
  earthjasonlin 2026-07-17 20:56:59 +08:00
  1d70fe2491
• feat: 2-col reply buttons, direct send, language-matched prompts - Buttons: [回复N 直接发送] [回复N 编辑] in 2-column layout - CALLBACK_SEND_REPLY: send immediately without editing - Prompts enforce matching email language (no Chinese forced on English) - Full mode: greeting + comma only, no [Your Name] placeholder - Tests: 5/5 passing
  earthjasonlin 2026-07-17 20:49:11 +08:00
  bedf5b887c
• fix: clear reply suggestions cache on cancel, regenerate when switching styles - Cancel now clears reply_suggestions from email_context - Selecting style with empty cache triggers fresh AI generation - Selecting style with cache uses cached suggestions - Tests: 3/3 passing
  earthjasonlin 2026-07-17 20:33:09 +08:00
  6ce9a806ea
• fix: send AI suggestion as MarkdownV2 code block for copy-on-tap
  earthjasonlin 2026-07-17 20:28:46 +08:00
  84f2428aeb
• feat: AI reply suggestions show as copyable code block, user edits before sending - Click suggestion -> show text in backtick code block (tap to copy) - Enter awaiting_reply state so user can edit/send like normal reply - No direct email sending on selection anymore - Tests: 3/3 passing
  earthjasonlin 2026-07-17 20:23:59 +08:00
  51064e48aa
• feat: AI reply modes - full (formal email) and short (concise) - Split 'AI回复' button into 'AI完整回复' and 'AI简洁回复' - Full mode: complete email format with greeting/signature, 300 char limit - Short mode: brief text message style, 50 char limit - Style persists in conversation state for regen/hint consistency - Tests: 6/6 passing
  earthjasonlin 2026-07-17 20:14:48 +08:00
  ab2bf7facb
• fix: restore links when returning to summary view _summary_keyboard was called without links param in VIEW_SUMM handler, causing extracted links to disappear after viewing original text.
  earthjasonlin 2026-07-17 20:10:18 +08:00
  2a9be9896f
• fix: read Telegram caption field for media messages Telegram sends text in 'caption' field (not 'text') when message has media. Handle both cases: text or caption, with text taking priority.
  earthjasonlin 2026-07-17 20:04:27 +08:00
  2f29e03cec
• fix: send reply immediately on media-only message, no accumulation - Remove accumulation logic: media-only now sends as reply directly - All 3 cases (text-only, media-only, text+media) send immediately - Tests: 4/4 passing
  earthjasonlin 2026-07-17 19:53:38 +08:00
  b2e219ece5
• style: simplify media accumulation - silent accumulate, immediate send on text
  earthjasonlin 2026-07-17 19:52:08 +08:00
  131e440d6b
• fix: add missing account_idx to save_email_context in tg_send_and_mark
  earthjasonlin 2026-07-17 19:36:50 +08:00
  4002dec33c
• feat: support attachments in manual reply (photo/video/document/voice) - Add _extract_media: extract media info from Telegram messages - Add _download_tg_file: download files from Telegram API - Modify _handle_message: accumulate attachments in awaiting_reply, send with text - Modify _handle_update: process messages without text (media-only) - Modify smtp_client.send_reply: support MIME multipart with attachments - Add comprehensive tests (11 tests, all passing)
  earthjasonlin 2026-07-17 19:04:27 +08:00
  d76a119190
• fix: save_conversation in CALLBACK_HINT, move AI hint to thread pool
  earthjasonlin 2026-07-17 18:45:40 +08:00
  d05277581c
• fix: parse_mode always MarkdownV2, add MEMORY.md with project rules
  earthjasonlin 2026-07-17 18:36:53 +08:00
  fe24a07d15
• fix: move regenerate to AI thread pool, fix parse_mode None error
  earthjasonlin 2026-07-17 18:30:57 +08:00
  0abb7de5d3
• perf: reduce poll timeout to 1s and wait to 50ms for faster button response
  earthjasonlin 2026-07-15 19:20:52 +08:00
  5ca739456d
• fix: reduce long-poll timeout to 2s, make mark_as_seen async to unblock TG sender
  earthjasonlin 2026-07-15 19:15:27 +08:00
  c26d8aa294
• fix: clear all database tables on startup
  earthjasonlin 2026-07-15 19:09:41 +08:00
  c940a456bc
• fix: clear processed_emails on startup to avoid stale state
  earthjasonlin 2026-07-15 19:09:02 +08:00
  b226f0b597
• fix: add error logging for send_thinking failures in email poller
  earthjasonlin 2026-07-15 19:02:59 +08:00
  687e60ede4
• fix: increase Telegram long-poll timeout to 5s and HTTP timeout to 15s
  earthjasonlin 2026-07-15 18:51:04 +08:00
  da1b266350
• feat: show email subject and sender in all status messages
  earthjasonlin 2026-07-15 18:39:58 +08:00
  dcdfba11fa
• refactor: split TG worker into poller (callbacks) and sender (email summaries) threads
  earthjasonlin 2026-07-15 18:35:01 +08:00
  2822075f2f
• fix: process one queued email per poll cycle to keep callbacks responsive
  earthjasonlin 2026-07-15 18:32:42 +08:00
  2744d9dd77
• fix: import is_uid_processed instead of is_uids_processed
  earthjasonlin 2026-07-15 18:25:57 +08:00
  17514302f9
• fix: ensure data directory exists before DB connection in all threads
  earthjasonlin 2026-07-15 18:18:24 +08:00
  d42022cc2e
• refactor: replace all in-memory state with SQLite database
  earthjasonlin 2026-07-14 14:49:23 +08:00
  54c4bf00fb
• feat: AI generates plain_text field, view full text shows readable version instead of HTML
  earthjasonlin 2026-07-14 14:37:12 +08:00
  c3132f746a
• fix: remove all body truncation, show full email text everywhere
  earthjasonlin 2026-07-14 14:34:17 +08:00
  dd7fc61fd4
• prompt: detailed instructions for extracting unsubscribe links from promotional emails
  earthjasonlin 2026-07-13 08:38:05 +08:00
  5113d78662
• fix: use threading.Event for immediate shutdown instead of sleep loops
  earthjasonlin 2026-07-13 08:34:02 +08:00
  8b885f1c4c
• prompt: emphasize extracting unsubscribe links from promotional emails
  earthjasonlin 2026-07-13 08:30:44 +08:00
  8b577b4c12
• fix: use ellipsis character instead of dots in status messages for MarkdownV2 compatibility
  earthjasonlin 2026-07-13 08:28:23 +08:00
  26468aa43d
• fix: omit parse_mode from payload when None instead of sending null
  earthjasonlin 2026-07-13 08:27:16 +08:00
  98147e6a6c
• fix: add parse_mode param to edit_message, status messages use plain text
  earthjasonlin 2026-07-13 08:23:42 +08:00
  bd5b824a6a
• feat: three-stage status: 获取邮件中 -> 等待处理 -> AI思考中
  earthjasonlin 2026-07-13 08:19:36 +08:00
  01504e6295
• feat: two-stage status messages: 获取邮件中 -> AI思考中
  earthjasonlin 2026-07-13 08:15:25 +08:00
  02b0941ed0
• revert: use debug log for unselectable folders instead of warning
  earthjasonlin 2026-07-13 08:11:30 +08:00
  85b02651b9
• fix: quote folder names in IMAP SELECT for folders with spaces
  earthjasonlin 2026-07-13 08:10:39 +08:00
  e74ae8be88
• fix: mark_as_seen uses readonly=False to actually set Seen flag
  earthjasonlin 2026-07-13 08:05:40 +08:00
  f38259e4bb
• fix: skip NoSelect folders, clean up debug logging
  earthjasonlin 2026-07-13 08:04:26 +08:00
  5368812e45
• debug: add skip_uids logging to diagnose re-fetch issue
  earthjasonlin 2026-07-13 07:54:13 +08:00
  8c088ddff5
• fix: never discard from _processing_uids to prevent re-fetching
  earthjasonlin 2026-07-13 07:49:09 +08:00
  0ec2048bc5
• fix: skip already-processing UIDs at FETCH level to avoid downloading email content
  earthjasonlin 2026-07-13 07:35:28 +08:00
  155a6dfc53
• fix: restore -FLAGS Seen after FETCH, protected by _processing_uids
  earthjasonlin 2026-07-13 07:13:08 +08:00
  d31ec18ea3
• fix: add _processing_uids to prevent re-fetching emails being processed
  earthjasonlin 2026-07-13 07:12:43 +08:00
  02cf4b88b6
• chore: remove accidental file
  earthjasonlin 2026-07-13 06:57:28 +08:00
  ae140df3fb
• fix: login without selecting INBOX first so conn.list() returns all folders
  earthjasonlin 2026-07-13 06:57:06 +08:00
  e9398526e6
• feat: scan all IMAP folders for unread emails, not just INBOX
  earthjasonlin 2026-07-13 00:16:28 +08:00
  479b855390
• prompt: force simplified Chinese for all AI outputs except reply suggestions
  earthjasonlin 2026-07-13 00:12:50 +08:00
  46bc7c7057
• fix: keep pending_uids until TG send completes to prevent duplicate processing
  earthjasonlin 2026-07-12 23:51:45 +08:00
  bbc43f8972
• prompt: refine link extraction to exclude promotional links
  earthjasonlin 2026-07-12 10:15:25 +08:00
  87e4b0b01e
• feat: show thinking indicator during AI processing, accept non-numeric verification codes
  earthjasonlin 2026-07-11 22:54:06 +08:00
  fc4c5a175c
• fix: mark emails back as UNSEEN after FETCH to counter server auto-read
  earthjasonlin 2026-07-11 22:45:31 +08:00
  1c7d0c1b00
• fix: per-email error handling with connection rebuild, remove @retry on fetch
  earthjasonlin 2026-07-11 22:43:39 +08:00
  5320b10317
• fix: remove body truncation for large emails
  earthjasonlin 2026-07-11 22:38:40 +08:00
  d8807ffbb5
• fix: use BODY.PEEK for large emails to prevent server auto-marking as read on timeout
  earthjasonlin 2026-07-11 22:38:07 +08:00
  8d40ed8b19
• feat: remove body truncation for all AI requests, increase API timeout to 120s
  earthjasonlin 2026-07-11 22:32:47 +08:00
  57191ab00e
• feat: add tell me more button for promotion emails with AI-generated details
  earthjasonlin 2026-07-11 22:17:10 +08:00
  13b76c00ab
• style: restructure email formats with 收件账户 and app_name for verification
  earthjasonlin 2026-07-11 22:11:15 +08:00
  cf0f7d3956
• fix: use single backtick for tap-to-copy, remove copy_text button
  earthjasonlin 2026-07-11 22:05:02 +08:00
  e56bdef0f7
• fix: copy_text field must be an object with text key
  earthjasonlin 2026-07-11 21:57:19 +08:00
  6d1fe29df4
• fix: use copy_text field instead of duplicate text key
  earthjasonlin 2026-07-11 21:52:07 +08:00
  05b15d9ee3
• fix: copy button shows only the code number
  earthjasonlin 2026-07-11 21:49:54 +08:00
  03c18cdb76
• feat: add copy_text button for verification codes
  earthjasonlin 2026-07-11 21:47:54 +08:00
  b835812f38
• style: beautify email formats with type labels and consistent layout
  earthjasonlin 2026-07-11 21:42:35 +08:00
  070c32071a
• chore: remove test scripts
  earthjasonlin 2026-07-11 21:35:58 +08:00
  5a21aeee14
• fix: always use MarkdownV2 for all message types
  earthjasonlin 2026-07-11 21:35:22 +08:00
  8007fa1cc4
• fix: remove null parse_mode from tg payload, add error logging
  earthjasonlin 2026-07-11 21:22:20 +08:00
  43994d2b0d
• refactor: remove action_required/action_items/key_points, keep summary concise
  earthjasonlin 2026-07-11 19:46:18 +08:00
  a992af0e02
• feat: extract clickable links from email and show as URL buttons
  earthjasonlin 2026-07-11 19:38:33 +08:00
  1957eb2a73
• feat: verification emails displayed as platform + code
  earthjasonlin 2026-07-08 16:15:51 +08:00
  be4e957af9
• feat: promotional emails summarized as who promotes what
  earthjasonlin 2026-07-08 16:13:54 +08:00
  9991e4ef17
• chore: AI并行workers 5→10
  earthjasonlin 2026-07-06 20:13:15 +08:00
  ea6358019d
• feat: AI并行处理 + 修复邮件丢失

  - _ai_processor 改用 ThreadPoolExecutor(5 workers) 并行调用AI
  - _tg_worker 每轮排空所有待发TG消息(原来每轮只取1条)
  - fetch_unseen_emails 单封FETCH失败不再丢弃整个批次，跳过继续

  earthjasonlin 2026-07-06 20:12:24 +08:00
  d70b817fd4
• fix: 修复 _email_poller 线程静默死亡问题

  - IMAP 连接加 30s socket timeout，防止 _send_id_command 等操作永久阻塞
  - _email_poller 加顶层 try/except，异常后 sleep 5s 继续循环
  - @retry() 加指数退避延迟(1s,2s,4s...)，避免重试风暴

  earthjasonlin 2026-07-06 19:54:23 +08:00
  0c1ccdfc79
• feat: handle Reply-To header, add account_email field, decode address headers
  earthjasonlin 2026-07-02 22:37:15 +08:00
  Verified c684090b9c
• feat: IMAP 支持 SSL/STARTTLS 配置
  earthjasonlin 2026-07-02 22:18:51 +08:00
  Verified d7daddf491
• chore: 添加 requirements.txt
  earthjasonlin 2026-07-02 22:05:07 +08:00
  Verified 05135ee0cc
• feat: 收件人/发件人改用邮件原始头数据

  - sender 从 decode 改为使用原始 From 头
  - 新增 recipient 字段，使用原始 To 头
  - 移除 ai_process 中对 acct.username 的依赖

  earthjasonlin 2026-07-02 22:04:27 +08:00
  Verified ad950ff367
• feat: include reply content in send confirmation message
  earthjasonlin 2026-07-02 21:01:05 +08:00
  Verified 2ebcad0a70
• feat: enhance logging detail across all modules

  - email_client: log IMAP connection, login, UNSEEN count, each email
    details (subject/sender/body size), mark-as-seen progress
  - ai_client: log AI request params, timing, token usage, response size
  - smtp_client: log SMTP connect, login, send details
  - tg_bot: log all callback actions with subject context, message states
  - main: periodic queue depth report (email_queue/tg_queue/pending_uids)

  earthjasonlin 2026-07-02 21:00:40 +08:00
  Verified d334b6f3eb
• fix: thread-safe logging with QueueHandler + QueueListener

  - Replace logging.basicConfig with QueueHandler/QueueListener
    so all log output writes from a single thread
  - Add %(threadName)s to format for thread identification

  earthjasonlin 2026-07-02 20:57:33 +08:00
  Verified 934d6a7545
• fix: also delete user's message when cleaning up reply/hint flow
  earthjasonlin 2026-07-02 20:56:30 +08:00
  Verified be412168bb
• fix: use original email From header for reply address instead of AI output

  - send_summary now accepts original_sender (raw From header)
  - Context stores original_sender separately from AI-generated sender
  - _do_send_reply tries original_sender first, then AI sender fallback

  earthjasonlin 2026-07-02 20:55:40 +08:00
  Verified 08a1a32367