openclaw/extensions
buyitsydney 4b69c6d3f1 fix(memory): add CJK/Kana/Hangul support to MMR tokenize() for diversity detection
The tokenize() function only matched [a-z0-9_]+ patterns, returning an
empty set for CJK-only text. This made Jaccard similarity always 0 (or
always 1 for two empty sets) for CJK content, effectively disabling MMR
diversity detection.

Add support for:
- CJK Unified Ideographs (U+4E00–U+9FFF, U+3400–U+4DBF)
- Hiragana (U+3040–U+309F) and Katakana (U+30A0–U+30FF)
- Hangul Syllables (U+AC00–U+D7AF) and Jamo (U+1100–U+11FF)

Characters are extracted as unigrams, and bigrams are generated only
from characters that are adjacent in the original text (no spurious
bigrams across ASCII boundaries).

Fixes #28000
2026-03-28 09:19:52 +05:30
..
acpx chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
amazon-bedrock chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
anthropic chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
anthropic-vertex fix: break plugin-sdk provider barrel recursion 2026-03-27 23:47:04 +00:00
bluebubbles test: harden extension integration fixtures 2026-03-28 03:31:42 +00:00
brave fix: normalize unsupported Brave country filters (#55695) (thanks @chen-zhang-cs-code) 2026-03-28 09:19:27 +05:30
browser chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
byteplus chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
chutes chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
cloudflare-ai-gateway chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
copilot-proxy chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
deepgram chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
deepseek chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
device-pair fix(regression): allow external device pair approvals 2026-03-27 16:07:54 -05:00
diagnostics-otel chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
diffs chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
discord refactor: move discord system events onto channel runtime 2026-03-28 03:27:12 +00:00
duckduckgo chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
elevenlabs chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
exa chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
fal refactor: narrow provider runtime auth seams 2026-03-28 02:04:31 +00:00
feishu test: harden extension integration fixtures 2026-03-28 03:31:42 +00:00
firecrawl chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
github-copilot refactor: narrow provider runtime auth seams 2026-03-28 02:04:31 +00:00
google refactor: trim provider oauth runtime seams 2026-03-28 02:08:29 +00:00
googlechat fix(regression): restore googlechat cold-runtime chunking 2026-03-27 21:25:21 -05:00
groq chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
huggingface chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
image-generation-core chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
imessage refactor: remove plugin sdk extension facade smells 2026-03-28 03:12:07 +00:00
irc fix(regression): restore irc cold-runtime chunking 2026-03-27 22:24:27 -05:00
kilocode chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
kimi-coding refactor: narrow provider runtime auth seams 2026-03-28 02:04:31 +00:00
line refactor: route channel activity through channel runtime 2026-03-28 02:53:03 +00:00
litellm chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
llm-task chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
lobster chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
matrix refactor(acp): generalize message-channel binds 2026-03-28 02:53:54 +00:00
mattermost fix(regression): align mattermost send helper runtime usage 2026-03-27 21:45:10 -05:00
media-understanding-core chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
memory-core fix(memory): add CJK/Kana/Hangul support to MMR tokenize() for diversity detection 2026-03-28 09:19:52 +05:30
memory-lancedb refactor: trim extension helper runtime seams 2026-03-28 02:12:05 +00:00
microsoft chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
microsoft-foundry chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
minimax refactor: trim provider oauth runtime seams 2026-03-28 02:08:29 +00:00
mistral chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
modelstudio chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
moonshot chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
msteams fix(regression): align msteams send helper runtime usage 2026-03-27 21:46:42 -05:00
nextcloud-talk fix(regression): align nextcloud-talk send helper runtime usage 2026-03-27 21:37:50 -05:00
nostr chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
nvidia chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
ollama refactor: narrow provider runtime auth seams 2026-03-28 02:04:31 +00:00
open-prose chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
openai refactor: trim provider oauth runtime seams 2026-03-28 02:08:29 +00:00
opencode chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
opencode-go chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
openrouter chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
openshell chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
perplexity chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
phone-control fix(regression): restore external phone control commands 2026-03-27 16:57:16 -05:00
qianfan chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
sglang chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
shared refactor: route plugin runtime through bundled seams 2026-03-27 16:40:27 +00:00
signal refactor: move secure random helpers onto core sdk 2026-03-28 03:06:06 +00:00
slack refactor: move slack system events onto channel runtime 2026-03-28 03:38:11 +00:00
speech-core chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
synology-chat test: harden extension integration fixtures 2026-03-28 03:31:42 +00:00
synthetic chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
talk-voice fix(regression): restore external talk voice updates 2026-03-27 16:05:22 -05:00
tavily chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
telegram refactor: route telegram bot deps through channel runtime 2026-03-28 03:42:37 +00:00
thread-ownership fix(extensions): route fetch calls through fetchWithSsrFGuard (#53929) 2026-03-26 02:04:54 -07:00
tlon refactor: trim secret and ssrf helper runtime seams 2026-03-28 02:25:28 +00:00
together chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
twitch chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
venice refactor: narrow provider runtime auth seams 2026-03-28 02:04:31 +00:00
vercel-ai-gateway chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
vllm chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
voice-call fix(regression): preserve voice call timeout markers before hangup 2026-03-27 22:25:32 -05:00
volcengine chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
whatsapp refactor: route whatsapp monitor through channel runtime 2026-03-28 03:48:57 +00:00
xai chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
xiaomi chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
zai chore: bump version metadata to 2026.3.27 2026-03-28 02:00:22 +00:00
zalo refactor: trim extension helper runtime seams 2026-03-28 02:12:05 +00:00
zalouser fix(regression): restore zalouser cold-runtime chunking 2026-03-27 21:33:14 -05:00
.npmignore