Desktop: remove GEMINI_API_KEY, route proactive AI through /v4/listen (#5396)#5413

Open

beastoin wants to merge 33 commits intomainfrom

collab/5396-integration

Commits on Mar 10, 2026

Add focus analysis handler for desktop screen_frame messages (#5396)

beastoin
and
claude
committed
Add FocusResultEvent message type for desktop proactive AI (#5396)

beastoin
and
claude
committed
Add screen_frame dispatcher to /v4/listen for desktop focus analysis (#5396)

beastoin
and
claude
committed
Add 26 unit tests for desktop focus analysis (#5396)

beastoin
and
claude
committed
Add task extraction handler for desktop screen analysis
beastoin
committed
Add memory extraction handler for desktop screen analysis
beastoin
committed
Add contextual advice handler for desktop screen analysis
beastoin
committed
Add live notes handler for desktop transcript processing
beastoin
committed
Add user profile generation handler for desktop
beastoin
committed
Add task reranking and deduplication handlers for desktop
beastoin
committed
Add message event classes for all desktop handler types
beastoin
committed
Add full desktop dispatcher for screen_frame and text message types
beastoin
committed
Add unit tests for task extraction handler (18 tests)
beastoin
committed
Add unit tests for memory extraction handler (14 tests)
beastoin
committed
Add unit tests for advice handler (14 tests)
beastoin
committed
Add unit tests for live notes handler (10 tests)
beastoin
committed
Add unit tests for profile handler (9 tests)
beastoin
committed
Add unit tests for task rerank and dedup handlers (16 tests)
beastoin
committed
Add all desktop handler tests to test.sh
beastoin
committed
Add BackendProactiveService for server-side proactive AI (#5396)

beastoin
and
claude
committed
Wire FocusAssistant to BackendProactiveService instead of GeminiClient (#5396)

beastoin
and
claude
committed
Create BackendProactiveService in ProactiveAssistantsPlugin lifecycle (#5396)

beastoin
and
claude
committed
Update FocusTestRunnerWindow for new FocusAssistant init signature (#5396)

beastoin
and
claude
committed
Add all 8 message types to BackendProactiveService (#5396)

beastoin
and
claude
committed
Wire TaskAssistant thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire MemoryAssistant thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire AdviceAssistant thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire TaskDeduplicationService thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire TaskPrioritizationService thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire AIUserProfileService thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire ProactiveAssistantsPlugin to pass backendService to all assistants (#5396)

beastoin
and
claude
committed
Wire LiveNotesMonitor thin client for Phase 2 (#5396)

beastoin
and
claude
committed
Wire LiveNotesMonitor in ProactiveAssistantsPlugin (#5396)

beastoin
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Desktop: remove GEMINI_API_KEY, route proactive AI through /v4/listen (#5396)#5413

Desktop: remove GEMINI_API_KEY, route proactive AI through /v4/listen (#5396)#5413
beastoin wants to merge 33 commits intomainfrom
collab/5396-integration

Commits on Mar 10, 2026

Add focus analysis handler for desktop screen_frame messages (#5396)

Add FocusResultEvent message type for desktop proactive AI (#5396)

Add screen_frame dispatcher to /v4/listen for desktop focus analysis (#5396)

Add 26 unit tests for desktop focus analysis (#5396)

Add task extraction handler for desktop screen analysis

Add memory extraction handler for desktop screen analysis

Add contextual advice handler for desktop screen analysis

Add live notes handler for desktop transcript processing

Add user profile generation handler for desktop

Add task reranking and deduplication handlers for desktop

Add message event classes for all desktop handler types

Add full desktop dispatcher for screen_frame and text message types

Add unit tests for task extraction handler (18 tests)

Add unit tests for memory extraction handler (14 tests)

Add unit tests for advice handler (14 tests)

Add unit tests for live notes handler (10 tests)

Add unit tests for profile handler (9 tests)

Add unit tests for task rerank and dedup handlers (16 tests)

Add all desktop handler tests to test.sh

Add BackendProactiveService for server-side proactive AI (#5396)

Wire FocusAssistant to BackendProactiveService instead of GeminiClient (#5396)

Create BackendProactiveService in ProactiveAssistantsPlugin lifecycle (#5396)

Update FocusTestRunnerWindow for new FocusAssistant init signature (#5396)

Add all 8 message types to BackendProactiveService (#5396)

Wire TaskAssistant thin client for Phase 2 (#5396)

Wire MemoryAssistant thin client for Phase 2 (#5396)

Wire AdviceAssistant thin client for Phase 2 (#5396)

Wire TaskDeduplicationService thin client for Phase 2 (#5396)

Wire TaskPrioritizationService thin client for Phase 2 (#5396)

Wire AIUserProfileService thin client for Phase 2 (#5396)

Wire ProactiveAssistantsPlugin to pass backendService to all assistants (#5396)

Wire LiveNotesMonitor thin client for Phase 2 (#5396)

Wire LiveNotesMonitor in ProactiveAssistantsPlugin (#5396)