feat(harvester,jobs): fast gateway harvesting, parallel thread polling, dynamic sidechat spawning

super/box

- Implement muse_hybrid fast gateway in response-harvester.py with ThreadPoolExecutor
- Reduce harvest cycle time from ~1m50s to ~18s; eliminate browser tab-hopping and CDP lock contention
- Add smart active thread filtering in get_monitored_threads to prune dead historical test pipes
- Fix initial watermark ingestion logic so fresh sidechats process first-arrival job responses
- Configure gw_wait window in dm.py (20s on reply:expected) so backend generation is not prematurely severed
- Update box-http-health, box-service-health, box-deep-health to dynamic timestamped sidechats without reuse_key
- Fix heartbeat job to route to dedicated heartbeat channel

This commit is contained in:

operator

2026-10-05 03:21:20 +00:00

parent 03ea7ed6d9

commit da59ad6edd

7 changed files with 214 additions and 172 deletions

									
										jobs/heartbeat.json
									
		+1
		-1
	
												View File
												
				@@ -9,7 +9,7 @@

				  "sidechat": {

				    "create": true,

				    "name_template": "heartbeat",

				    "reuse_key": "heartbeat-opm"

				    "reuse_key": "heartbeat"

				  },

				  "timeout": 300

				}