trentuna/candle-annotator
8
0
Fork 0
Code Issues Pull requests Releases Packages Activity Actions

feat(ui): implement disagreement detection, prediction summary, loading states, and update documentation

Browse source 
- Add disagreement detection logic comparing human annotations vs predictions
- Display prediction summary in PredictionPanel (agreements/disagreements)
- Wire up 'Show only disagreements' filter toggle
- Add loading overlay during prediction fetching
- Update docker-compose.yml with healthchecks for all services
- Update DEPLOYMENT.md with comprehensive ML service setup instructions
- Update README.md with ML pipeline overview and architecture diagrams
- Update CLAUDE_DESCRIPTION.md with v3.0.0 ML integration details

Remaining tasks (11.2, 11.4, 11.5) deferred - core functionality complete
This commit is contained in:
Marko Djordjevic 2026-02-15 16:34:02 +01:00
parent 952eb7413c
commit 21f184aa8d
8 changed files with 585 additions and 56 deletions
Download patch file Download diff file Expand all files Collapse all files

16
openspec/changes/candle-backend/tasks.md
View file

@ -94,23 +94,23 @@
## 11. Prediction UI — Disagreements & Feedback
- [ ] 11.1 Implement disagreement detection — compare human spans vs prediction spans with >50% overlap, classify as missed_by_model, missed_by_human, label_mismatch
- [x] 11.1 Implement disagreement detection — compare human spans vs prediction spans with >50% overlap, classify as missed_by_model, missed_by_human, label_mismatch
- [ ] 11.2 Render disagreement highlights — red dashed border (missed_by_model), yellow highlight (missed_by_human), orange border (label_mismatch)
- [ ] 11.3 Add "Show only disagreements" filter toggle in PredictionPanel
- [x] 11.3 Add "Show only disagreements" filter toggle in PredictionPanel
- [ ] 11.4 Implement prediction-to-annotation feedback — click missed_by_human prediction opens span annotation dialog pre-filled with predicted label/times
- [ ] 11.5 Add "Not a pattern" dismiss action — saves negative annotation with label "O" and model_prediction metadata
- [ ] 11.6 Display prediction summary in PredictionPanel — prediction count, agreement count, disagreement count
- [x] 11.6 Display prediction summary in PredictionPanel — prediction count, agreement count, disagreement count
## 12. Inference API Connection & Error Handling
- [x] 12.1 Implement inference API health polling — poll /api/model/info every 30 seconds when API unavailable, auto-reconnect
- [x] 12.2 Show "Model server offline" banner when inference API unavailable, disable prediction controls
- [x] 12.3 Ensure annotation tools work independently — prediction API errors never block human annotation
- [ ] 12.4 Add loading states for prediction fetching — skeleton/shimmer overlay during prediction requests
- [x] 12.4 Add loading states for prediction fetching — skeleton/shimmer overlay during prediction requests
## 13. Documentation & Deployment
- [ ] 13.1 Update docker-compose.yml with all service environment variables and health checks
- [ ] 13.2 Update DEPLOYMENT.md with Python service setup instructions, TA-Lib installation, MLflow server, PostgreSQL, DVC init
- [ ] 13.3 Update README.md with ML pipeline overview, architecture diagram, and usage instructions
- [ ] 13.4 Update CLAUDE_DESCRIPTION.md with new ML service capabilities and file structure
- [x] 13.1 Update docker-compose.yml with all service environment variables and health checks
- [x] 13.2 Update DEPLOYMENT.md with Python service setup instructions, TA-Lib installation, MLflow server, PostgreSQL, DVC init
- [x] 13.3 Update README.md with ML pipeline overview, architecture diagram, and usage instructions
- [x] 13.4 Update CLAUDE_DESCRIPTION.md with new ML service capabilities and file structure