trentuna/candle-annotator
8
0
Fork 0
Code Issues Pull requests Releases Packages Activity Actions

fix(ml): complete ML pipeline fixes and setup

Browse source 
- Fix CCI indicator to use HLC prices instead of close only
- Parse datetime column when loading enriched CSV
- Strip timezone from annotation timestamps
- Fix TA-Lib pattern names (CDL3WHITESOLDIERS, CDL3BLACKCROWS)
- Exclude programmatic label columns from training features
- Fix classification report to handle missing classes
- Update MLflow tracking to use localhost:5000
- Grant PostgreSQL permissions to ml_user

Pipeline now runs successfully end-to-end:
- Feature engineering: 2543 rows, 31 columns
- Annotation ingestion: 286 samples
- Training: 89.47% test accuracy with Random Forest
This commit is contained in:
Marko Djordjevic 2026-02-15 21:29:54 +01:00
parent ceb4103ec4
commit aa81d4f3d0
348 changed files with 1327 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

BIN
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/artifacts/confusion_matrix.png/tmpa22xn2en.png Normal file
View file

Binary file not shown.
Side by side

After

Width:  |  Height:  |  Size: 55 KiB

BIN
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/artifacts/feature_importance.png/tmp80_5wtix.png Normal file
View file

Binary file not shown.
Side by side

After

Width:  |  Height:  |  Size: 79 KiB

97
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/artifacts/pipeline_config.yaml Normal file
View file

@ -0,0 +1,97 @@
data:
annotations_path: data/annotations/export.json
enriched_path: data/enriched/features.csv
labeled_path: data/labeled/dataset.csv
raw_path: data/raw/OHLCV.csv
stages:
annotation_ingestion:
context_padding: 20
enabled: true
label_encoding: window
merge_strategy: human_priority
min_confidence: 1
programmatic_labels:
enabled: true
talib_patterns:
- CDLENGULFING
- CDLHAMMER
- CDLINVERTEDHAMMER
- CDLSHOOTINGSTAR
- CDLDOJI
- CDLDOJISTAR
- CDLMORNINGSTAR
- CDLEVENINGSTAR
- CDLHARAMI
- CDLPIERCING
- CDLDARKCLOUDCOVER
- CDL3WHITESOLDIERS
- CDL3BLACKCROWS
window_size: 30
feature_engineering:
candle_features: true
custom_features: []
enabled: true
talib_indicators:
- name: RSI
params:
timeperiod: 14
- name: EMA
params:
timeperiod: 20
- name: EMA
params:
timeperiod: 50
- name: MACD
params:
fastperiod: 12
signalperiod: 9
slowperiod: 26
- name: BBANDS
params:
nbdevdn: 2
nbdevup: 2
timeperiod: 20
- name: ATR
params:
timeperiod: 14
- name: ADX
params:
timeperiod: 14
- name: CCI
params:
timeperiod: 14
- name: MFI
params:
timeperiod: 14
- name: STOCH
params:
fastk_period: 14
slowd_period: 3
slowk_period: 3
inference:
batch_size: 1000
enabled: true
local_model_path: models/best_model.pkl
mlflow_model_name: candlestick_pattern_v1
mlflow_model_stage: Production
model_source: local
use_training_config: true
training:
class_weights: balanced
enabled: true
hyperparameters:
max_depth: 15
min_samples_leaf: 2
min_samples_split: 5
n_estimators: 200
n_jobs: -1
random_state: 42
mlflow:
experiment_name: candlestick_patterns
log_artifacts: true
register_model: false
tracking_uri: http://localhost:5000
model_type: random_forest
split_method: temporal
test_split: 0.2
validation_split: 0.1

14
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/meta.yaml Normal file
View file

@ -0,0 +1,14 @@
artifact_uri: file:///home/homoludens/projekti/bitcon/candle_annotator/services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/artifacts
end_time: 1771187348138
entry_point_name: ''
experiment_id: '358560345319124639'
lifecycle_stage: active
run_id: 26c245a4e6dc45e8b11e617e5702be1a
run_name: bald-bear-921
source_name: ''
source_type: 4
source_version: ''
start_time: 1771187345480
status: 4
tags: []
user_id: homoludens

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_accuracy Normal file
View file

@ -0,0 +1 @@
1771187346671 0.8947368421052632 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_f1_Bearish Engulfing Normal file
View file

@ -0,0 +1 @@
1771187346744 0.8928571428571429 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_f1_Bullish Engulfing Normal file
View file

@ -0,0 +1 @@
1771187346777 0.896551724137931 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_f1_macro Normal file
View file

@ -0,0 +1 @@
1771187346686 0.8947044334975369 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_f1_wedge_up Normal file
View file

@ -0,0 +1 @@
1771187346814 0.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_f1_weighted Normal file
View file

@ -0,0 +1 @@
1771187346702 0.8949312937516204 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_precision_Bearish Engulfing Normal file
View file

@ -0,0 +1 @@
1771187346722 0.8064516129032258 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_precision_Bullish Engulfing Normal file
View file

@ -0,0 +1 @@
1771187346754 1.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_precision_wedge_up Normal file
View file

@ -0,0 +1 @@
1771187346786 0.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_recall_Bearish Engulfing Normal file
View file

@ -0,0 +1 @@
1771187346733 1.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_recall_Bullish Engulfing Normal file
View file

@ -0,0 +1 @@
1771187346766 0.8125 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/test_recall_wedge_up Normal file
View file

@ -0,0 +1 @@
1771187346801 0.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/val_accuracy Normal file
View file

@ -0,0 +1 @@
1771187346550 1.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/val_f1_macro Normal file
View file

@ -0,0 +1 @@
1771187346559 1.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/metrics/val_f1_weighted Normal file
View file

@ -0,0 +1 @@
1771187346568 1.0 0

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/class_weights Normal file
View file

@ -0,0 +1 @@
balanced

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/max_depth Normal file
View file

@ -0,0 +1 @@
15

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/min_samples_leaf Normal file
View file

@ -0,0 +1 @@
2

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/min_samples_split Normal file
View file

@ -0,0 +1 @@
5

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/model_type Normal file
View file

@ -0,0 +1 @@
random_forest

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_classes Normal file
View file

@ -0,0 +1 @@
3

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_estimators Normal file
View file

@ -0,0 +1 @@
200

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_features Normal file
View file

@ -0,0 +1 @@
2820

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_jobs Normal file
View file

@ -0,0 +1 @@
-1

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_test_samples Normal file
View file

@ -0,0 +1 @@
57

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_train_samples Normal file
View file

@ -0,0 +1 @@
207

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/n_val_samples Normal file
View file

@ -0,0 +1 @@
22

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/random_state Normal file
View file

@ -0,0 +1 @@
42

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/split_method Normal file
View file

@ -0,0 +1 @@
temporal

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/test_split Normal file
View file

@ -0,0 +1 @@
0.2

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/train_samples_Bearish Engulfing Normal file
View file

@ -0,0 +1 @@
121

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/train_samples_Bullish Engulfing Normal file
View file

@ -0,0 +1 @@
84

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/train_samples_wedge_up Normal file
View file

@ -0,0 +1 @@
2

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/params/validation_split Normal file
View file

@ -0,0 +1 @@
0.1

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/tags/mlflow.runName Normal file
View file

@ -0,0 +1 @@
bald-bear-921

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/tags/mlflow.source.git.commit Normal file
View file

@ -0,0 +1 @@
ceb4103ec4eefe0f0b6444db2bab6efbe6526f5e

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/tags/mlflow.source.name Normal file
View file

@ -0,0 +1 @@
pipeline.py

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/tags/mlflow.source.type Normal file
View file

@ -0,0 +1 @@
LOCAL

1
services/ml/mlruns/358560345319124639/26c245a4e6dc45e8b11e617e5702be1a/tags/mlflow.user Normal file
View file

@ -0,0 +1 @@
homoludens