This repository contains an implementation for the Dynamic Weighted Ensemble (DWE) - Local Fusion method. Find the paper in this ref on IEEE.
Local Fusion is an ensemble techinque that could be used to improve predictions by weighing appropriately the single models contribution.
pip install ensemblem
Docs - ReadTheDocs (UnderReview)
First of all, you need to define the KWEnsembler class. Next, it's required to provide the search-space (it could be the validation set / neighbours-set) in which the ensembler will find the nearest elements to the generic test sample.
from ensemblem.model import KWEnsembler
ensemble = KWEnsembler(5)
ensemble.fit(X_validation, y_validation)
Finally, calling the prediction method the class will produce the forecasts.
ensemble.predict(X_test,
features_space,
other_model_prediction_columns)
The class returns predictions in the same order in which they are provided. It supports one or multiple samples to forecasts. In this library, we refers to the neighbours-set as the space in which the ensembler will find the nearest elements to the generic test sample.
You can find a detailed tutorial in the readthedocs webpage.
- Load data
- Split data into train, neighbours-set and test sets
- Train multiple expert models on the train data
- Generate predictions for the test data
- Train the ensembler on neighbours-set
- Generate predictions for the test dataset using ensembler
- Compare the predictions from the ensembler with the predictions from the expert models
Model | MAPE | MAE | RMSE | RMSLE | |
---|---|---|---|---|---|
0 | Ensemble | 0.304129 | 0.499381 | 0.0016118 | 0.211999 |
1 | Tree 1 | 0.370919 | 0.593606 | 0.00755926 | 0.249373 |
2 | Tree 2 | 0.319638 | 0.511249 | 0.00224047 | 0.225012 |
3 | RidgeCV | 0.31537 | 0.531177 | 0.0131216 | 0.238018 |
15-05-2023 [Fix] Renamed wrong paths
Algorithm Applications
-
A dynamic weighting ensemble approach for wind energy production prediction IEEE
-
An ensemble approach to sensor fault detection and signal reconstruction for nuclear system control Elsevier
-
[Code] Clean-code
-
[Engineering] When dealing with features coming with magnitude and different meaning, it's relevant to normalize values appropriately.
-
[Engineering] Additional measures to the simple euclidean-space
The code is provided with a MIT licence.