#### USE CASE

# ENERGY PRICES FORECAST

**WITH SHAPELETS**

###### CATEGORY

#### Shapelets

###### CATEGORY

#### Shapelets

###### CATEGORY

#### Shapelets

###### Â CATEGORY

#### Â Use Case

###### Â DATE

#### Â 07 June

###### Â TIME

#### Â Â 05 Minutes

**The Case: How to forecast energy pricing using energy generation dataÂ **

The accurate forecasting of energy prices is crucial for the orientation of the energy market and can guide policymakers and market participants, such as businesses and individuals.Â Â Â

In this use case, we will explore how Shapelets accelerated platform can be used to **improve price prediction**. We will use historical energy price data together with energy generation data to find out how energy consumption and production are related.Â Â

##### BEHIND THE DATA SCIENTIST

**Use Case by Carlos Sevilla**

In this use case, we will explore how Shapelets accelerated platform can be used to improve price prediction. We will use historical energy price data together with energy generation data to find out how energy consumption and production are related.

**Note**Â

While this case study focuses on the Spanish energy market, the following approach is applicable to any other international market, as long as large customer databases are available. Furthermore, while the energy pricing market needs to follow each jurisdiction’s rules, the primary objective of this use case is to obtain an understanding of the relationship between energy price data and energy generation data to improve its prediction.Â Â Â

**Intro**

The electricity market in Spain is regulated by the REE (Red ElÃ©ctrica EspaÃ±ola) and acts as an intermediary between companies that generate energy and companies that buy this energy to distribute it to the customers.

The price of electricity is calculated using a matching offer. Every day at 16:00 the next day’s energy prices are calculated, and it is calculated by ordering from the lowest to highest the prices at which energy sellers want to sell the energy produced, and by ordering from the highest to lowest the prices at which buyers want to buy the energy.Â Â

This process is repeated for each hourly segment of the following day and is managed by Operador del Mercado IbÃ©rcio-Polo espaÃ±ol (OMIE).Â

**The objective of this DataApp is to try to predict the energy matching price for each of the hours a day.Â **Â

**The Challenge**

The main challenge solved with this DataApp is to find some relationship between energy generation and energy price and discover that relationship using Machine Learning algorithms. Using different python libraries we implemented the best models to solve this problem.Â

To get this challenge it is necessary to take into account some problems such as working with datasets that have different frequencies and also present anomalies within the data which make difficult the discovery of patterns in the data.

**Data**

The data used in this project is a dataset extracted from the OMIE API. This API has 1400 indicators available for analysis, among them information on scheduled power generation, real-time generation, and energy price including intraday market session prices.

**Methodology**

To solve this use case, we have applied the following methodology.Â

Step 1Â Data loading and anexploratory data analysis (EDA).

Step 2Data processingbycreatingthe target variable.

Step 3Data modelling and performance analysis.

We have some initial business knowledge about this data, and we know that price evolution throughout the day has a very similar shape over the different days of the month.Â Â

Knowing this, you can use a dimensionality reduction algorithm such as PCS to reduce the dimensionality of the target variable.Â Â

**TODO:** You can try adding information about the season of the year or month information, to see if the results improve!

Â

**Metrics**

For this project, we have used traditional regression error metrics such as MSE, RMSE, MAE and MAPE. The target feature in this use case is a value that will be used by a PCA algorithm to obtain the real price data so that a small error can mean a very high deviation in the real price data. From the Shapelets team, we have chosen MAE as a reference metric, to focus our efforts on reducing the MAE value to the minimum possible.

Â Â

**AlgorithmsÂ **

This problem can be approached from different points of view.Â Â

As an autoregressive time series, predicting the value of the principal component of the daily data.Â Â

As a multivariate time series problem, with the different KPIs, we have.Â

As a regression problem.ÂÂ

**We have used 3 algorithms:Â Â **

The RandomForestRegressor algorithm from the package, and is implemented like this

The LightGBM algorithm, from Microsoft.Â Â

The XGBoost algorithm.Â Â

This Data App implements a system to compare the predictions between them so that the user can choose which model best fits his business vision.Â Â

With Shapelets you have all the power of Python and its different packages, so it is as easy as importing and running them!Â Â

**Synthesized ResolutionÂ Â **

Predicting the price allow companies that purchase energy to adjust their budget more accurately.Â

Once the data is processed, three algorithms are proposed to predict the energy price which is evaluated using regression error metrics. These models have similar performance, giving some tighter predictions for each day.Â Â

This data app implements a system to compare the predictions between them so that the user can choose which model best fits his business vision.

Â

**Results**

**Several interesting results arise from this study:Â **

The first insight that is obtained is based on this study’s results: it is indeed possible to predict the price of energy with a very small error.

We have obtained an accurate energy price prediction with a 1.12 average score in MAE on the target variable.Â

Additionally, if we look it from a business perspective, there is only a 35.77 â‚¬ average difference in the pricing prediction.Â Â

With only 10 KPIs you get a very accurate prediction of the price of energy, so you can improve this approach to get better results. It can serve as inspiration to incorporate it into your project or to compare it with other approaches or ways to solve this project.Â

With Shapelets you have all the power of Python and its different packages, so it is as easy as importing and running them!Â Â

**How does Shapelets help solve this challenge?Â **

Data App development in less than 30 min.Â Â

Results are ready to be shared with the business stakeholders in a secure way.Â Â Â

Data App ready to go into test for multiple approaches.Â Â Â

Now, what are you waiting for?Â

* If you have any questions or would like some business guidance, you may contact us here.*Â