CyberPun-K
CyberPun-K t1_j9rhbqm wrote
N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting
The NHITS model enhances the multi-step forecasting strategy by incorporating innovative hierarchical interpolation and multi-rate data sampling techniques inspired by wavelet analysis.
It assembles its predictions sequentially and emphasizes its components with different frequencies and scales. NHITS significantly improves accuracy in long-horizon forecasting tasks while reducing computation time by orders of magnitude compared to existing neural forecasting approaches.
CyberPun-K t1_j16mqoa wrote
Convolutional Neural Networks are an excellent example of how correct inductive biases can:
- Reduce number of parameters.
- Improve performance.
CyberPun-K t1_izywnhq wrote
There is long way to go for AutoML solutions. Thanks for confirming I was not the only one.
CyberPun-K t1_iyj7gb9 wrote
Reply to comment by HateRedditCantQuitit in [R] Statistical vs Deep Learning forecasting methods by fedegarzar
All the models are global models, trained using cross learning. Not single models per series. Unless the experiments were done like that.
CyberPun-K t1_iyj6q2r wrote
Reply to comment by BrisklyBrusque in [R] Statistical vs Deep Learning forecasting methods by fedegarzar
NBEATs hyper-parameters are minimally explored in the original paper the ensemble was not tuned. There is something broken with the reported times.
CyberPun-K t1_iyj4snj wrote
The M3 dataset consists only of 3,003 series, a minimal improvement of DL is not a surprise. Everybody knows that neural networks require large datasets to show substantial improvements over statistical baselines.
What is truly surprising is the time it takes to train the networks, 13 days for thousand series
=> there must be something broken with the experiments
CyberPun-K t1_jae0m46 wrote
Reply to [Discussion] Open Source beats Google's AutoML for Time series by fedegarzar
While AutoML is a powerful tool for automated machine learning, it's not widely used by most people. Personally, I wouldn't pay thousands of dollars for fancy hyperparameter optimization. In most cases improvements are marginal.
One of the cool features of Big Query is its seamless integration with SQL queries, which makes data analysis much easier.