R error 22.214.171.124: Error: water.exceptions.H2OModelBuilderIllegalArgumentException:
When running this code (included in Kaggle Competition):
It generates the error:
Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for GBM model: gbm1. Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (1,0 MB per tree x 500 > 503,2 MB) - try decreasing ntrees and/or max_depth or increasing min_rows!
In version 126.96.36.199
While the same code run in version 188.8.131.52 runs without any error, limitation.
I run the same code (ntrees: 2000) in the same machine with the same dataset and h2o script.
In both cases, I run it with the same initial configuration parameters:
h2o.init(nthreads = -1, min_mem_size = "6G")
I am still seeing this issue in the latest version of h2o, 184.108.40.206.
On h2o version 220.127.116.11 The following script :
with the following dataset:
is able to build all of the models however on the latest version of h2o i get the OOM error:
Illegal argument(s) for DRF model: Grid_DRF_main_model_R_1495513529770_1_model_11_cv_1. Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory
I am reopening this issue because this is not a JVM memory setting issue. I was able to perform the grid search without error in 18.104.22.168 using the same exact Rscript and dataset.
Memory would have to be increased from the looks of the exception