Memory Utilization R h2o
0
I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.
Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1. Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero ) - try decreasing ntrees and/or max_depth or increasing min_rows!
Here is my code sample:
y<-"Survived"
x<-setdiff(names(newtrain_imp),y)
rf_mod<-h2o.randomForest(x,y,train_set,
nfolds = 10,
keep_cross_validation_predictions = T,
seed=233,
mtries = 8,#sampling default-1 set to al
ntrees = 500,
max_depth = 12,
validation_frame = validate_set,
binomial_double_trees = T)
r h2o
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
add a comment |
0
I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.
Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1. Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero ) - try decreasing ntrees and/or max_depth or increasing min_rows!
Here is my code sample:
y<-"Survived"
x<-setdiff(names(newtrain_imp),y)
rf_mod<-h2o.randomForest(x,y,train_set,
nfolds = 10,
keep_cross_validation_predictions = T,
seed=233,
mtries = 8,#sampling default-1 set to al
ntrees = 500,
max_depth = 12,
validation_frame = validate_set,
binomial_double_trees = T)
r h2o
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 '18 at 6:11
Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 '18 at 6:15
Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 '18 at 6:19
you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 '18 at 6:20
There's no answer though.
– NelsonGon
Nov 14 '18 at 6:22
add a comment |
0
0
0
I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.
Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1. Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero ) - try decreasing ntrees and/or max_depth or increasing min_rows!
Here is my code sample:
y<-"Survived"
x<-setdiff(names(newtrain_imp),y)
rf_mod<-h2o.randomForest(x,y,train_set,
nfolds = 10,
keep_cross_validation_predictions = T,
seed=233,
mtries = 8,#sampling default-1 set to al
ntrees = 500,
max_depth = 12,
validation_frame = validate_set,
binomial_double_trees = T)
r h2o
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.
Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1. Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero ) - try decreasing ntrees and/or max_depth or increasing min_rows!
Here is my code sample:
y<-"Survived"
x<-setdiff(names(newtrain_imp),y)
rf_mod<-h2o.randomForest(x,y,train_set,
nfolds = 10,
keep_cross_validation_predictions = T,
seed=233,
mtries = 8,#sampling default-1 set to al
ntrees = 500,
max_depth = 12,
validation_frame = validate_set,
binomial_double_trees = T)
r h2o
r h2o
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
asked Nov 14 '18 at 6:03
NelsonGonNelsonGon
2,3792628
2,3792628
During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 '18 at 6:11
Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 '18 at 6:15
Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 '18 at 6:19
you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 '18 at 6:20
There's no answer though.
– NelsonGon
Nov 14 '18 at 6:22
add a comment |
During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 '18 at 6:11
Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 '18 at 6:15
Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 '18 at 6:19
you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 '18 at 6:20
There's no answer though.
– NelsonGon
Nov 14 '18 at 6:22
During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 '18 at 6:11
During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 '18 at 6:11
Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 '18 at 6:15
Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 '18 at 6:15
Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 '18 at 6:19
Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 '18 at 6:19
you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 '18 at 6:20
you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 '18 at 6:20
There's no answer though.
– NelsonGon
Nov 14 '18 at 6:22
There's no answer though.
– NelsonGon
Nov 14 '18 at 6:22
add a comment |
1 Answer
1
active
oldest
votes
2
During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53294034%2fmemory-utilization-r-h2o%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
2
During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
add a comment |
2
During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
add a comment |
2
2
2
During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
answered Nov 14 '18 at 6:25
HunaidkhanHunaidkhan
834114
834114
add a comment |
add a comment |
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53294034%2fmemory-utilization-r-h2o%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 '18 at 6:11
Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 '18 at 6:15
Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 '18 at 6:19
you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 '18 at 6:20
There's no answer though.
– NelsonGon
Nov 14 '18 at 6:22