Recommended way to monitor Kubernetes cluster network output throughput
I have a Kubernetes cluster doing distributed (parallel) data processing, which writes results to a DB.
I am facing what seems to be a limit to my parallelism due to network throughput performance limit on the DB.
However I was told to investigate the cluster as well, i.e. ensure that my 1000+ Pods in my cluster are really churning out a high level of throughput and is limited by the DB's ability to receive this data.
What are some recommended ways to monitor Kubernetes cluster network throughput (or network performance)?
For monitoring CPU and Memory consumption I am using Heapster in Kubernetes Dashboard, and that is fine.
For my workload that is highly parallel, I am actually finding network issues most prevalent (i.e. my nodes have more than enough CPU and memory resources, but I suspect not enough network bandwidth to write all this data successfully to the DB).
I have checked out several articles like this but it seems to cover connectivity issues (reachability), but not for monitoring volume of traffic of the cluster in its entirety.
I am really looking for something that shows me "all your Pods are generating X volume of network traffic", if possible.
kubernetes cadvisor heapster
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
add a comment |
I have a Kubernetes cluster doing distributed (parallel) data processing, which writes results to a DB.
I am facing what seems to be a limit to my parallelism due to network throughput performance limit on the DB.
However I was told to investigate the cluster as well, i.e. ensure that my 1000+ Pods in my cluster are really churning out a high level of throughput and is limited by the DB's ability to receive this data.
What are some recommended ways to monitor Kubernetes cluster network throughput (or network performance)?
For monitoring CPU and Memory consumption I am using Heapster in Kubernetes Dashboard, and that is fine.
For my workload that is highly parallel, I am actually finding network issues most prevalent (i.e. my nodes have more than enough CPU and memory resources, but I suspect not enough network bandwidth to write all this data successfully to the DB).
I have checked out several articles like this but it seems to cover connectivity issues (reachability), but not for monitoring volume of traffic of the cluster in its entirety.
I am really looking for something that shows me "all your Pods are generating X volume of network traffic", if possible.
kubernetes cadvisor heapster
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
add a comment |
I have a Kubernetes cluster doing distributed (parallel) data processing, which writes results to a DB.
I am facing what seems to be a limit to my parallelism due to network throughput performance limit on the DB.
However I was told to investigate the cluster as well, i.e. ensure that my 1000+ Pods in my cluster are really churning out a high level of throughput and is limited by the DB's ability to receive this data.
What are some recommended ways to monitor Kubernetes cluster network throughput (or network performance)?
For monitoring CPU and Memory consumption I am using Heapster in Kubernetes Dashboard, and that is fine.
For my workload that is highly parallel, I am actually finding network issues most prevalent (i.e. my nodes have more than enough CPU and memory resources, but I suspect not enough network bandwidth to write all this data successfully to the DB).
I have checked out several articles like this but it seems to cover connectivity issues (reachability), but not for monitoring volume of traffic of the cluster in its entirety.
I am really looking for something that shows me "all your Pods are generating X volume of network traffic", if possible.
kubernetes cadvisor heapster
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
I have a Kubernetes cluster doing distributed (parallel) data processing, which writes results to a DB.
I am facing what seems to be a limit to my parallelism due to network throughput performance limit on the DB.
However I was told to investigate the cluster as well, i.e. ensure that my 1000+ Pods in my cluster are really churning out a high level of throughput and is limited by the DB's ability to receive this data.
What are some recommended ways to monitor Kubernetes cluster network throughput (or network performance)?
For monitoring CPU and Memory consumption I am using Heapster in Kubernetes Dashboard, and that is fine.
For my workload that is highly parallel, I am actually finding network issues most prevalent (i.e. my nodes have more than enough CPU and memory resources, but I suspect not enough network bandwidth to write all this data successfully to the DB).
I have checked out several articles like this but it seems to cover connectivity issues (reachability), but not for monitoring volume of traffic of the cluster in its entirety.
I am really looking for something that shows me "all your Pods are generating X volume of network traffic", if possible.
kubernetes cadvisor heapster
kubernetes cadvisor heapster
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
asked Nov 14 '18 at 12:17
cryanbhucryanbhu
462414
462414
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53300057%2frecommended-way-to-monitor-kubernetes-cluster-network-output-throughput%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53300057%2frecommended-way-to-monitor-kubernetes-cluster-network-output-throughput%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
