Kafka - AccessDeniedException when changing partition leader





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}







1















When running a Kafka cluster (Kafka v 2.11-1.1.0) on 2 Windows machines, it seems an AccessDeniedException is thrown when I try to change the leader for a particular topic partition. This causes the broker (current leader) to crash. This may be related to the following unresolved issue: https://issues.apache.org/jira/browse/KAFKA-1194 . Is there anything I can do about this or can you just not change the topic leader on Windows at this time without having to restart a broker?



Steps to re-produce:




  1. Start a zookeeper service on a Windows 10 machine.

  2. Start a kafka broker on the same machine.

  3. Start a second kafka broker on a second Windows 10 machine connected to the same zookeeper as the first, so as to form a Kafka cluster.

  4. Create a topic with 1 partition and observe the resultant leader of that partition.


  5. Use kafka-reassign-partitions command (as per https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools) to change the leader for that topic partition. Use a json file similar to what is shown below where 'topicName' is replaced by the name of the topic created in step 4, and '1' is replaced by the BrokerId of the Kafka broker that is not currently the leader of this partition:



    {
    "version":1,
    "partitions":[
    {"topic":"topicName","partition":0,"replicas":[1]}
    ]
    }




After performing the above steps I see an the following in the log of the old topic partition leader:



Error while renaming dir for testTopic in log dir C:UsersPublicDocumentsKafkalogs (kafka.server.LogDirFailureChannel) java.nio.file.AccessDeniedException









share|improve this question































    1















    When running a Kafka cluster (Kafka v 2.11-1.1.0) on 2 Windows machines, it seems an AccessDeniedException is thrown when I try to change the leader for a particular topic partition. This causes the broker (current leader) to crash. This may be related to the following unresolved issue: https://issues.apache.org/jira/browse/KAFKA-1194 . Is there anything I can do about this or can you just not change the topic leader on Windows at this time without having to restart a broker?



    Steps to re-produce:




    1. Start a zookeeper service on a Windows 10 machine.

    2. Start a kafka broker on the same machine.

    3. Start a second kafka broker on a second Windows 10 machine connected to the same zookeeper as the first, so as to form a Kafka cluster.

    4. Create a topic with 1 partition and observe the resultant leader of that partition.


    5. Use kafka-reassign-partitions command (as per https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools) to change the leader for that topic partition. Use a json file similar to what is shown below where 'topicName' is replaced by the name of the topic created in step 4, and '1' is replaced by the BrokerId of the Kafka broker that is not currently the leader of this partition:



      {
      "version":1,
      "partitions":[
      {"topic":"topicName","partition":0,"replicas":[1]}
      ]
      }




    After performing the above steps I see an the following in the log of the old topic partition leader:



    Error while renaming dir for testTopic in log dir C:UsersPublicDocumentsKafkalogs (kafka.server.LogDirFailureChannel) java.nio.file.AccessDeniedException









    share|improve this question



























      1












      1








      1








      When running a Kafka cluster (Kafka v 2.11-1.1.0) on 2 Windows machines, it seems an AccessDeniedException is thrown when I try to change the leader for a particular topic partition. This causes the broker (current leader) to crash. This may be related to the following unresolved issue: https://issues.apache.org/jira/browse/KAFKA-1194 . Is there anything I can do about this or can you just not change the topic leader on Windows at this time without having to restart a broker?



      Steps to re-produce:




      1. Start a zookeeper service on a Windows 10 machine.

      2. Start a kafka broker on the same machine.

      3. Start a second kafka broker on a second Windows 10 machine connected to the same zookeeper as the first, so as to form a Kafka cluster.

      4. Create a topic with 1 partition and observe the resultant leader of that partition.


      5. Use kafka-reassign-partitions command (as per https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools) to change the leader for that topic partition. Use a json file similar to what is shown below where 'topicName' is replaced by the name of the topic created in step 4, and '1' is replaced by the BrokerId of the Kafka broker that is not currently the leader of this partition:



        {
        "version":1,
        "partitions":[
        {"topic":"topicName","partition":0,"replicas":[1]}
        ]
        }




      After performing the above steps I see an the following in the log of the old topic partition leader:



      Error while renaming dir for testTopic in log dir C:UsersPublicDocumentsKafkalogs (kafka.server.LogDirFailureChannel) java.nio.file.AccessDeniedException









      share|improve this question
















      When running a Kafka cluster (Kafka v 2.11-1.1.0) on 2 Windows machines, it seems an AccessDeniedException is thrown when I try to change the leader for a particular topic partition. This causes the broker (current leader) to crash. This may be related to the following unresolved issue: https://issues.apache.org/jira/browse/KAFKA-1194 . Is there anything I can do about this or can you just not change the topic leader on Windows at this time without having to restart a broker?



      Steps to re-produce:




      1. Start a zookeeper service on a Windows 10 machine.

      2. Start a kafka broker on the same machine.

      3. Start a second kafka broker on a second Windows 10 machine connected to the same zookeeper as the first, so as to form a Kafka cluster.

      4. Create a topic with 1 partition and observe the resultant leader of that partition.


      5. Use kafka-reassign-partitions command (as per https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools) to change the leader for that topic partition. Use a json file similar to what is shown below where 'topicName' is replaced by the name of the topic created in step 4, and '1' is replaced by the BrokerId of the Kafka broker that is not currently the leader of this partition:



        {
        "version":1,
        "partitions":[
        {"topic":"topicName","partition":0,"replicas":[1]}
        ]
        }




      After performing the above steps I see an the following in the log of the old topic partition leader:



      Error while renaming dir for testTopic in log dir C:UsersPublicDocumentsKafkalogs (kafka.server.LogDirFailureChannel) java.nio.file.AccessDeniedException






      windows apache-kafka access-denied






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 19 '18 at 19:29







      FredEspo

















      asked Nov 16 '18 at 19:05









      FredEspoFredEspo

      62




      62
























          0






          active

          oldest

          votes












          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53343937%2fkafka-accessdeniedexception-when-changing-partition-leader%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53343937%2fkafka-accessdeniedexception-when-changing-partition-leader%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Florida Star v. B. J. F.

          Danny Elfman

          Retrieve a Users Dashboard in Tumblr with R and TumblR. Oauth Issues