Python, opposite function urllib.urlencode












84















How can I convert data after processing urllib.urlencode to dict?
urllib.urldecode does not exist.






python urllib







share|improve this question





























    84















    How can I convert data after processing urllib.urlencode to dict?
    urllib.urldecode does not exist.






    python urllib







    share|improve this question



























      84












      84








      84


      21






      How can I convert data after processing urllib.urlencode to dict?
      urllib.urldecode does not exist.






      python urllib







      share|improve this question
















      How can I convert data after processing urllib.urlencode to dict?
      urllib.urldecode does not exist.






      python urllib




      python urllib






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited May 29 '16 at 10:44









      guaka

      10.8k74784




      10.8k74784










      asked Aug 22 '10 at 18:59









      ArtyomArtyom

      88821114




      88821114
























          3 Answers
          3






          active

          oldest

          votes


















          116














          As the docs for urlencode say,




          The urlparse module provides the
          functions parse_qs() and parse_qsl()
          which are used to parse query strings
          into Python data structures.




          (In older Python releases, they were in the cgi module). So, for example:



          >>> import urllib
          
>>> import urlparse
          
>>> d = {'a':'b', 'c':'d'}
          
>>> s = urllib.urlencode(d)
          
>>> s
          
'a=b&c=d'
          
>>> d1 = urlparse.parse_qs(s)
          
>>> d1
          
{'a': ['b'], 'c': ['d']}


          The obvious difference between the original dictionary d and the "round-tripped" one d1 is that the latter has (single-item, in this case) lists as values -- that's because there is no uniqueness guarantee in query strings, and it may be important to your app to know about what multiple values have been given for each key (that is, the lists won't always be single-item ones;-).



          As an alternative:



          >>> sq = urlparse.parse_qsl(s)
          
>>> sq  
          
[('a', 'b'), ('c', 'd')]
          
>>> dict(sq)
          
{'a': 'b', 'c': 'd'}


          you can get a sequence of pairs (urlencode accepts such an argument, too -- in this case it preserves order, while in the dict case there's no order to preserve;-). If you know there are no duplicate "keys", or don't care if there are, then (as I've shown) you can call dict to get a dictionary with non-list values. In general, however, you do need to consider what you want to do if duplicates are present (Python doesn't decide that on your behalf;-).






          share|improve this answer





















          • 1





            Alex Martelli, thank you!

            – Artyom
            Aug 22 '10 at 20:17











          • @Derek, you're welcome!

            – Alex Martelli
            Aug 22 '10 at 20:25






          • 1





            Very thorough answer. Awesome!

            – Hartley Brody
            Dec 21 '11 at 19:53



















          16














          Python 3 code for Alex's solution:



          >>> import urllib.parse
          
>>> d = {'a':'b', 'c':'d'}
          
>>> s = urllib.parse.urlencode(d)
          
>>> s
          
'a=b&c=d'
          
>>> d1 = urllib.parse.parse_qs(s)
          
>>> d1
          
{'a': ['b'], 'c': ['d']}


          The alternative:



          >>> sq = urllib.parse.parse_qsl(s)
          
>>> sq
          
[('a', 'b'), ('c', 'd')]
          
>>> dict(sq)
          
{'a': 'b', 'c': 'd'}


          parse_qsl is reversible:



          >>> urllib.parse.urlencode(sq)
          
'a=b&c=d'





          share|improve this answer































            16














            urllib.unquote_plus() does what you want. It Replace %xx escapes by their single-character equivalent and replaces plus signs with spaces.



            Example: 



            unquote_plus('/%7Ecandidates/?name=john+connolly')


            yields 



            '/~candidates/?name=john connolly'.





            share|improve this answer





















            • 1





              He said, he wanted a dict. So your answer is wrong.

              – balrok
              Jul 23 '14 at 16:45






            • 4





              yay, this is what I was looking for.

              – Joe
              Mar 21 '16 at 12:01











            Your Answer






            StackExchange.ifUsing("editor", function () {
            StackExchange.using("externalEditor", function () {
            StackExchange.using("snippets", function () {
            StackExchange.snippets.init();
            });
            });
            }, "code-snippets");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "1"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f3542881%2fpython-opposite-function-urllib-urlencode%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            3 Answers
            3






            active

            oldest

            votes








            3 Answers
            3






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            116














            As the docs for urlencode say,




            The urlparse module provides the
            functions parse_qs() and parse_qsl()
            which are used to parse query strings
            into Python data structures.




            (In older Python releases, they were in the cgi module). So, for example:



            >>> import urllib
            
>>> import urlparse
            
>>> d = {'a':'b', 'c':'d'}
            
>>> s = urllib.urlencode(d)
            
>>> s
            
'a=b&c=d'
            
>>> d1 = urlparse.parse_qs(s)
            
>>> d1
            
{'a': ['b'], 'c': ['d']}


            The obvious difference between the original dictionary d and the "round-tripped" one d1 is that the latter has (single-item, in this case) lists as values -- that's because there is no uniqueness guarantee in query strings, and it may be important to your app to know about what multiple values have been given for each key (that is, the lists won't always be single-item ones;-).



            As an alternative:



            >>> sq = urlparse.parse_qsl(s)
            
>>> sq  
            
[('a', 'b'), ('c', 'd')]
            
>>> dict(sq)
            
{'a': 'b', 'c': 'd'}


            you can get a sequence of pairs (urlencode accepts such an argument, too -- in this case it preserves order, while in the dict case there's no order to preserve;-). If you know there are no duplicate "keys", or don't care if there are, then (as I've shown) you can call dict to get a dictionary with non-list values. In general, however, you do need to consider what you want to do if duplicates are present (Python doesn't decide that on your behalf;-).






            share|improve this answer





















            • 1





              Alex Martelli, thank you!

              – Artyom
              Aug 22 '10 at 20:17











            • @Derek, you're welcome!

              – Alex Martelli
              Aug 22 '10 at 20:25






            • 1





              Very thorough answer. Awesome!

              – Hartley Brody
              Dec 21 '11 at 19:53
















            116














            As the docs for urlencode say,




            The urlparse module provides the
            functions parse_qs() and parse_qsl()
            which are used to parse query strings
            into Python data structures.




            (In older Python releases, they were in the cgi module). So, for example:



            >>> import urllib
            
>>> import urlparse
            
>>> d = {'a':'b', 'c':'d'}
            
>>> s = urllib.urlencode(d)
            
>>> s
            
'a=b&c=d'
            
>>> d1 = urlparse.parse_qs(s)
            
>>> d1
            
{'a': ['b'], 'c': ['d']}


            The obvious difference between the original dictionary d and the "round-tripped" one d1 is that the latter has (single-item, in this case) lists as values -- that's because there is no uniqueness guarantee in query strings, and it may be important to your app to know about what multiple values have been given for each key (that is, the lists won't always be single-item ones;-).



            As an alternative:



            >>> sq = urlparse.parse_qsl(s)
            
>>> sq  
            
[('a', 'b'), ('c', 'd')]
            
>>> dict(sq)
            
{'a': 'b', 'c': 'd'}


            you can get a sequence of pairs (urlencode accepts such an argument, too -- in this case it preserves order, while in the dict case there's no order to preserve;-). If you know there are no duplicate "keys", or don't care if there are, then (as I've shown) you can call dict to get a dictionary with non-list values. In general, however, you do need to consider what you want to do if duplicates are present (Python doesn't decide that on your behalf;-).






            share|improve this answer





















            • 1





              Alex Martelli, thank you!

              – Artyom
              Aug 22 '10 at 20:17











            • @Derek, you're welcome!

              – Alex Martelli
              Aug 22 '10 at 20:25






            • 1





              Very thorough answer. Awesome!

              – Hartley Brody
              Dec 21 '11 at 19:53














            116












            116








            116







            As the docs for urlencode say,




            The urlparse module provides the
            functions parse_qs() and parse_qsl()
            which are used to parse query strings
            into Python data structures.




            (In older Python releases, they were in the cgi module). So, for example:



            >>> import urllib
            
>>> import urlparse
            
>>> d = {'a':'b', 'c':'d'}
            
>>> s = urllib.urlencode(d)
            
>>> s
            
'a=b&c=d'
            
>>> d1 = urlparse.parse_qs(s)
            
>>> d1
            
{'a': ['b'], 'c': ['d']}


            The obvious difference between the original dictionary d and the "round-tripped" one d1 is that the latter has (single-item, in this case) lists as values -- that's because there is no uniqueness guarantee in query strings, and it may be important to your app to know about what multiple values have been given for each key (that is, the lists won't always be single-item ones;-).



            As an alternative:



            >>> sq = urlparse.parse_qsl(s)
            
>>> sq  
            
[('a', 'b'), ('c', 'd')]
            
>>> dict(sq)
            
{'a': 'b', 'c': 'd'}


            you can get a sequence of pairs (urlencode accepts such an argument, too -- in this case it preserves order, while in the dict case there's no order to preserve;-). If you know there are no duplicate "keys", or don't care if there are, then (as I've shown) you can call dict to get a dictionary with non-list values. In general, however, you do need to consider what you want to do if duplicates are present (Python doesn't decide that on your behalf;-).






            share|improve this answer















            As the docs for urlencode say,




            The urlparse module provides the
            functions parse_qs() and parse_qsl()
            which are used to parse query strings
            into Python data structures.




            (In older Python releases, they were in the cgi module). So, for example:



            >>> import urllib
            
>>> import urlparse
            
>>> d = {'a':'b', 'c':'d'}
            
>>> s = urllib.urlencode(d)
            
>>> s
            
'a=b&c=d'
            
>>> d1 = urlparse.parse_qs(s)
            
>>> d1
            
{'a': ['b'], 'c': ['d']}


            The obvious difference between the original dictionary d and the "round-tripped" one d1 is that the latter has (single-item, in this case) lists as values -- that's because there is no uniqueness guarantee in query strings, and it may be important to your app to know about what multiple values have been given for each key (that is, the lists won't always be single-item ones;-).



            As an alternative:



            >>> sq = urlparse.parse_qsl(s)
            
>>> sq  
            
[('a', 'b'), ('c', 'd')]
            
>>> dict(sq)
            
{'a': 'b', 'c': 'd'}


            you can get a sequence of pairs (urlencode accepts such an argument, too -- in this case it preserves order, while in the dict case there's no order to preserve;-). If you know there are no duplicate "keys", or don't care if there are, then (as I've shown) you can call dict to get a dictionary with non-list values. In general, however, you do need to consider what you want to do if duplicates are present (Python doesn't decide that on your behalf;-).







            share|improve this answer














            share|improve this answer



            share|improve this answer








            edited Aug 22 '10 at 19:09

























            answered Aug 22 '10 at 19:02









            Alex MartelliAlex Martelli

            629k12810411281




            629k12810411281








            • 1





              Alex Martelli, thank you!

              – Artyom
              Aug 22 '10 at 20:17











            • @Derek, you're welcome!

              – Alex Martelli
              Aug 22 '10 at 20:25






            • 1





              Very thorough answer. Awesome!

              – Hartley Brody
              Dec 21 '11 at 19:53














            • 1





              Alex Martelli, thank you!

              – Artyom
              Aug 22 '10 at 20:17











            • @Derek, you're welcome!

              – Alex Martelli
              Aug 22 '10 at 20:25






            • 1





              Very thorough answer. Awesome!

              – Hartley Brody
              Dec 21 '11 at 19:53








            1




            1





            Alex Martelli, thank you!

            – Artyom
            Aug 22 '10 at 20:17





            Alex Martelli, thank you!

            – Artyom
            Aug 22 '10 at 20:17













            @Derek, you're welcome!

            – Alex Martelli
            Aug 22 '10 at 20:25





            @Derek, you're welcome!

            – Alex Martelli
            Aug 22 '10 at 20:25




            1




            1





            Very thorough answer. Awesome!

            – Hartley Brody
            Dec 21 '11 at 19:53





            Very thorough answer. Awesome!

            – Hartley Brody
            Dec 21 '11 at 19:53













            16














            Python 3 code for Alex's solution:



            >>> import urllib.parse
            
>>> d = {'a':'b', 'c':'d'}
            
>>> s = urllib.parse.urlencode(d)
            
>>> s
            
'a=b&c=d'
            
>>> d1 = urllib.parse.parse_qs(s)
            
>>> d1
            
{'a': ['b'], 'c': ['d']}


            The alternative:



            >>> sq = urllib.parse.parse_qsl(s)
            
>>> sq
            
[('a', 'b'), ('c', 'd')]
            
>>> dict(sq)
            
{'a': 'b', 'c': 'd'}


            parse_qsl is reversible:



            >>> urllib.parse.urlencode(sq)
            
'a=b&c=d'





            share|improve this answer




























              16














              Python 3 code for Alex's solution:



              >>> import urllib.parse
              
>>> d = {'a':'b', 'c':'d'}
              
>>> s = urllib.parse.urlencode(d)
              
>>> s
              
'a=b&c=d'
              
>>> d1 = urllib.parse.parse_qs(s)
              
>>> d1
              
{'a': ['b'], 'c': ['d']}


              The alternative:



              >>> sq = urllib.parse.parse_qsl(s)
              
>>> sq
              
[('a', 'b'), ('c', 'd')]
              
>>> dict(sq)
              
{'a': 'b', 'c': 'd'}


              parse_qsl is reversible:



              >>> urllib.parse.urlencode(sq)
              
'a=b&c=d'





              share|improve this answer


























                16












                16








                16







                Python 3 code for Alex's solution:



                >>> import urllib.parse
                
>>> d = {'a':'b', 'c':'d'}
                
>>> s = urllib.parse.urlencode(d)
                
>>> s
                
'a=b&c=d'
                
>>> d1 = urllib.parse.parse_qs(s)
                
>>> d1
                
{'a': ['b'], 'c': ['d']}


                The alternative:



                >>> sq = urllib.parse.parse_qsl(s)
                
>>> sq
                
[('a', 'b'), ('c', 'd')]
                
>>> dict(sq)
                
{'a': 'b', 'c': 'd'}


                parse_qsl is reversible:



                >>> urllib.parse.urlencode(sq)
                
'a=b&c=d'





                share|improve this answer













                Python 3 code for Alex's solution:



                >>> import urllib.parse
                
>>> d = {'a':'b', 'c':'d'}
                
>>> s = urllib.parse.urlencode(d)
                
>>> s
                
'a=b&c=d'
                
>>> d1 = urllib.parse.parse_qs(s)
                
>>> d1
                
{'a': ['b'], 'c': ['d']}


                The alternative:



                >>> sq = urllib.parse.parse_qsl(s)
                
>>> sq
                
[('a', 'b'), ('c', 'd')]
                
>>> dict(sq)
                
{'a': 'b', 'c': 'd'}


                parse_qsl is reversible:



                >>> urllib.parse.urlencode(sq)
                
'a=b&c=d'






                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Apr 17 '12 at 0:02









                phobiephobie

                1,61511519




                1,61511519























                    16














                    urllib.unquote_plus() does what you want. It Replace %xx escapes by their single-character equivalent and replaces plus signs with spaces.



                    Example: 



                    unquote_plus('/%7Ecandidates/?name=john+connolly')


                    yields 



                    '/~candidates/?name=john connolly'.





                    share|improve this answer





















                    • 1





                      He said, he wanted a dict. So your answer is wrong.

                      – balrok
                      Jul 23 '14 at 16:45






                    • 4





                      yay, this is what I was looking for.

                      – Joe
                      Mar 21 '16 at 12:01
















                    16














                    urllib.unquote_plus() does what you want. It Replace %xx escapes by their single-character equivalent and replaces plus signs with spaces.



                    Example: 



                    unquote_plus('/%7Ecandidates/?name=john+connolly')


                    yields 



                    '/~candidates/?name=john connolly'.





                    share|improve this answer





















                    • 1





                      He said, he wanted a dict. So your answer is wrong.

                      – balrok
                      Jul 23 '14 at 16:45






                    • 4





                      yay, this is what I was looking for.

                      – Joe
                      Mar 21 '16 at 12:01














                    16












                    16








                    16







                    urllib.unquote_plus() does what you want. It Replace %xx escapes by their single-character equivalent and replaces plus signs with spaces.



                    Example: 



                    unquote_plus('/%7Ecandidates/?name=john+connolly')


                    yields 



                    '/~candidates/?name=john connolly'.





                    share|improve this answer















                    urllib.unquote_plus() does what you want. It Replace %xx escapes by their single-character equivalent and replaces plus signs with spaces.



                    Example: 



                    unquote_plus('/%7Ecandidates/?name=john+connolly')


                    yields 



                    '/~candidates/?name=john connolly'.






                    share|improve this answer














                    share|improve this answer



                    share|improve this answer








                    edited Nov 15 '18 at 8:11









                    Jean-François Corbett

                    28.8k22110161




                    28.8k22110161










                    answered Feb 26 '14 at 15:36









                    Andrew FarrellAndrew Farrell

                    1,3131218




                    1,3131218








                    • 1





                      He said, he wanted a dict. So your answer is wrong.

                      – balrok
                      Jul 23 '14 at 16:45






                    • 4





                      yay, this is what I was looking for.

                      – Joe
                      Mar 21 '16 at 12:01














                    • 1





                      He said, he wanted a dict. So your answer is wrong.

                      – balrok
                      Jul 23 '14 at 16:45






                    • 4





                      yay, this is what I was looking for.

                      – Joe
                      Mar 21 '16 at 12:01








                    1




                    1





                    He said, he wanted a dict. So your answer is wrong.

                    – balrok
                    Jul 23 '14 at 16:45





                    He said, he wanted a dict. So your answer is wrong.

                    – balrok
                    Jul 23 '14 at 16:45




                    4




                    4





                    yay, this is what I was looking for.

                    – Joe
                    Mar 21 '16 at 12:01





                    yay, this is what I was looking for.

                    – Joe
                    Mar 21 '16 at 12:01


















                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Stack Overflow!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid …



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f3542881%2fpython-opposite-function-urllib-urlencode%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    -

                    Popular posts from this blog

                    Florida Star v. B. J. F.

                    Image
                    Florida Star v. B. J. F. From Wikipedia, the free encyclopedia Jump to navigation Jump to search United States Supreme Court case Florida Star v. B. J. F. Supreme Court of the United States Argued March 21, 1989 Decided June 21, 1989 Full case name The Florida Star v. B. J. F. Citations 491 U.S. 524 ( more ) 109 S. Ct. 2603; 105 L. Ed. 2d 443; 1989 U.S. LEXIS 3120; 57 U.S.L.W. 4816; 16 Media L. Rep. 1801 Prior history The Florida Star v. B.J.F., 530 So.2d 286 (1988) Supreme Court of Florida; Florida Star v. B.J.F., 499 So.2d 883 (1986) Fla. Dist. Court of Appeals Holding Florida Stat. § 794.03 is unconstitutional to the extent it makes the truthful reporting of information that was a matter of public record unlawful, as it violates the First Amendment. Court membership Chief Justice William Rehnquist Associate Justices William J. Brennan Jr.  · Byron White Thurgood Marshall  · Harry Blac
                    Read more

                    Error while running script in elastic search , gateway timeout

                    Image
                    0 while running script in elastic search, I got 504 Gateway timeout error. { "query": { "bool": { "filter": { "script": { "script": " doc['creted_date'].date.getMonthOfYear() == 12 " } } } }, "aggs": { "test": { "date_histogram": { "field": "creted_date", "interval": "month", "format": "MMM" }, "aggs": { "cost": { "sum": { "field": "cost" } } }
                    Read more

                    Adding quotations to stringified JSON object values

                    Image
                    0 My stringified object data doesn't include quotation marks around object values, which errors when attempting JSON.parse() : '{ "affiliation": CORPORATE, "userId": 75c35d1c-5d12-4485-8fa8-b2f1551a3e6e }' I need the string to be: '{ "affiliation": "CORPORATE", "userId": "75c35d1c-5d12-4485-8fa8-b2f1551a3e6e" }' I'm using this regex to add quotes to the object keys: var newStr = str.replace(/(['"])?([a-z0-9A-Z_]+)(['"])?:/g, '"$2": '); For instance: '{ affiliation: CORPORATE }' to '{ "affiliation": CORPORATE }' There are only string values in my data, so I don't need to check value types. How can I alter my regex expression to add quotations to
                    Read more