Urlencode

urlencode()函数原理就是首先把中文字符转换为十六进制，然后在每个字符前面加一个标识符%

http://www.lagou.com/jobs/list_Python?px=default&city=%E5%8C%97%E4%BA%AC&district=%E6%9C%9D%E9%98%B3%E5%8C%BA&bizArea=%E6%9C%9B%E4%BA%AC#filterBox

urlencode编码 - 图1

提出个问题：中文字符按什么编码格式进行转化成十六进制呢？

utf-8、gb2312、gbk urlencode编码

  • utf-8与utf-8 urlencode区别
  1. import urllib
  3. country = u'中国'
  5. country.encode('utf-8')
  6. '\xe4\xb8\xad\xe5\x9b\xbd'
  8. urllib.quote(country.encode('utf-8'))
  9. '%E4%B8%AD%E5%9B%BD'
  • gb2312与gb2312 urlencode区别
  1. import urllib
  3. country = u'中国'
  5. country.encode('gb2312')
  6. '\xd6\xd0\xb9\xfa'
  8. urllib.quote(country.encode('gb2312'))
  9. '%D6%D0%B9%FA'

案例

模拟出 拉勾网 如下url地址：

http://www.lagou.com/jobs/list_Python?px=default&city=%E5%8C%97%E4%BA%AC&district=%E6%9C%9D%E9%98%B3%E5%8C%BA&bizArea=%E6%9C%9B%E4%BA%AC#filterBox

  1. # -*- coding: utf-8 -*-
  2. import urllib
  3. import chardet
  5. city=u'北京'.encode('utf-8')
  6. district=u'朝阳区'.encode('utf-8')
  7. bizArea=u'望京'.encode('utf-8')
  9. query={
  10.     'city':city,
  11.     'district':district,
  12.     'bizArea':bizArea
  13. }
  15. print chardet.detect(query['city'])
  16. {'confidence': 0.7525, 'encoding': 'utf-8'}
  18. print urllib.urlencode(query)
  19. city=%E5%8C%97%E4%BA%AC&bizArea=%E6%9C%9B%E4%BA%AC&district=%E6%9C%9B%E4%BA%AC
  21. print 'http://www.lagou.com/jobs/list_Python?px=default&'+urllib.urlencode(query)+'#filterBox'
  22. http://www.lagou.com/jobs/list_Python?px=default&city=%E5%8C%97%E4%BA%AC&bizArea=%E6%9C%9B%E4%BA%AC&district=%E6%9C%9B%E4%BA%AC#filterBox

模拟出 阿里巴巴 如下url地址：

https://s.1688.com/selloffer/offer_search.htm?keywords=%CA%D6%BB%FA%BC%B0%C5%E4%BC%FE%CA%D0%B3%A1

urlencode编码 - 图2

  1. # -*- coding: utf-8 -*-
  2. import urllib
  3. import chardet
  5. keywords=u'手机及配件市场'.encode('gbk')
  7. query={
  8.     'keywords':keywords,
  9. }
  10. print chardet.detect(query['keywords'])
  11. {'confidence': 0.99, 'encoding': 'GB2312'}
  12. print urllib.urlencode(query)
  13. keywords=%CA%D6%BB%FA%BC%B0%C5%E4%BC%FE%CA%D0%B3%A1
  15. print 'https://s.1688.com/selloffer/offer_search.htm?'+urllib.urlencode(query)
  16. https://s.1688.com/selloffer/offer_search.htm?keywords=%CA%D6%BB%FA%BC%B0%C5%E4%BC%FE%CA%D0%B3%A1

练习

模拟出 环球经贸网 如下url地址：

http://search.nowec.com/search?q=%B0%B2%C8%AB%C3%C5

  1. # -*- coding: utf-8 -*-
  2. import urllib
  3. import chardet
  5. q=u'安全门'.encode('gb2312')
  7. query={
  8.     'q':q,
  9. }
  10. print chardet.detect(query['q'])
  11. {'confidence': 0.99, 'encoding': 'GB2312'}
  12. print urllib.urlencode(query)
  13. q=%B0%B2%C8%AB%C3%C5
  15. print 'http://search.nowec.com/search?'+urllib.urlencode(query)
  16. http://search.nowec.com/search?q=%B0%B2%C8%AB%C3%C5