0

GSoC 2018: Building a benchmarker for the urlparse

The benchmarker that I built can be seen here. This benchmarker will help me out a lot when profiling the main components that use functions from the urlparse library!

There are 3 functions that we need to pay attention to:

  • w3lib.url , file_uri_to_path, which uses urlparse
  • Safe_url_string, which uses urlsplit and urlunsplit
  • Canonicalize_url, which uses urlparse, parse_qsl, quote, urlunparse

Therefore, I made this benchmarker to measure the speed of those 3 functions directly from w3lib!

More analysis on this is coming soon!