We should use font_config to select which fonts to use for rendering. There are Python bindings available.