Is it possible to use SVG sprites for MDL components?

In order to make the component icons rendered we need to add Material Icons font to the page. We already use SVG versions of the icons and want to reuse them for the components instead of duplicating them with the fonts file.

If I add SVG sprites to the page the components do not pick up the icons and empty squares rendered instead of icons. Example:

``` html

Result:
Expected - the menu icon is rendered: