And I don’t know if you need all the files (I am not really familiar with material icons, just quickly tried it when I read your question. Maybe that’s not what you need(.
For the sake of the example I used this file:
https://fonts.gstatic.com/s/materialsymbolsoutlined/v10/kJEhBvYX7BgnkSrUwT8OhrdQw4oELdPIeeII9v6oFsI.woff2
Of course, if you need to change the parameters like Fill etc… you’re better work with a stylesheet in an iframe or custom element.