Heroku + Material Design Icons + Rails Asset Pipeline stalling

I'm running Angular (with ngMaterial) and a Rails (3.2.x) backend hosted on Heroku. Trying to install Material Design Icons in bower, but they timeout going through the Rails asset precompile step.

Is there a way to install Material Design Icons in a way that is accessible to Angular but also gets through the rails asset pipeline (or uses a CDN hosted set of icons?)