So far, Guice is not elegantly designed

A simpler way is to write configuration is in Java initialization block. see https://github.com/drinkjava2/jBeanBox project.
Guice is harder to use than jBeanBox or Spring's Java based configuration if need inject a bean but without its sourcecode. Please consider simplify the Provider by write config in initialization block.