With BurntSushi/tomlUnmarshalText(text []byte) error, we can support unmarshal to set directly, check hashset_test.go for detail. But BurntSushi/toml is not under active development, we hope pelletier/go-toml would support this feature soon. Check pelletier/go-toml#329 if you like this feature.