treasure-data / td-client-go Goto Github PK

View Code? Open in Web Editor NEW

11.0 88.0 17.0 138 KB

Go Client Library for Treasure Data

Home Page: https://docs.treasuredata.com/

License: Apache License 2.0

Go 97.31% Makefile 2.69%

td-client-go's Introduction

Treasure Data API client for Go

Build

make
- To build code and run all the tests
make test-verbose
- To run tests verbosely
make help
- To describe targets
make clean
- To cleanup locally

Synopsis

package main

import (
	td_client "github.com/treasure-data/td-client-go"
)

func main() {
	client, err := td_client.NewTDClient(td_client.Settings {
		ApiKey: "YOUR-API-KEY-HERE",
	})
	if err != nil { ... }
	jobId, err := client.SubmitQuery("mydatabase", td_client.Query {
		Type: "hive",
		Query: "SELECT * FROM mytable WHERE value >= 500",
	})
	if err != nil { ... }
	for {
		status, err := client.JobStatus(jobId)
		if err != nil { ... }
		if status != "queued" && status != "running" { break }
		time.Sleep(1000000000)
	}
	err = client.JobResultEach(jobId, func(v interface{}) error {
		fmt.Printf("Result:%v\n", v)
		return nil
	})
	if err != nil { ... }
}

License

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

td-client-go's People

Contributors

Stargazers

Watchers

Forkers

teraken0509 shiro16 suthio ken11 yui-knk katsuhito123 hkdnet akito19 mickeey2525 jangocheng isabella232 junya-kobayashi

td-client-go's Issues

The call to showAccount fails

The code to reproduce

package main
import (
        td_client "github.com/treasure-data/td-client-go"
        "os"
        "fmt"
        "bytes"
        "compress/gzip"
)
func CompressWithGzip(b []byte) []byte {
        retval := bytes.Buffer {}
        w := gzip.NewWriter(&retval)
        w.Write(b)
        w.Close()
        return retval.Bytes()
}
func main() {
        apiKey := os.Getenv("TD_CLIENT_API_KEY")
        client, err := td_client.NewTDClient(td_client.Settings {
                ApiKey: apiKey,
        })
        account, err := client.ShowAccount()
        if err != nil {
                fmt.Println(err.Error())
                return
        }
        fmt.Printf("id=%d\n", account.Id);
}

When you run the above program, the output is as follows:

$ go run main.go
GenericError: failed to parse response: unknown key presto_plan under /account

td-api update breaks listResults

Code to reproduce

package main

import (
    "fmt"
    td_client "github.com/treasure-data/td-client-go"
    "os"
)

func main() {
    apiKey := os.Getenv("TD_CLIENT_API_KEY")
    client, err := td_client.NewTDClient(td_client.Settings{
        ApiKey: apiKey,
    })
    if err != nil {
        fmt.Println(err.Error())
        return
    }
    results, err := client.ListResults()
    if err != nil {
        fmt.Println(err.Error())
        return
    }
    fmt.Printf("%d results\n", len(*results))
}

$ TD_CLIENT_API_KEY=`td apikey:show` go run test_result.go
GenericError: failed to parse response: unknown key organization under /results[0]

Make HTTPS access for Treasure Data endpoints as default

Treasure Data will abolish HTTP access for Treasure Data endpoints in this August.
Therefore, any accesses via HTTP raise error such as "Server not found".

Since td-client-go uses HTTP access as default, all users who don't use ssl option must be required their code fixed to avoid the errors. Thus, I believe that it's better to enable HTTPS access without ssl option.

https://github.com/treasure-data/td-client-go/blob/master/td_client.go#L233

Currently CI fails on v1.5 and v1.6

td-client-go depends on github.com/ugorji/go/codec.
Currently (2019-06-14), github.com/ugorji/go/codec cannot be built by Go 1.5 and 1.6 because of the missing of the definition of func mapRange.

$ go get github.com/ugorji/go/codec
# github.com/ugorji/go/codec
../../ugorji/go/codec/encode.go:587: undefined: mapRange

https://travis-ci.org/treasure-data/td-client-go/jobs/545596286

This has been caused since ugorji/go@31b118d.
I don't know whether it is intentional or not.

ListJobs method returns an error

With example.go as below

package main
import (
    td_client "github.com/treasure-data/td-client-go"
    "fmt"
    "os"
)

func main() {
    apiKey := os.Getenv("TD_CLIENT_API_KEY")
    client, err := td_client.NewTDClient(td_client.Settings{
        ApiKey: apiKey,
    })

    jobs, err := client.ListJobs()

    if err != nil {
        fmt.Printf("%s\n", err.Error())
    } else {
        fmt.Printf("num jobs:%d\n", len(*jobs))
    }
    return
}

I get the following error consistently.

$ TD_CLIENT_API_KEY=`td apikey:show` go run example.go
NotFoundError: List jobs failed:

Develop a build strategy

The code currently does not have an easy way to build

At the minimum, add a Makefile to build and run tests easily.

treasure-data / td-client-go Goto Github PK

td-client-go's Introduction

Treasure Data API client for Go

Build

Synopsis

License

td-client-go's People

Contributors

Stargazers

Watchers

Forkers

td-client-go's Issues

The call to showAccount fails

td-api update breaks listResults

Make HTTPS access for Treasure Data endpoints as default

Currently CI fails on v1.5 and v1.6

ListJobs method returns an error

Develop a build strategy

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent