• output repositories in tabular format
• output repositories in json format
• output repositories in grimoirelab format

Private repositories currently contain the user and token in the http clone urls. It seems there is a fix in latest version that has not yet been released as docker image.

Furthermore git clones as ssh should be possible, however that only works for the git specific parts.

chaoss/grimoirelab#205 (comment)

External collaborators in an organization should be included in the members overview.
For each member in this overview it should be clear that the member is a external collaborator using a boolean field.

https://docs.gitlab.com/ee/api/api_resources.html

• Fetch repositories
• Filter cababilities like the github cli offers
• Visbility filters are also added to the api request

See #36 for the implementation on github cli.

To be able to fetch github forks the query has to be adjusted.

From:
{"query":"org:philips-forks archived:false","repoCursor":null}

To:
{"query":"org:philips-forks archived:false fork: true","repoCursor":null}

Furthermore it would be good to include this in the table output to indicate which repo is a fork.

Also include filter capability to show only forks, both or non-forks.

https://goreleaser.com/customization/docker_manifest/

Currently:

$ tabia github repositories -O philips-labs -F json
[
  {
    "name": "tabia",
    "id": "MDEwOlJlcG9zaXRvcnkyNjUzMDYzNzU=",
    "url": "https://github.com/philips-labs/tabia",
    "ssh_url": "[email protected]:philips-labs/tabia.git",
    "owner": "philips-labs",
    "created_at": "2020-05-19T16:50:46Z",
    "updated_at": "2020-07-20T13:31:06Z",
    "pushed_at": "2020-07-20T13:32:18Z"
  },
  {
    "name": "internal-example",
    "id": "MDEwOlJlcG9zaXRvcnkyNjUzMDYzNzU=",
    "url": "https://github.com/philips-labs/internal-example",
    "ssh_url": "[email protected]:philips-labs/internal-example.git",
    "owner": "philips-labs",
    "is_private": 1,
    "created_at": "2020-05-19T16:50:46Z",
    "updated_at": "2020-07-20T13:31:06Z",
    "pushed_at": "2020-07-20T13:32:18Z"
  },
  {
    "name": "private-example",
    "id": "MDEwOlJlcG9zaXRvcnkyNjUzMDYzNzU=",
    "url": "https://github.com/philips-labs/private-example",
    "ssh_url": "[email protected]:philips-labs/private-example.git",
    "owner": "philips-labs",
    "is_private": 2,
    "created_at": "2020-05-19T16:50:46Z",
    "updated_at": "2020-07-20T13:31:06Z",
    "pushed_at": "2020-07-20T13:32:18Z"
  },
]

Expected:

See is_private is renamed to visibility and values are represented as string as opposed to integer.

$ tabia github repositories -O philips-labs -F json
[
  {
    "name": "tabia",
    "id": "MDEwOlJlcG9zaXRvcnkyNjUzMDYzNzU=",
    "url": "https://github.com/philips-labs/tabia",
    "ssh_url": "[email protected]:philips-labs/tabia.git",
    "owner": "philips-labs",
    "visibility": "Public",
    "created_at": "2020-05-19T16:50:46Z",
    "updated_at": "2020-07-20T13:31:06Z",
    "pushed_at": "2020-07-20T13:32:18Z"
  },
  {
    "name": "internal-example",
    "id": "MDEwOlJlcG9zaXRvcnkyNjUzMDYzNzU=",
    "url": "https://github.com/philips-labs/internal-example",
    "ssh_url": "[email protected]:philips-labs/internal-example.git",
    "owner": "philips-labs",
    "visibility": "Internal",
    "created_at": "2020-05-19T16:50:46Z",
    "updated_at": "2020-07-20T13:31:06Z",
    "pushed_at": "2020-07-20T13:32:18Z"
  },
  {
    "name": "private-example",
    "id": "MDEwOlJlcG9zaXRvcnkyNjUzMDYzNzU=",
    "url": "https://github.com/philips-labs/private-example",
    "ssh_url": "[email protected]:philips-labs/private-example.git",
    "owner": "philips-labs",
    "visibility": "Private",
    "created_at": "2020-05-19T16:50:46Z",
    "updated_at": "2020-07-20T13:31:06Z",
    "pushed_at": "2020-07-20T13:32:18Z"
  },
]

Summary

When quering repositories, tabia only shows the first 1000 repositories.

Example

./bin/tabia github -t <token> repositories -O philips-internal -F templated -T tabia-repository.tmpl > repositories.txt

https://docs.microsoft.com/en-us/rest/api/azure/devops/?view=azure-devops-rest-6.0

• Fetch repositories
• Filter cababilities like the github cli offers

The tabia github repositories cli contains an option --filter with alias -f. Which allows to filter the list of repositories.

The same functionality can be added and documented for the tabia bitbucket repositories cli.

The tabia github repositories cli has an option to define a template for the output using --format templated and --template my-template-file.template which allows for example to output the contents in markdown or csv format.

The same feature can be added to bitbucket.

Using following approach we should be able to have progress information if we are not writing the contents to a file.

https://rosettacode.org/wiki/Check_output_device_is_a_terminal#Go

See the bitbucket and github cli for a reference implementation.

Start at branch feature/gitlab-grimoirelab

https://github.com/goreleaser/goreleaser-action#signing

This is a test for first-interaction workflow

make build fails with the following error message:

$ make build
BIN_OUTPUT: bin/tabia
rm -rf bin/ cover.out
go generate ./...
go: downloading github.com/urfave/cli/v2 v2.2.0
go: downloading golang.org/x/oauth2 v0.0.0-20200107190931-bf48bf16ab8d
go: downloading github.com/shurcooL/githubv4 v0.0.0-20200414012201-bbc966b061dd
go: downloading github.com/antonmedv/expr v1.8.8
go: downloading golang.org/x/net v0.0.0-20200602114024-627f9648deb9
go: downloading github.com/shurcooL/graphql v0.0.0-20181231061246-d48a9a75455f
go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.0
go: downloading github.com/russross/blackfriday/v2 v2.0.1
go: downloading github.com/shurcooL/sanitized_anchor_name v1.0.0
lib/github/github.go:32: running "stringer": exec: "stringer": executable file not found in $PATH
make: *** [generate] Error 1

Add the httpRoundtripper implementation to both the bitbucket and github httpclients if --verbose option is given. This way a enduser can debug and see the request.

https://play.golang.org/p/jAKBW46BdPh

https://docs.github.com/en/actions/reference/context-and-expression-syntax-for-github-actions

• Send a thank you message
• Include links and checkboxes for code of conduct and contributions.md

Using the cli it should be possible to fetch 1 or many files from a given repository.

e.g.:

bin/tabia github files --repo philips-labs/tabia --files README.md --files LICENSE