wabarc / archive.is Goto Github PK
View Code? Open in Web Editor NEWA command-line tool and Go package for wayback web pages to archive.today
License: GNU General Public License v3.0
archive.is's People
Contributors
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
![renovate[bot] avatar](https://avatars.githubusercontent.com/in/2740?v=4 "renovate[bot]")
Stargazers
Watchers
archive.is's Issues
Cookie not working
$ export ARCHIVE_COOKIE=cf_clearance=747c8285c60f3297fb1d52e89228f043a56af6bf-1652837033-TKBSOLBK
$ archive.is https://www.google.com
[2022-05-17T15:40:47] [ERROR] exec: "tor": executable file not found in $PATH
https://www.google.com => archive.today is unavailable.
Dependency Dashboard
This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.
Open
These updates have all been created already. Click a checkbox below to force a retry/rebase of any.
- Update module golang.org/x/net to v0.17.0 [SECURITY]
- Update module github.com/PuerkitoBio/goquery to v1.9.1
- Update step-security/harden-runner action to v2.7.0
- Update actions/upload-artifact action to v4
- Click on this checkbox to rebase all open PRs at once
Ignored or Blocked
These are blocked by an existing closed PR and will not be recreated unless you click a checkbox below.
- Update github.com/wabarc/helper digest to be74403
- Update actions/upload-artifact action to v3.1.3
- Update actions/checkout action to v3.6.0
- Update actions/setup-go action to v4.1.0
- Update actions/checkout action to v4
- Update actions/setup-go action to v5
Detected dependencies
github-actions
.github/workflows/analysis.yml
.github/workflows/linter.yml
.github/workflows/release.yml
.github/workflows/stale.yml
.github/workflows/testing.yml
step-security/harden-runner v2.2.1@1f99358870fe1c846a3ccba386cc2b2246836776actions/setup-go v4.0.0@4d34df0c2316fe8122ab82dc22947d607c0c91f9actions/checkout v3.4.0@24cb9080177205b6e8c946b17badbe402adc938ftor-actions/setup-tor 462b4eef22eecc86cc4abdedafc95a38667e2557tor-actions/setup-tor 462b4eef22eecc86cc4abdedafc95a38667e2557actions/upload-artifact v3.1.2@0b7f8abb1508181956e8e162db84b466c27e18ce
gomod
go.mod
go 1.19github.com/PuerkitoBio/goquery v1.8.1github.com/cretz/bine v0.2.0github.com/wabarc/helper v0.0.0-20230318095659-969de9ddf4b6@969de9ddf4b6github.com/wabarc/logger v0.0.0-20210730133522-86bd3f31e792@86bd3f31e792github.com/wabarc/proxier v0.0.0-20230610135141-b55fe1536465@b55fe1536465golang.org/x/net v0.10.0
- Check this box to trigger a request for Renovate to run again on this repository
Make the documentation more verbose
Hi there,
I've tried to install on Debian 10 but failed. Here is what I tried:
sudo apt install golang-go
go get github.com/wabarc/archive.is
archive.org google.fr
The output:
archive.org: unknown command
Another try:
go archive.org google.fr
go archive.org: unknown command
Run 'go help' for usage.
Do you have any hint? (I'm completely new to Go)
Thank you
Wayback() is causing a crash
Bug Report
Current Behavior
The below code is causing the the program to crash:
package main
import (
"context"
"fmt"
"net/url"
"time"
is "github.com/wabarc/archive.is"
)
func main() {
wbrc := &is.Archiver{}
url, _ := url.Parse(`https://gnu.org`)
ctx, cancel := context.WithTimeout(context.Background(), 2*time.Minute)
defer cancel()
println("Archiving...")
if result, err := wbrc.Wayback(ctx, url); err != nil {
fmt.Printf("ERROR: %v\n", err)
} else {
fmt.Printf("Success: %v\n", result)
}
}The TTY output:
Archiving...
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x5e326e]
goroutine 1 [running]:
net/http.(*Client).deadline(0x40bea7?)
/usr/lib/go-1.21/src/net/http/client.go:194 +0xe
net/http.(*Client).do(0x0, 0xc000182100)
/usr/lib/go-1.21/src/net/http/client.go:608 +0x209
net/http.(*Client).Do(...)
/usr/lib/go-1.21/src/net/http/client.go:590
github.com/wabarc/archive%2eis.(*Archiver).Do(0xc000199ef0, 0xc000182100)
/home/ramon/src/go/pkg/mod/github.com/wabarc/[email protected]/is.go:97 +0x74
github.com/wabarc/archive%2eis.(*Archiver).getSubmitID(0x4?, {0x6e41b5, 0x12})
/home/ramon/src/go/pkg/mod/github.com/wabarc/[email protected]/is.go:213 +0x38b
github.com/wabarc/archive%2eis.(*Archiver).getValidDomain.func1({0x919fa0?, 0x7, 0x0?})
/home/ramon/src/go/pkg/mod/github.com/wabarc/[email protected]/is.go:241 +0x8c
github.com/wabarc/archive%2eis.(*Archiver).getValidDomain(0xc000199ef0, 0xc000199e58)
/home/ramon/src/go/pkg/mod/github.com/wabarc/[email protected]/is.go:252 +0x83
github.com/wabarc/archive%2eis.(*Archiver).archive(0xc000199ef0, {0x75d2b0, 0xc0001920e0}, 0xc000199e58, 0x439114?)
/home/ramon/src/go/pkg/mod/github.com/wabarc/[email protected]/is.go:136 +0x6e
github.com/wabarc/archive%2eis.(*Archiver).Wayback(0x6e199d?, {0x75d2b0?, 0xc0001920e0?}, 0xc0000061a0?)
/home/ramon/src/go/pkg/mod/github.com/wabarc/[email protected]/is.go:113 +0x3b
main.main()
/home/ramon/src/go/src/test/main.go:33 +0xc8
exit status 2Expected behavior/code
The code should not crash.
Environment
- github.com/wabarc/archive.is v1.4.0
- go1.21.1 linux/amd64
- Ubuntu 23.10
Possible Solution
N/A
Additional context/Screenshots
N/A
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.