gwern / gwern.net Goto Github PK

Proposition to add pdf/link to the following line in the article Why Tool AIs Want to be Agent AIs:

"While LSTM RNNs are the default for sequence tasks, they have occasionally been beaten by feedforward neural networks—using internal attention or “self-attention”, like the Transformer architecture (eg Vaswani et al 2017 or Al-Rfou et al 2018)"

Add this arxiv doc:
Attention Is All You Need

Is there a feed to the content that is published on the site itself?

There's a feed to substack that hasn't been updated in a while and the substack itself seem to be gone from the web but I can't find any feeds for the site content.

Your website is beyond awesome.
I want to reuse the code of your website to build my own.

Permission #1
Reuse the code as is and attribute to you with a backlink.

Permission #2
Reuse the static part of the website, change the haskell code to python/javascript. Something more extensible by others.
Haskell is awesome of course but not widely used apart from FP enthusiasts (I count myself as one. Though erlang is my choice)

Permission #3
Make the code of "permission #2" public so others can build on top of it. Under a license you prefer me to add to it for reuse.

Do let me know :)

In https://gwern.net/doc/ai/nn/transformer/gpt/5/index#stanley-2023-section, when I click on any image to enlarge it, I see the base64 for the image rather than the image itself. Screenshot:

This is using Chromium on Arch Linux. I see the same behaviour on Firefox and Brave, though. Images on other pages work fine.

Gwern,

While reading the post Why Tool AIs Want to be Agent AIs, I noticed that the original host (Yahoo Groups) for a discussion is no longer hosted as of December 14, 2019.

Here is the link in the article:

...coined by Holden Karnofsky in a July 2011 discussion

I am almost 2 hours deep in your site ad loved every minute .
keep it up < 3

In the article Problem 14, all 7 collapsible blocks with code in them have a fixed height of 100px in them. (This does not affect the first collapsible which is a spreadsheet and not a code block).

<pre class="sourceCode R collapse-content-wrapper" style="height: 100px;">
    <code class="sourceCode r"> ... </code>
</pre>

This makes it hard to read (refer to the image below, only three lines visible), removing the inline style gets rid of this.

Screenshot from Mozilla Firefox 108.0.1 on Arch Linux, also tried in Chromium Version 108.0.5359.124, behaves the same.

I use iPadOS 14.7.1.

Page I’ve encountered issues with: https://gwern.net/Lunar-sleep

Drop Cap

Right Options Menu partially covers content

And doesn’t always work.

A content Text is outside the box it is intended to be in

Navigation is not centered

I’m not sure it’s a bug though, is it intended this way?

This issue is about two bugs:

1. Inline unopened collapsible previews are not visible
2. Inline opened collapsibles are not readable due to an offset

Here's an affected page: https://gwern.net/death-note-script

Search The settings to get to the collapsible in question.

(Note that the screen width should be wide enough such that it displays inline, as this only occurs for inline collapsibles and not regular ones.)

Here's what it looks like, inline and unopened:) [Bug no. 1]

And opened: [Bug no. 2]

And upon inspection (take note of the margin-left: calc(-1019px);):

When not displayed inline (here, in the Appendix), everything looks fine:

Tested on Firefox 123.0 and Chromium 122.0.6261.69 on Arch Linux.

First of all, this is an amazing project you have put together. You’ve taken a simple static site generator and transformed it into a powerful tool for organizing complex written content and rendering it elegantly.

Because of this, I would love to use this as a platform for my own writing. Judging by the number of forks of this project, I believe others would as well.

That being said, would it be possible for a release version or some sort of build support and usage documentation to be provided?

I understand that gwern.net is a bespoke tool and was never intended for this purpose, but it would be amazing if other people could use it.