This is the ArangoDB documentation repository containing all documentation for all versions as published on arangodb.com/docs/.

The documentation uses the static site generator Jekyll.

View the latest successful preview build of the main branch.

To suggest a concrete change to the documentation, you may edit files directly on GitHub. It will fork the repository automatically if necessary. Commit the changes to a new branch, give it a succinct name, and open a pull request (PR).

To add more changes to a PR, click on the branch name below the headline of the PR (the latter link of "<User> wants to merge <n> commits into main from branch-name"). Then locate and edit the next file. Commit the changes directly to your PR branch.

For general suggestions, feel free to create an issue.

In every pull request, there is a number of so-called checks (above the text field for entering a comment). The last entry should be netlify/zealous-morse-14392b/deploy-preview with a Details link. Whenever you push a change to the PR branch, Netlify will build a preview. While it is doing that or if it fails building the docs, then the Details link will get you to the build log. If it succeeded, then it gets you to the hosted preview of that PR. If no checks show up at all, then Netlify is probably busy with another build (or down). The checks should eventually appear, however.

To accept external contributions, we need you to fill out and sign our Contributor License Agreement (CLA). We use an Apache 2 CLA for ArangoDB, which can be found here: https://www.arangodb.com/documents/cla.pdf You can scan and email the CLA PDF file to [email protected] or send it via fax to +49-221-2722999-88.

The following section describes how you can build the documentation locally. This is not strictly necessary when contributing. You can also rely on automatic previews.

Make sure that symlink support is enabled before you clone the repository with Git. It is turned off by default in Git for Windows. Start a terminal as administrator and run:

git config --system core.symlinks true

To work locally on the documentation you can:

• install Jekyll and dependencies
• or use the Docker container arangodb/arangodb-docs

Docker is generally easier, but may also be slower (at least under Windows).

Note that the Algolia plugin has a dependency which does not support Ruby 2.6+.

If you want to build the docs the first time, run bundle install to ensure that all dependencies (gems / plugins) are installed.

For local development, start Jekyll in watch mode:

bundle exec jekyll serve

This will build the documentation, rebuild it if you change files, and serve the documentation site locally using Jekyll's built-in web server.

You can then browse the docs in a browser at http://127.0.0.1:4000/docs/stable/. Note that it has to be /docs/stable/ (or another version than stable). Both paths / and /docs do not work (404 Page not found) because of the configured baseurl in _config.yml, and /docs/ redirects you to the online version of the documentation.

To let Jekyll build the static site without serving it or watching for file changes, use:

bundle exec jekyll build

The generated content will be stored in the _site/docs/ folder.

To serve the content from a previous build without watching for changes, use:

bundle exec jekyll serve --skip-initial-build --no-watch

In the docs directory, execute:

docker run --rm -v $(pwd):/docs -p 4000:4000 arangodb/arangodb-docs

This will watch for file changes and you will be able to see the resulting static site on http://127.0.0.1:4000/docs/stable/.

Note that Jekyll's --incremental build option is enabled. In addition, DocuBlocks are parsed once per invocation and then cached in memory. If you encounter stale content, then stop the container and run:

docker run --rm -v $(pwd):/docs -p 4000:4000 arangodb/arangodb-docs bundler exec jekyll serve -H 0.0.0.0 --trace

Alternatively, you may stop the container, execute either of the following commands, and run the normal Docker command again (without additional arguments).

• rm -rf .jekyll-cache/ .jekyll-metadata _site/
• docker run --rm -v $(pwd):/docs arangodb/arangodb-docs bundler exec jekyll clean

To build the documentation without watch mode or serving the resulting site, you can execute:

docker run --rm -v $(pwd):/docs arangodb/arangodb-docs bundler exec jekyll build --trace

After that the HTML files in _site/ are ready to be served by a webserver:

cd _site
python3 -m http.server

To check for broken references (e.g. internal links), you can run htmltest:

docker run --rm -v $(pwd):/docs arangodb/arangodb-docs htmltest

A full build (all versions) will take quite a while. You can use Jekyll's watch mode to let it continuously rebuild the pages you change after an initial build. For simple documentation changes this process normally works perfect.

However there are cases where Jekyll won't detect changes. This is especially true when changing plugins and configuration (including the navigation YAML when adding a new page). To be sure you have an up-to-date version remove the _site directory and then abort and restart the watch mode.

To speed up the build process you may disable certain versions from being built by changing the _config.yml:

exclude:
# - 3.12/
# - 3.11/
# - 3.10/
  - 3.9/
  - 3.8/

Above example disables versions 3.8 and 3.9, so that only 3.10 through 3.12 are built. Do not commit these changes of the configuration!

Note that building may fail if you disable certain versions that contain the files that other versions refer to with symlinks, or required versions as defined in _config.yml:

versions:
  stable: "3.8"
  devel: "3.9"

In the root directory, the directories 3.8, 3.9 etc. represent the individual ArangoDB versions and their documentation. We only maintain one version of the documentation for every minor and major version (3.9, 4.0, etc.) but not for every patch release (e.g. 3.8.2).

The content for different documentation versions used to be in version branches (2.7, devel, etc.) in the arangodb/arangodb repository, but now all documentation versions live in the main branch of this repository. This has the advantage that all versions can be built at once, but the drawback of Git cherry-picking not being available and therefore requiring to manually apply changes to different versions as necessary (copy-pasting text or files).

The documentation is split into different parts, called "books" for historical reasons. The core book (Manual) of a version does not have an own folder for its content, but the files are found in the version directory, e.g. 3.8/*.md. Other books (AQL, HTTP) have subfolders in the version folder, e.g. 3.8/aql/.

There are also books (Drivers, ArangoGraph) that are not directly couple to ArangoDB versions, that have their files in an own folders in the root directory, e.g. arangograph/*.md. These folders are symlinked in multiple version folders. Some files, like release notes, are also symlinked to reduce maintenance costs.

The organization of documents is flat, namely there are no subdirectories per book (as opposed to the previous documentation system). For example, all files of the AQL part are in the aql/ folder. It does not have any subfolders like aql/examples/. Instead, the file name reflects which files belong together, e.g. aql/examples-counting.md.

Content folders aside, there are the following other directories:

The documentation is written in the light-weight markup language Markdown. There are different flavors of Markdown and it is further extended by Liquid, Jekyll's templating language, as well as our own customization.

Below is a list of the most commonly used markup, and an approximation of how it gets rendered:

Element	Markdown	Preview	HTML
Text line	A single line of text	A single line of text	A single line of text
Paragraph	A single paragraph. Another paragraph.	A single paragraph. Another paragraph.	<p>A single paragraph.</p> <p>Another paragraph.</p>
Heading 1	# Level 1	Level 1	<h1>Level 1</h1>
Heading 1 (Variant)	Level 1 =======	Level 1	<h1>Level 1</h1>
Headling 2	## Level 2	Level 2	<h2>Level 2</h2>
Headling 2 (Variant)	Level 2 -------	Level 2	<h2>Level 2</h2>
Headling 3	### Level 3	Level 3	<h3>Level 3</h3>
Headling 4	#### Level 4	Level 4	<h4>Level 4</h4>
Headling 5	##### Level 5	Level 5	<h5>Level 5</h5>
Headling 6	###### Level 6	Level 6	<h6>Level 6</h6>
Italic	*italic*	italic	<em>italic</em>
Italic	_italic_	italic	<em>italic</em>
Bold	**bold**	bold	<strong>bold</strong>
Bold	__bold__	bold	<strong>bold</strong>
Bold & Italic	***bold & italic***	bold & italic	<strong><em>bold & italic</em></strong>
Bold & Italic	___bold & italic__	bold & italic	<strong><em>bold & italic</em></strong>
Superscript	2<sup>32</sup>	232	2<sup>32</sup>
Subscript	2<sub>32</sub>	H2O	H<sub>2</sub>O
Blockquote	> quote	quote	<blockquote>quote</blockquote>
Ordered List	1. First 2. Second 3. Third	First Second Third	<ol> <li>First</li> <li>Second</li> <li>Third</li> </ol>
Unordered List	- First - Second - Third	First Second Third	<ul> <li>First</li> <li>Second</li> <li>Third</li> </ul>
Unordered List	* First * Second * Third	First Second Third	<ul> <li>First</li> <li>Second</li> <li>Third</li> </ul>
Inline Code	`code value`	code value	<code>code value</code>
Fenced Code	```js new Date(); // JavaScript ```	new Date(); // JavaScript	<pre><code>new Date(); // JavaScript</code></pre>
Code Block	shell> pwd /home/alice	shell> pwd /home/alice	<pre><code>shell&gt; pwd /home/alice</code></pre>
Horizontal Rule	---		<hr />
Link (Internal)	[label](book/file.html)	label	<a href="book/file.html">label</a>
Link (Anchor)	[label](#element-id)	label	<a href="#element-id">label</a>
Link (External)	[label](https://www.arangodb.com/){:target="_blank"}	label	<a href="https://www.arangodb.com" target="_blank">label</a>
Link (External)	<https://www.arangodb.com/>{:target="_blank"}	https://www.arangodb.com/	<a href="https://www.arangodb.com" target="_blank">https://www.arangodb.com/</a>
Image			<img src="assets/arangodb_logo_small_2016.png" alt="ArangoDB Logo">
Table	| A | B | C | |----|----|----| | A1 | B1 | C1 | | A2 | B2 | C2 |	A B C A1 B1 C1 A2 B2 C2	<table> <thead> <tr> <th>A</th> <th>B</th> <th>C</th> </tr> </thead> <tbody> <tr> <td>A1</td> <td>B1</td> <td>C1</td> </tr> <tr> <td>A2</td> <td>B2</td> <td>C2</td> </tr> </tbody> </table>
Frontmatter	--- layout: default description: Page about X title: Feature X ---		<title>Feature X | ArangoDB Documentation</title> <meta itemprop="description" name="description" content="Page about X" />
Danger	{% hint 'danger' %} Unrecoverable fault {% endhint %}	❌ Unrecoverable fault	<div class="alert alert-danger" …> Unrecoverable fault </div>
Warning	{% hint 'warning' %} Common pitfall {% endhint %}	⚠ Common pitfall	<div class="alert alert-warning" …> Common pitfall </div>
Security	{% hint 'security' %} Security warning {% endhint %}	🛡 Security warning	<div class="alert alert-warning" …> Security warning </div>
Info	{% hint 'info' %} Informative note {% endhint %}	ℹ Informative note	<div class="alert alert-info" …> Informative note </div>
Tip	{% hint 'tip' %} Useful hint {% endhint %}	✔ Useful hint	<div class="alert alert-success" …> Useful hint </div>
Include	{% include hint-ee-arangograph.md feature="SmartGraphs" plural=true %}	ℹ SmartGraphs are only available in the Enterprise Edition, including the ArangoGraph Insights Platform.	<div class="alert alert-info" …> SmartGraphs are only available in the <a href="https://www.arangodb.com/enterprise-server/" target="_blank">Enterprise Edition</a>, including the <a href="https://cloud.arangodb.com/home" target="_blank">ArangoGraph Insights Platform</a>. </div>
Version (full)	{{ site.data.versions[page.version.name] }}	v3.9.0-devel	v3.9.0-devel
Version (major.minor)	{{ page.version.version }}	3.9	3.9
Version Condition	{%- assign ver = "3.8" | version: ">=" %} {%- if ver %} Current version is greater than 3.8 {%- else %} Current version is less than or equal to 3.8 {%- endif %}	Current version is greater than 3.8	Current version is greater than 3.8
Version Remark	<small>Introduced in: v3.8.2</small>	Introduced in: v3.8.2	<small>Introduced in: v3.8.2</small>

• Use American English spelling, e.g. behavior instead of behaviour.

• Use inclusive language, e.g. work-hours instead of man-hours.

• Get to point quickly on every page. Add a Lead Paragraph that summarizes what the page is about.

• Target end-users and focus on the outcome. It should be about solutions, not features.

• Do not use jargon or technical abbreviations in headlines or the navigation. Define the meaning if you use it in the content.

• Do not add too many hint boxes or everything ends up being a highlight.

• Wrap text at 80 characters where possible. This helps tremendously in version control. Pre-wrap lines if necessary.

• Put Markdown links on a single line [link label](target.html#hash), even if it violates the guideline of 80 characters per line.

• Avoid breaking lines of code blocks and where Markdown does not allow line breaks, e.g. in Markdown table rows (you can use <br> if really necessary).

• Avoid using here as link label. Describe what the link points to instead.

• Avoid overly long link labels, such as entire sentences.

• Use relative links for cross-references to other documentation pages, e.g. ../drivers/js.html instead of /docs/stable/drivers/js.html or https://www.arangodb.com/docs/stable/drivers/js.html.

• Append {:target="_blank"} to Markdown links which point to external sites, e.g. [external link](https://www.github.com/){:target="_blank"}.

• Avoid **bold** and _italic_ markup in headlines. Inline `code` is acceptable for code values, nonetheless.

• - is preferred for bullet points in unordered lists over *

• Use # and ## for level 1 and 2 headlines for new content over === and --- underlines.

• There should be a blank line above and below fenced code blocks and headlines (except if it is at the top of the document, right after the end of the frontmatter ---).

• Use aql as language in fenced code blocks for highlighting AQL queries in version 3.10 and later. Use js for 3.9 and older.

  FOR i IN 1..3 RETURN CONCAT("a", i)
  

• Use all lowercase languages in fenced code blocks without whitespace before or after the language, and use the following languages in favor of the ones in parentheses for consistency:

  • ```py (instead of ```python)
  • ```yaml (instead of ```yml)
  • ```sh (instead of ```shell)
  • ```js (instead of ```javascript)
  • ``` (instead of ```plain or ```text)

• Use the exact spelling of Enterprise Edition and its features, as well as for all other terms coined by ArangoDB:

  • EnterpriseGraphs
  • SmartGraphs, Disjoint SmartGraphs
  • SmartGraphs using SatelliteCollection, not Hybrid SmartGraphs
  • SmartJoins
  • OneShard
  • Community Edition
  • Enterprise Edition
  • DB-Server, not dbserver, db-server, DBserver (unless it is a code value)
  • Coordinator (uppercase C)
  • Agent, Agency (uppercase A)
  • Active Failover
  • Datacenter-to-Datacenter Replication (note the hyphens), DC2DC
  • ArangoGraph Insights Platform and ArangoGraph for short, but not Oasis, ArangoDB Oasis, or ArangoDB Cloud

• Do not capitalize the names of executables or code values, e.g. write arangosh instead of Arangosh.

• Do not write TODOs right into the content. Use an HTML comment <!-- An HTML comment --> if it is okay that the comment will be visible in the page source of the generated files. Otherwise use {% comment %}...{% endcomment %}.

The official way to cross-reference other pages within the documentation would be to use Jekyll's link tag ({% link path/to/file.md %}). This mechanism is not used, however. We use plain Markdown links, but this has the drawback of having to change the file extension from .md to .html so that it will work once the documentation is built.

This is an [internal link](aql/functions-numeric.html#max).

Note that internal links should be relative, i.e. not include a version number, unless it is supposed to point to a different version of the documentation on purpose. To point from one book to another, you may need to use .. to refer to the parent folder of a file.

You can also link to headlines within a page like [label](#anchor-id). The anchor ID is the headline text but with the characters converted to Latin base characters, all lower-case, spaces and other special characters replaced by hyphens -. Underscores remain, however. Some examples:

For external links, please add {:target="_blank"} so that they open in a new tab when clicked:

This is an [external link](https://www.arangodb.com/){:target="_blank"}

The main page about a new feature should indicate the version the feature was added in, as shown below:

---
layout: default
description: >-
  Feature summary
---
# New feature

<small>Introduced in: v3.10.0</small>

{{ page.description }}
{:class="lead"}

...

Similarly, the remark should be added if only a section is added to an existing page, as shown below:

# Existing feature

...

## New feature section

<small>Introduced in: v3.10.0</small>

...

The value v3.10.0 implies that all later versions also have this feature (3.10.1, 3.10.2, etc., as well as 3.11.0 and later). If this is not the case, then also mention the other relevant versions. For example, if a feature is added to 3.9.6 and 3.10.2, then write the following in the 3.10 documentation:

<small>Introduced in: v3.9.6, v3.10.2</small>

All later documentation versions should use a copy of the content, as thus the 3.11 documentation would contain the same.

In the 3.9 documentation, only mention versions up to this documentation version (excluding 3.10 and later in this example), pretending no later version exists to be consistent with the rest of the 3.9 documentation and to avoid additional maintenance burdens:

<small>Introduced in: v3.9.6</small>

New options in the JavaScript and HTTP APIs are covered by the release notes, but if new options are added mid-release (not in the x.x.0 release but a later bugfix version), then this should be pointed out as follows:

- `existingOption` (number, _optional_): ...
- `newOption` (string, _optional_): ... (introduced in v3.9.6, v3.10.2).

You may also add a remark if an existing feature or option is significantly extended by a new (sub-)option in a x.x.0 release.

Pages and sections about Enterprise Edition features should indicate that the Enterprise Edition is required using a hint box. Use the following include in the general case:

{% include hint-ee-arangograph.md feature="New feature X" %}

This should be placed after version remarks if there are any.

Most Enterprise Edition features are also available in ArangoGraph, but some features are not or in a different form (e.g. DC2DC, Hot Backup). If a feature is not available in ArangoGraph, use the following include instead:

{% include hint-ee.md feature="New feature X" %}

If the feature name is a plural form of a word, set the plural option to true (this works with both includes):

{% include hint-ee-arangograph.md feature="EnterpriseGraphs" plural=true %}

In the release notes, add the following at the end of a section about a new Enterprise Edition feature:

This feature is only available in the Enterprise Edition.

API options that are only available in the Enterprise Edition should have a remark as follows:

- `enterpriseOption` (boolean, _optional_): ...
  (Enterprise Edition only).

If there are both a version remark and an Enterprise Edition remark, use:

- `enterpriseOption` (boolean, _optional_): ...
  (introduced in v3.9.6 and v3.10.2, Enterprise Edition only).

A lead paragraph is the opening paragraph of a written work that summarizes its main ideas. Only few pages have one so far, but new content should be written with such a brief description. It is supposed to clarify the scope of the article so that the reader can quickly assess whether the following information is of relevance, but also acts as an introduction.

# Using Feature X

You can do this and that with X, and it is ideal to solve problem Y
{:class="lead"}

The lead paragraph needs to be placed between the top-level headline and the first content paragraph. It should end without a period, contain no links and usually avoid other markup as well (bold, italic). This also enables the use of the lead paragraph as metadata for the page:

---
layout: default
description: >-
  You can do this and that with X, and it is ideal to solve problem Y
title: Feature X
---
# Using Feature X

{{ page.description }}
{:class="lead"}

The generated metadata looks like this:

<meta property="og:title" content="Feature X | ArangoDB Documentation" />
<meta property="og:description" content="You can do this and that with X, and it is ideal to solve problem Y" />

Start off by finding a file name. It should be:

• All lower-case
• Use hyphen-minus - instead of spaces
• Be very short but descriptive
• Follow the patterns of existing files

Note that the file name is independent of what will show in the navigation or what will be used as headline for that page. The file name will be used as part of the final URL, however. For example, 3.8/aql/examples.md will become http://www.arangodb.com/docs/3.8/aql/examples.html.

Create a new file with the file name and a .md file extension. Open the file in a text editor (Visual Studio Code is recommended). Add the following frontmatter:

---
layout: default
description: A meaningful description of the page
title: Short title
---

Add the actual content formatted in Markdown syntax below the frontmatter.

Then add the page to the navigation. Each book has a navigation tree represented as a nested data structure in YAML syntax. The NavigationTag plugin creates the navigation on the left-hand side from it. The YAML file for a book can be found here: _data/<version>-<book>.yml.

Open the respective navigation definition file, e.g. _data/3.8-aql.yml if the page should be added to the AQL book of version 3.8. Let us assume the file is aql/operations-create.md and the page is supposed to show above the FOR language construct in the navigation. Locate where that other page is added and insert a new pair of lines for the new page:

 - text: High level Operations
   href: operations.html
   children:
+    - text: CREATE
+      href: operations-create.html
     - text: FOR
       href: operations-for.html

text will be used as label in the navigation. href is the name of the file, relative to the current book. Note that the file extension needs to be .html, not .md!

The URL of a page is derived from the file name. If you rename a file, e.g. from old-name.md to new-name.md, make sure to add a redirect for the old URL by adding the following to the frontmatter:

 ---
 layout: default
 description: ...
 title: ...
 ---
+redirect_from:
+  - old-name.html # 3.8 -> 3.9

The URL should be relative and the comment (#) indicate the versions it was renamed in (can also be the same version twice, e.g. # 3.8 -> 3.8).

Headlines are assigned automatically generated identifiers based on their text. In some cases you may want to set an ID explicitly:

### A headline {: #custom-id }

The table of contents (ToC) on the right-hand side at the top of a page lists the headlines if there at least three on the page. It can be disabled for individual pages with the following frontmatter:

---
layout: default
page-toc:
  disable: true
---

It can also be restricted to a maximum headline level to omit the deeper nested headlines for less clutter:

---
layout: default
page-toc:
  max-headline-level: 3
---

A setting of 3 means that <h1>, <h2>, and <h3> headlines will be listed in the ToC, whereas <h4>, <h5>, and <h6> will be ignored.

The version number schema is vMajor.Minor.Patch, e.g. v3.9.5. Patch releases contain bugfixes only. Minor releases often add new features and come with some breaking changes. Major releases add new features and may contain substantial breaking changes.

Non-stable versions can have a suffix. The devel version usually ends with -devel, e.g. v3.9.0-devel. Preview releases can also have suffixes like -alpha.1, -beta.2, -rc.3.

When a new patch release is published, the respective version number in _data/versions.yml is incremented by the release automation:

-"3.8": "v3.8.1"
+"3.8": "v3.8.2"

The examples should be re-generated to ensure that they match the actual server behavior of the new version.

When a new major or minor version is released to the public, the new stable version needs to be made the default version for the documentation. It will be available under the stable alias at https://www.arangodb.com/docs/stable/. At the same time, the in-development version needs to be updated as well. It will be available under the devel alias at https://www.arangodb.com/docs/devel/.

The stable and devel versions can be adjusted in the _config.yml under the versions key:

 versions:
-  stable: "3.8"
-  devel: "3.9"
+  stable: "3.9"
+  devel: "3.10"

Also update the version number in the _redirects file to the latest stable version, so that Netlify previews default to this version:

-/              /docs/3.8/
+/              /docs/3.9/

Update the list of files to exclude to let Algolia index the new stable version:

 algolia:
   ...
   files_to_exclude:
     - 3.10/**/*
-    - 3.9/**/*
-#   - 3.8/**/*  # OUR STABLE VERSION
+#   - 3.9/**/*  # OUR STABLE VERSION
+    - 3.8/**/*
     - 3.7/**/*
     - ...

Do not forget to re-generate the examples before publishing.

When an ArangoDB version reaches End-of-Life, its documentation needs to be marked as such. The respective version needs to be added to the _data/deprecations.yml file for that:

 - "3.5"
 - "3.6"
+- "3.7"

It makes a warning show at the top of every page for that version.

• Run below commands in Bash. If you use Git Bash on Windows, it will dereference symlinks by default (copies the referenced files)! To avoid that, start Git Bash as administrator and run export MSYS=winsymlinks:nativestrict before you continue.
• Copy the latest devel version to a new directory i.e. cp -a 3.9 4.0
• Create the necessary navigation definition files in _data by copying, e.g.

  cd _data
  for book in aql drivers http manual arangograph; do
    cp -a "3.9-${book}.yml" "4.0-${book}.yml"
  done
  cd ..

• Create relative symlinks to program option JSON files and the metrics YAML file in _data, like

  cd _data
  for prog in backup bench d dump export import inspect restore sh vpack; do
    ln -s "../4.0/generated/arango${prog}-options.json" "4.0-program-options-arango${prog}.json"
  done
  ln -s "../4.0/generated/allMetrics.yaml" "4.0-allMetrics.yaml"
  cd ..

• Adjust the version numbers in redirect_from URLs in the frontmatter to match the new version folder, e.g.

   redirect_from:
  -  - /3.9/path/to/file.html # 3.6 -> 3.7
  +  - /4.0/path/to/file.html # 3.6 -> 3.7

  This is only necessary for absolute redirects. Relative redirects are preferred, e.g. - old.html in new.html (may also include ..). If pages were removed, then you may want to use absolute redirects to point to older versions or redirect to completely different pages.
• Create release note pages for the new version (here: 4.0 / 40) and add them to the navigation (4.0-manual.yml):

   - text: Release Notes
     href: release-notes.html
     children:
  +    - text: Version 4.0
  +      href: release-notes-40.html
  +      children:
  +        - text: What's New in 4.0
  +          href: release-notes-new-features40.html
  +        - text: Known Issues in 4.0
  +          href: release-notes-known-issues40.html
  +        - text: Incompatible changes in 4.0
  +          href: release-notes-upgrading-changes40.html
  +        - text: API changes in 4.0
  +          href: release-notes-api-changes40.html

• Add the relevant links to the release notes overview page 4.0/release-notes.html
• Delete the release note pages of the previous version (here: 3.9) in the folder of the new version (here: 4.0) and symlink the files instead:

  cd 4.0
  rm release-notes-39.md
  rm release-notes-new-features39.md
  rm release-notes-known-issues39.md
  rm release-notes-upgrading-changes39.md
  rm release-notes-api-changes39.md
  ln -s ../3.9/release-notes-39.md release-notes-39.md
  ln -s ../3.9/release-notes-new-features39.md release-notes-new-features39.md
  ln -s ../3.9/release-notes-known-issues39.md release-notes-known-issues39.md
  ln -s ../3.9/release-notes-upgrading-changes39.md release-notes-upgrading-changes39.md
  ln -s ../3.9/release-notes-api-changes39.md release-notes-api-changes39.md
  cd ..

• Check if any links to version-specific pages such as the release notes need to be updated, e.g.

  -See [Known Issues](release-notes-known-issues39.html).
  +See [Known Issues](release-notes-known-issues40.html).

• Add a section Version 4.0 to 4.0/highlights.html including a link to What's New in 4.0
• Add the version to _data/versions.yml with the full version name
• Add all books of that version to _data/books.yml
• Add entries for the new version in _config.yml to the algolia and exclude keys:

   algolia:
     files_to_exclude:
  +    - 4.0/**/*
       - 3.9/**/*

   exclude:
     - ...
  +  - 4.0/generated
     - 3.9/generated
     - ...
  +# - 4.0/
   # - 3.9/

A complete example with the preferred indentation:

    {% arangoshexample examplevar="examplevar" script="script" result="result" %}
    @startDocuBlockInline ensureUniquePersistentSingle
    @EXAMPLE_ARANGOSH_OUTPUT{ensureUniquePersistentSingle}
    ~ db._create("ids");
      db.ids.ensureIndex({ type: "persistent", fields: [ "myId" ], unique: true });
      db.ids.save({ "myId": 123 });
    | db.ids.save({ 
    |   "myId": 123
      }); // xpError(ERROR_ARANGO_UNIQUE_CONSTRAINT_VIOLATED)
    ~ db._drop("ids");
    @END_EXAMPLE_ARANGOSH_OUTPUT
    @endDocuBlock ensureUniquePersistentSingle
    {% endarangoshexample %}
    {% include arangoshexample.html id=examplevar script=script result=result %}

Jekyll requires the example code to be encapsulated by an arangoshexample block, followed by an include tag to embed the example:

{% arangoshexample examplevar="examplevar" script="script" result="result" %}
...
{% endarangoshexample %}
{% include arangoshexample.html id=examplevar script=script result=result %}

Inside the block, two more wrappers are needed. The outer one marks the beginning and end of a so-called DocuBlock and gives it a unique name that will be used as file name for the example transcript (e.g. 3.9/generated/Examples/name_of_docublock.generated). The inner one indicates that it is an arangosh example and not a curl example and repeats the DocuBlock name:

@startDocuBlockInline name_of_docublock
@EXAMPLE_ARANGOSH_OUTPUT{name_of_docublock}
...
@END_EXAMPLE_ARANGOSH_OUTPUT
@endDocuBlock name_of_docublock

Groups of examples should have the same name prefix. If an example needs to be run against an ArangoDB cluster instead of a single server (default), then give the name a suffix of _cluster.

Inside the wrappers, you can write the JavaScript code for arangosh:

db._create("collection");
db.collection.save({ _key: "foo", value: 123 });
db._query(`FOR doc IN collection RETURN doc.value`).toArray();
db._drop("collection");

Each statement needs to be either on a single line, or indicate that line continuation is required for statements spanning multiple lines. A leading pipe character | is required for all lines except the last line of a multi-line statement:

  db._create("collection");
| db.collection.save([
|   { multiple: true },
|   { lines: true }
  ]);
| for (var i = 0; i < 3; i++) {
|   db.collection.save({ _key: "k" + i });
  }
  db._drop("collection");

The statements as well as the results will be visible in the example transcript. To hide certain statements from the output, e.g. for setup/teardown that is not relevant for the example, you can use a leading tilde ~ to suppress individual lines:

~ db._create("collection");
  db.collection.save({ _key: "foo" });
~ db._drop("collection");

Examples need to remove the collections and Views they create. Not dropping them will raise an error unless they are specifically exempt:

~ db._create("collection");
~ db._createView("view", "arangosearch", {...});
  db.collection.save({...});
~ addIgnoreView("view");
~ addIgnoreCollection("collection");

This is helpful for creating collections and Views once, using them in multiple examples, and finally dropping them instead of having to create and drop them in each example. You need to choose the names for the DocuBlocks so that they are alphabetically sortable to have them execute in the correct order. The last example of the series should undo the ignore to catch unintended leftovers:

~ removeIgnoreCollection("collection");
~ removeIgnoreView("view");
~ db._dropView("view");
~ db._drop("collection");

If a statement is expected to fail (e.g. to demonstrate the error case), then this has to be indicated with a special JavaScript comment:

db._document("collection/does_not_exist"); // xpError(ERROR_ARANGO_DOCUMENT_NOT_FOUND)

This will make the example generation continue despite the error. See Error codes and meanings for a list of all error codes and their names. If a unexpected error is raised, then the example generation will abort with an error.

If you want to wrap the special comment to a new line but suppress and empty line in the output, you can use | on the first and ~ on the second line:

| db._document("collection/does_not_exist");
~ // xpError(ERROR_ARANGO_DOCUMENT_NOT_FOUND)

Every backslash in a query needs to be escaped with another backslash, i.e. JSON escape sequences require two backslashes, and literal backslashes four:

db._query(`RETURN REGEX_SPLIT("foo\\t bar\\r baz\\n foob", "\\\\s+|(?:b\\\\b)")`).toArray();

This does not apply to backslashes in bind variables:

db._query(`RETURN REGEX_SPLIT(@t, @r)`, {t: "foo\t bar\r baz\n foob", r: "\\s+|(?:b\\b)"}).toArray();

Complete example with the preferred indentation:

    {% aqlexample examplevar="examplevar" type="type" query="query" bind="bind" result="result" %}
    @startDocuBlockInline joinTuples
    @EXAMPLE_AQL{joinTuples}
    @DATASET{joinSampleDataset}
    @EXPLAIN{TRUE}
    FOR u IN users
      FILTER u.active == true
      LIMIT 0, 4
      FOR f IN relations
        FILTER f.type == @friend && f.friendOf == u.userId
        RETURN {
          "user" : u.name,
          "friendId" : f.thisUser
        }
    @BV {
      friend: "friend"
    }
    @END_EXAMPLE_AQL
    @endDocuBlock joinTuples
    {% endaqlexample %}
    {% include aqlexample.html id=examplevar type=type query=query bind=bind result=result %}

Similar to arangosh examples, several wrappers are required. The aqlexample block encapsulates the example for Jekyll, and the include tag embeds it:

{% aqlexample examplevar="examplevar" type="type" query="query" bind="bind" result="result" %}
...
{% endaqlexample %}
{% include aqlexample.html id=examplevar type=type query=query bind=bind result=result %}

Inside the block, there is a DocuBlock wrapper and a wrapper to indicate that this is an AQL example:

@startDocuBlockInline name_of_docublock
@EXAMPLE_AQL{name_of_docublock}
...
@END_EXAMPLE_AQL
@endDocuBlock name_of_docublock

The example can optionally specify a dataset that will be loaded before the query is run:

@DATASET{name_of_dataset}

See https://github.com/arangodb/arangodb/blob/devel/js/common/modules/@arangodb/examples/examples.js for the available datasets.

To get the query explain output including the execution plan instead of the actual query result, you can optionally specify:

@EXPLAIN{TRUE}

Then the actual AQL query follows, e.g.

FOR i IN 1..3
  RETURN i

The query can optionally use bind parameters that can be passed like this:

FOR elem IN @arr
  RETURN elem
@BV {
  arr: ["foo", "bar"]
}

DocuBlocks define reusable pieces of content but the DocuBlocks system is mainly used for describing the HTTP API by now. It is also used for arangosh and AQL examples, using inline DocuBlocks (see above).

To embed a DocuBlock in the documentation, use the docublock tag in a Markdown file:

{% docublock name %}

The source files for DocuBlocks that describe and demonstrate the HTTP API are located in the main repository at Documentation/DocuBlocks/Rest/: https://github.com/arangodb/arangodb/tree/devel/Documentation/DocuBlocks/Rest They are written in a proprietary text format that can be converted to Swagger 2.0 definitions as well as rendered by the documentation tooling.

A complete example of such a DocuBlock:

@startDocuBlock post_api_foo
@brief creates a foo

@RESTHEADER{POST /_api/foo/{param}, Create foo, createFoo}

@HINTS
{% hint 'warning' %}
Text to be displayed in a callout box.
{% endhint %}

@RESTDESCRIPTION
Detailed description of the endpoint.

@RESTURLPARAMETERS

@RESTURLPARAM{param,string,required}
Dynamic piece of the URL path, signified by curly {braces} in the @RESTHEADER route.

@RESTQUERYPARAMETERS

@RESTQUERYPARAM{creationOption,boolean,optional}
One-off setting that is not persisted unlike e.g. collection properties.

@RESTHEADERPARAMETERS

@RESTHEADERPARAM{If-Match,string,optional}
An HTTP header field that you can set.

@RESTBODYPARAM{name,string,required,string}
Primitive body parameter that is of type string and mandatory.

@RESTBODYPARAM{fooOptions,object,optional,post_api_foo_opts}
Complex body parameter with key `fooOptions` and an object as value.
The object is described by @RESTSTRUCTs that reference `post_api_foo_opts`.

@RESTSTRUCT{type,post_api_foo_opts,integer,required,int64}
A nested parameter with parent `fooOptions`, key `type`, and expecting an integer as value.

@RESTRETURNCODES

@RESTRETURNCODE{200}
HTTP status code returned if the request was successful.

@RESTREPLYBODY{error,boolean,required,}
`false` in this case

@RESTRETURNCODE{400}
HTTP status code returned if the request failed.

@RESTREPLYBODY{error,boolean,required,}
`true` in this case

@EXAMPLES

@EXAMPLE_ARANGOSH_RUN{RestFooCreate}
    var url = "/_api/foo/example?creationOption=true";
    var body = {
      name: "testFoo",
      fooOptions: {
        type: 123
      }
    };

    var response = logCurlRequest('POST', url, body);
    assert(response.code === 200);
    logJsonResponse(response);
@END_EXAMPLE_ARANGOSH_RUN

@endDocuBlock

Every DocuBlock starts with @startDocuBlock followed by a name, and ends with @endDocuBlock.

@startDocuBlock post_api_foo
...
@endDocuBlock

There is typically just one DocuBlock in a file but a single file can contain multiple DocuBlocks.

The naming convention is to use snake_case and the pattern method_path, e.g. post_api_collection for the POST /_api/collection endpoint. The DocuBlock name is often used as file name, too, but it can deviate. The file extension is .md as the content is Markdown-formatted text (DocuBlock markup aside).

The first structural element in a DocuBlock should be @brief, followed by a summary of what the endpoint does:

@brief creates a foo

The next element should be the @RESTHEADER:

@RESTHEADER{VERB /url/{param}, Description, operationId}

• VERB: An HTTP method, one of: GET, POST, PATCH, PUT, DELETE, HEAD
• /url…: URL path of the endpoint. Should start with a /. May contain placeholders in curly braces for URL parameters (here: {param}) that need to be described in a subsequent @RESTURLPARAMETERS section by a @RESTURLPARAM element.
• Description: A short description of what the endpoint is for. More or less the same as @brief.
• operationId: A string that identifies this endpoint. Needs to be unique across all endpoint descriptions. It defaults to a de-spaced Description. It should not be changed anymore.

There can optionally be a @HINTS element with one or more hint blocks:

@HINTS
{% hint 'type' %}
Remarks to highlight.
{% endhint %}

• type: One of tip, info, warning, security, danger

If @RESTHEADER contains at least one {placeholder} for URL parameters, then a @RESTURLPARAMETERS section with @RESTURLPARAM elements for every placeholder is required:

@RESTURLPARAMETERS

@RESTURLPARAM{param,type,necessity}
Description.

@RESTURLPARAM...

• param: Name of the URL parameter. Needs to match the placeholder in @RESTHEADER.
• type: Swagger type (should always be string)
• necessity: needs to be required. optional is not supported anymore. Create a second DocuBlock without the parameter if necessary.

If an endpoint supports query parameters (like ?param1=aaa&param2=bbb after the URL path), then a @RESTQUERYPARAMETERS section with @RESTQUERYPARAM elements for every query parameter is needed:

@RESTQUERYPARAMETERS

@RESTQUERYPARAM{name,type,necessity}
Description.

@RESTQUERYPARAM...

• param: Name of the query parameter.
• type: Swagger type (typically string or boolean)
• necessity: either required or optional

If an endpoint supports options that can be set in the HTTP header, then a @RESTHEADERPARAMETERS section with @RESTHEADERPARAM elements for every header field is needed:

@RESTHEADERPARAMETERS

@RESTHEADERPARAM{Field,type,necessity}
Description.

@RESTHEADERPARAM...

• Field: Name of the HTTP header field.
• type: Swagger type (should always be string)
• necessity: either required or optional

To describe the request payload, use @RESTBODYPARAM elements. Note that there is no @RESTBODYPARAMETERS section:

@RESTBODYPARAM{name,type,necessity,subtype}
Description.

@RESTBODYPARAM...

• name: The name of the body parameter.
• type: Swagger type (typically string, boolean, integer, number), array, or object
• necessity: either required or optional
• subtype: can be a Swagger format, reference a @RESTSTRUCT by name (if type is object or array), or be empty.

Example of a body parameter that expects an array of strings:

@RESTBODYPARAM{fields,array,required,string}

Example of a body parameter that expects an array of objects without further description of these objects:

@RESTBODYPARAM{primarySort,array,optional,object}

Example of a body parameter that expects an array of objects. Each object needs to have a username key with a string value, and can optionally have an active key with a boolean value:

@RESTBODYPARAM{users,array,optional,user_object}

@RESTSTRUCT{username,user_object,string,required,}
Login name of an existing user or one to be created.

@RESTSTRUCT{active,user_object,boolean,optional,}
Whether the account should be activated or not. Defaults to `true`.

Note that you can reference @RESTSTRUCTs that are defined in other files. This is useful for sharing common data structures. The files called 1_structs.md are used for this kind of sharing. The 1_ prefix was chosen because operating systems typically iterate folder contents in alphabetical order, ensuring that it gets processed before other files in the same folder, so that the @RESTSTRUCT definition is available before it gets referenced.

If an endpoint has a schemaless JSON body or plaintext payload, then you can use a single @RESTALLBODYPARAM element instead of any @RESTBODYPARAMs:

@RESTALLBODYPARAM{name,type,necessity}
Description.

• name: A name, unused
• type: json / object or string (plaintext)
• necessity: required or optional

To describe the response payload, use a @RESTRETURNCODES section with one or more @RESTRETURNCODE subsections. You should add a subsection for every relevant HTTP status code. General status codes that are not specific to the endpoint (e.g. 503 Service Unavailable) should not be described. Each subsection may have @RESTREPLYBODY elements that describe the response data structure:

@RESTRETURNCODES

@RESTRETURNCODE{status}
Description.

@RESTREPLYBODY{name,type,necessity,subtype}
Description.

@RESTREPLYBODY...

@RESTRETURNCODE...

@RESTREPLYBODY...

• status: A 3-digit HTTP status code.
• name: The name of the reply body attribute.
• type: Swagger type (typically string, boolean, integer, number), array, or object
• necessity: either required or optional
• subtype: can be a Swagger format, reference a @RESTSTRUCT by name (if type is object or array), or be empty.

For nested data structures, as well for sharing structural descriptions between DocuBlocks, you can use @RESTSTRUCT. Such structs can be referenced in @RESTBODYPARAM, @RESTREPLYBODY, and other @RESTSTRUCT elements.

@RESTSTRUCT{name,struct,type,necessity,subtype}
Description.

• name: The name of the body parameter.
• struct: A name for this data structure that you can refer to in subtype of a @RESTBODYPARAM, @RESTREPLYBODY, or another @RESTSTRUCT element.
• type: Swagger type (typically string, boolean, integer, number), array, or object
• necessity: either required or optional
• subtype: can be a Swagger format, reference a @RESTSTRUCT by name (if type is object or array), or be empty.

Special case of a @RESTREPLYBODY element referencing a @RESTSTRUCT as top-level object description (note the empty name):

@RESTREPLYBODY{,object,required,collection_info}

Example of a response description with an array at the top-level (note the empty name):

@RESTREPLYBODY{,array,required,get_api_query_rules}

You can add an arbitrary number of examples to a DocuBlock in an @EXAMPLES section. An HTTP API example needs to be wrapped by @EXAMPLE_ARANGOSH_RUN and @END_EXAMPLE_ARANGOSH_RUN:

@EXAMPLES

@EXAMPLE_ARANGOSH_RUN{name}
    /* code */
@END_EXAMPLE_ARANGOSH_RUN

@EXAMPLE_ARANGOSH_RUN...

• name: The name of the example. Will be used as file name Documentation/Examples/<name>.generated. The convention for Rest DocuBlocks is to use PascalCase, Rest as prefix, the endpoint name, and succinct description of what the example is about, e.g. RestCollectionCreateKeyopt.

Unlike arangosh examples (@EXAMPLE_ARANGOSH_OUTPUT), requests and responses need to be output explicitly by calling one of the following functions:

• logCurlRequest(method, url, body) → response: make and output an HTTP request
• logCurlRequestRaw(method, url, body) → response: make and output an HTTP request without code highlighting
• logCurlRequestPlain(method, url, body) → response: make and output an HTTP request, with the payload decoded (new lines instead of \r\n etc.). Useful for formatting complex requests.
• logJsonResponse(response): output a JSON server reply (fails on invalid JSON)
• logJsonLResponse(response): output a JSONL server reply (fails on invalid JSON)
• logRawResponse(response): output plaintext response (do not use for JSON replies)
• logPlainResponse(response): output decoded response (new lines instead of \r\n etc.). Useful for formatting complex responses, like from batch requests.
• logHtmlResponse(response): output HTML
• logErrorResponse(response): dump reply to error log for testing (makes example generation fail)

To test whether requests and replies are as expected, you can add assert(expression) calls. Expressions that evaluate to false will make the example generation fail. You may inspect the generated JavaScript code of the failed example in arangosh.examples.js.

• Liquid Exception: No title found for /x.x/xxx.html.
  Maybe you forgot to link it to the navigation? in /_layouts/default.html
  

  Jekyll points you to the wrong file. _layouts/default.html should be fine. Jekyll has no native support for navigation menus. _plugins/NavigationTag.rb is a custom plugin to generate the left-hand side navigation from _data/<version>-<book>.yml. You probably forgot to add your new page there.

• docs/page.html
    target does not exist --- docs/page.html --> target.md
  

  If you see this error and the target ends with an .md extension then change it to .html. The resulting page has to be referenced, not the source file!

• docs/page1.html
    target does not exist --- docs/page1.html --> target.html
  docs/page2.html
    target does not exist --- docs/page2.html --> target.html
  ...
  

  or

  docs/page.html
    target is a directory, no index --- docs/page.html --> /docs/newfolder/
  

  If you get dozens of these errors for the same target, then you likely forgot to add a frontmatter to that page (docs/target.md):

  ---
  layout: default
  description: ...
  ---

  The error is issued once per page of the same book because the target page is linked in the navigation.

  Another reason can be a faulty reference in the navigation file (e.g. _data/3.9-manual.yml). The file name or directory might simply be wrong, or the file extension could be wrong or incomplete in the href attribute:

  - text: Missing L in .html
    href: page.htm
  

• docs/page.html
    hash does not exist --- docs/page.html --> target.html#hash
  

  docs/page.html
    target does not exist --- docs/page.html --> target.html
  

  Check if the target file exists and if the anchor is correct (if applicable). Look at the generated .html file if in doubt. A redirect_from frontmatter might be bad (e.g. wrong version number in path) and accidentally overwrite a page, removing the original content and links.

• docs/<version>/programs-arangod-options.html
    target does not exist --- docs/<version>/programs-arangod-options.html --> programs-arangod-<something>.html
  

  This error may start to occur after an update of the generated examples.

  The ArangoDB server (arangod) has numerous startup options. Each startup option section (--section.name) has its own page programs-arangod-<section>.md. The parent page programs-arangod-options.md automatically links to these subpages (see _includes/program-options.html) without checking if this page actually exists.

  When a new section is added to arangod (seldom), it is necessary to create a corresponding page in the docs. If no detailed descriptions are available for the newly added startup options, then reuse the arangod option descriptions.

• Configuration file: none
              Source: /path/to/docs/3.9
         Destination: /path/to/docs/3.9/_site
   Incremental build: disabled. Enable with --incremental
        Generating...
       Build Warning: Layout 'default' requested in subfolder/page.md does not exist.
       Build Warning: Layout 'default' requested in other.md does not exist.
    Liquid Exception: Liquid syntax error (line 11): Unknown tag 'docublock' in
  

  Warnings and exceptions like above show if you try to run Jekyll from a subfolder. Change your working directory to the root folder of the working copy (/path/to/docs).

• Liquid Exception: undefined method `captures' for nil:NilClass
  

  This error can be raised by the navvar method in _plugins/ExtraFilters.rb (run Jekyll with --trace to verify). Check that the working copy is clean. Stray folders with untracked Markdown files may cause this problem, e.g. the output of oasisctl generate-docs. Either remove the files or add the folder to the list of excludes in _config.yml.

• /docs/_plugins/PageNavFilter.rb:13:in `create_flat_nav': undefined method `each' for nil:NilClass (NoMethodError)
  

  This error can originate from a missing symlink, e.g. the navigation definition file for a specific version like 3.11-arangograph.yml being absent. Create a symlink that points to e.g. ../arangograph.yml to resolve the problem.

• /opt/build/repo/_plugins/versions/version.rb:45:in `<=>': undefined method `version' for nil:NilClass (NoMethodError)
  

  This error occurs sporadically in the Netlify preview builds. The cause is unclear. So far it was sufficient to trigger another build, e.g. by pushing an empty commit, and it succeeded.

• Please append `--trace` to the `build` command
  for any additional information or backtrace.
  

  This is a generic error message which requires the inspection of the stack trace to figure out the root cause of the problem.

  • …lib/jekyll/utils.rb:141:in `initialize': No such file or directory @ rb_sysopen - /path/to/file
    

    Jekyll can't open the specified file. A possible reason is that it is a binary file which is not supposed to be in the source tree in the first place or which should be excluded via _config.yml

  • …lib/safe_yaml/load.rb:143:in `parse': (/path/to/docs/_data/3.x-manual.yml):
    mapping values are not allowed in this context at line 274 column 15 (Psych::SyntaxError)
    

    The specified navigation definition file is not valid YAML. Check if the indention is correct and that you use children: if the following entries are child pages.

For the CI process we currently use Netlify. This service has been built so that you can quickly test and deploy static sites. We only use it to have a live preview and a CI pipeline, not for hosting the actual documentation site.

There are a few files in the repo required for Netlify:

• _redirects

  Defines redirects for Netlify. There is only one redirect going from / to the docs so that the site preview doesn't start with a 404 (we are generating pages into /docs/). As Netlify doesn't understand symlinks we are linking absolutely to a version.

• netlify.toml

  Defines the build pipeline. Not much going on there.

• netlify.sh

  Special script for Netlify build. Because we cannot just use a Docker container we have to download htmltest every time.

For details please check out the Netlify documentation.

The ArangoDB documentation is licensed under Apache-2.0. See LICENSE for details.

Parts not licensed under Apache-2.0 are outlined in LICENSES-OTHER-COMPONENTS.md